-- Logs begin at Tue 2022-08-30 23:32:40 UTC, end at Wed 2022-08-31 01:14:08 UTC. -- Aug 31 00:12:02.138644 dv-cinder-855060-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 00:12:02.148197 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:12:02 2022] *** Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: nodename: dv-cinder-855060-1-iscsi Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: machine: x86_64 Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: clock source: unix Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: pcre jit disabled Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: detected number of CPU cores: 4 Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: current working directory: / Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:12:02.150779 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: your processes number limit is 47680 Aug 31 00:12:02.151550 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: your memory page size is 4096 bytes Aug 31 00:12:02.151550 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: detected max file descriptor number: 2048 Aug 31 00:12:02.151550 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: lock engine: pthread robust mutexes Aug 31 00:12:02.151550 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: thunder lock: enabled Aug 31 00:12:02.151550 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 00:12:02.151550 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:12:02.189174 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: Python main interpreter initialized at 0x55cba6c709c0 Aug 31 00:12:02.189174 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: python threads support enabled Aug 31 00:12:02.189174 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: your server socket listen backlog is limited to 100 connections Aug 31 00:12:02.189174 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:12:02.189530 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:12:02.189609 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: *** Operational MODE: preforking *** Aug 31 00:12:02.189838 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:12:02.189838 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: spawned uWSGI master process (pid: 111948) Aug 31 00:12:02.190026 dv-cinder-855060-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 00:12:02.191126 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: spawned uWSGI worker 1 (pid: 111949, cores: 1) Aug 31 00:12:02.191126 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: spawned uWSGI worker 2 (pid: 111950, cores: 1) Aug 31 00:12:02.191126 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:12:02.857780 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:12:02.862849 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:12:03.950646 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:12:03.950646 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: from cryptography.utils import int_from_bytes Aug 31 00:12:03.951282 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:12:03.951282 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: from cryptography.utils import int_from_bytes Aug 31 00:12:03.952914 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:12:03.952914 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: from cryptography.utils import int_from_bytes Aug 31 00:12:03.953331 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:12:03.953331 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: from cryptography.utils import int_from_bytes Aug 31 00:12:06.492158 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:12:06.493385 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:12:06.493662 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:12:06.494036 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:12:06.494293 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:12:06.494396 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:12:06.494749 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:12:06.494840 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.494996 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.495197 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:12:06.495366 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.495622 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:12:06.495711 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.495884 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:12:06.495979 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.496274 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.496372 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.496595 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.496687 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.496914 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.497007 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.497234 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.497326 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.497493 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.497589 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.497806 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.497905 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.498130 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855060-1-iscsi {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.498224 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.498454 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.498547 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.498762 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.498873 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.499080 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.499180 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.499401 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.499493 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.499706 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.499805 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855060-1-iscsi {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.500030 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.500123 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.500336 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.500428 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.500652 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.500835 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.502030 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.502030 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.502303 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.502303 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.502555 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.502680 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.502807 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.502939 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.503094 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.503242 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.503379 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.503508 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.503647 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.503781 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.503929 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.504071 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.504203 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.504337 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.504483 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.504617 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.504753 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.504873 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855060-1-iscsi {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.505001 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.505129 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.505247 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.505380 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.505504 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.505633 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.505764 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.505900 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.506032 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855060-1-iscsi {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.506161 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.506283 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.506410 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.506551 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.506685 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.506869 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.507006 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.507181 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.507319 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.507449 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.507580 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.507741 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.507879 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.508083 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.508229 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.508545 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.508682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.508891 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.509028 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.509152 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.509322 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.509456 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.509650 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.509789 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.509976 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.510110 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.510301 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.510427 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.510560 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.510706 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.510845 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.510978 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.511196 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.511337 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.511523 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.511653 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.511831 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.511956 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.512090 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.512219 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.512348 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.512480 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.512614 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.512737 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.512932 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.513064 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.513247 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.513386 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.513555 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.513681 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.513841 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.513975 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.514357 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.514491 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.514656 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.514783 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.514985 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.515172 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.515313 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.515437 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.515613 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.515739 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.515934 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.516068 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.516249 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.516376 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.516572 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.516710 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.516878 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.517015 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.517186 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.517312 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.517495 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.517621 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.517816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.517960 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.518126 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.518250 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.518448 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.518578 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.518757 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.518892 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.519088 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.519215 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.519413 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.519541 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.519736 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.519872 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.520045 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.520186 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.520351 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.520477 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.520660 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.520787 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.520979 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.521106 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.521299 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.521431 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.521603 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.521740 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.521863 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.521991 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.522141 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.522274 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.522447 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.522584 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.522766 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.522893 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.523099 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.523241 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.523410 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.523545 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.523708 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.523843 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.524168 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.524478 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.524607 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.524796 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.525083 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.525536 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.525677 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.525853 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.526004 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.526167 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.526294 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.526479 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.526614 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.526789 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.526926 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.527124 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.527265 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.527432 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.527565 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.527737 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.527864 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.528046 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.528177 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.528355 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.528480 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.528667 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.528792 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.528978 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.529143 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.529284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.529429 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.529593 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.529722 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.529914 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.530038 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.530221 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.530353 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.530527 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.530693 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.530819 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.530944 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.531156 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.531293 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.531461 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.531587 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.531779 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.531910 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.532083 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.532208 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.532391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.532526 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.532699 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.532836 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.532998 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.533138 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.533305 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.533431 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.533616 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.533756 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.533925 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.534059 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.534228 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.534364 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.534530 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.534649 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.534832 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.535159 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.535298 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.535463 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.535589 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.535765 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.535966 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.536091 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.536225 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.536349 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.536478 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.536653 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.536786 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.536959 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.537086 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.537264 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.537397 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.537569 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.537696 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.537872 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.538008 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.538191 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.538315 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.538516 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.538647 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.538828 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.539351 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.539992 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.540194 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.540340 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.540340 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:12:06.540589 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.540719 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.540947 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.541084 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.541330 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.541540 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.541674 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.541974 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.542099 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.542313 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.542637 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.542762 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.542955 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.543235 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.543365 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.543620 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.543825 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.543965 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.544244 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.544381 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.544562 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.544887 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.545019 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.545217 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.545444 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.545571 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.545860 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.545991 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.546181 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.546505 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.546635 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.546821 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.547159 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.547306 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.547494 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.547620 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.547819 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.547946 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.548299 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.548471 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.548655 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.548781 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.549058 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.549984 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.550137 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.550272 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.550396 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.550526 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.550660 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.550784 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.550920 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.551093 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.551211 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.551333 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.551467 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.551600 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.551726 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.551848 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.551970 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.552092 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.552214 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.552352 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.552477 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.552599 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.552722 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.552845 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.552967 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.553101 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.553225 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.553347 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.553481 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.553612 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.553744 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.553908 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.554045 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.554223 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.554349 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.554549 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.554676 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.554865 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.555005 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.555848 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.555989 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.556173 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.556309 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.556491 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.556617 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.556805 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.556933 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.557146 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.557282 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.557464 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.557591 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.557792 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.557920 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.558100 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.558235 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.558409 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.558543 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.558718 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.558846 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.559030 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.559191 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.559362 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.559487 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.559674 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.559798 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.559981 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.560124 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.560288 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.560422 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.560593 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.560728 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.560904 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.561031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.561209 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.561337 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.561522 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.561655 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.561860 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.561987 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.562124 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.562260 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.562430 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.562557 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.562741 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.562876 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.563080 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.563234 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.563386 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.563511 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.563696 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.563822 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.564001 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.564134 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.564317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.564458 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.564624 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.564761 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.564930 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.565047 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.565251 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.565387 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.565561 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.565685 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.565870 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.565996 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.566184 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.566320 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.566492 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.566617 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.566802 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.566928 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.567141 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.567279 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.567455 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.567581 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.567765 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.567890 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.568080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.568216 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.568392 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.568520 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.568718 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.568853 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.569034 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.569161 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.569348 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.569477 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.569653 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.569790 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.569965 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.570101 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.570274 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.570408 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.570584 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.570738 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.570931 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.571085 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.571268 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.571407 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.571576 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.571712 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.571884 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.572011 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.572190 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.572323 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.572495 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.572633 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.572801 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.572935 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.573126 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.573261 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.573436 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.573572 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.573743 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.573870 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.574046 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.574177 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.574350 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.574476 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.574652 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.574786 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.574978 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.575139 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.575317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.575445 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.575626 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.575755 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.575932 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.576058 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.576237 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.576357 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.576581 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.576716 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.576887 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.577014 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.577219 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.577345 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.577539 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.577666 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.577855 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.577983 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.578170 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.578299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.578487 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.578612 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.578801 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.578943 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.579134 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.579261 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.579450 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.579587 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.579765 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.579900 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.580079 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.580214 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.580401 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.580527 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.580711 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.580848 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.581029 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.581156 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.581339 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.581466 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.581683 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.581833 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.581980 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.582118 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.582302 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.582430 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.582609 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.582736 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.582921 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.583083 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.583262 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.583397 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.583578 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.583713 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.583892 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.584020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.584210 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.584345 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.584523 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.584649 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.584838 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.584964 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.585175 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.585315 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.585449 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.585574 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.585740 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.585877 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.586052 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.586178 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.586408 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.586545 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.586783 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.586907 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.587134 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.587285 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.587446 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.587572 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.587771 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.587905 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.588085 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.588221 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.588400 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.588533 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.588703 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.588828 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.589017 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.589187 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.589318 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.589449 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.589626 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.589753 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.589936 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.590110 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.590236 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.590359 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.590543 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.590671 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.590874 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.591007 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.591185 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.591311 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.591497 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.591624 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.591802 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.591927 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.592110 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.592244 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.592419 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.592554 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.592726 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.592861 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.593031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.593164 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.593343 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.593539 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.593676 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.593807 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.593952 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.594089 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.594259 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.594406 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.594563 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.594698 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.594865 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.594992 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.595197 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.595337 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.595522 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.595647 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.595832 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.595957 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.596142 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.596270 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.596453 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.596574 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.596756 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.596889 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.597059 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.597199 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.597383 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.597509 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.597693 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.597819 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.597998 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.598123 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.598304 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.598431 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.598611 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.598738 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.598925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.599123 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.599250 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.599372 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.599560 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.599686 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.599877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.600003 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.600191 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.600308 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.600498 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.600623 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.600810 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.600937 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.601117 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.601242 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.601427 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.601561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.601738 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.601870 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.602643 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.602979 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.603198 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.603342 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.603467 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.603623 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.603751 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.603942 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.604078 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.604254 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.604390 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.604580 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.604706 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.604889 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.605023 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.605200 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.605512 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.605648 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.605817 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.605942 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.606130 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.606264 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.606445 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.606578 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.606769 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.607013 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.607178 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.607369 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.607513 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.607685 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.607812 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.608004 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.608130 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.608324 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.608452 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.608671 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.608796 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.608979 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.609119 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.609286 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.609428 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.609599 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.609725 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.609906 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.610033 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.610211 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.610346 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.610516 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.610651 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.610816 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.610942 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.611140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.611281 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.611447 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.611572 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.611748 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.611873 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.612047 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.612167 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.612356 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.612485 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.612661 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.612785 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.612960 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.613093 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.613261 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.613387 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.613564 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.613690 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.613878 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.614004 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.614178 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.614310 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.614480 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.614614 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.614781 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.614907 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.615128 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.615259 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.615435 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.615562 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.615772 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.615899 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.616023 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.616145 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.616317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.616449 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.616660 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.616781 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.616965 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.617093 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.617303 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.617439 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.618165 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.618367 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.618557 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.618685 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.618840 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.619020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.619169 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.619292 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.619414 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.619536 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.619712 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.619855 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.620028 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.620154 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.620342 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.620468 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.620655 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.620791 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.620966 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.621092 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.621274 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.621399 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.621586 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.621712 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.621890 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.622016 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.622207 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.622325 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.622518 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.622643 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.622821 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.622947 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.623147 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.623273 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.623451 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.623576 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.623761 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.623884 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.624066 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.624203 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.624370 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.624496 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.624674 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.624855 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.624992 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.625127 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.625286 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.625575 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.625701 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.625889 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.626027 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.626202 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.626328 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.626512 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.626653 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.626818 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.626938 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.627166 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.627483 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.627608 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.627792 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.627918 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.628102 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.628230 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.628412 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.628538 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.628720 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.628853 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.629029 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.629193 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.629328 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.629523 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.629656 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.629837 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.629972 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.630144 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.630273 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.630452 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.630579 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.630764 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.630886 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.631158 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.631468 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.631778 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.632082 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.632389 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.632693 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.632999 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.633386 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.633708 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.634108 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.634422 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.634734 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.634858 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.635066 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.635317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.635456 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.635669 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.635808 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.636028 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.636156 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.636356 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.636627 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.636763 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.636962 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.637088 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.637285 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.637409 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.637602 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.637729 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.637920 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.638053 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.638228 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.638354 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.638546 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.638861 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.638992 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.639440 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.639639 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.639775 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.639963 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.640090 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.640285 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.640412 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.640606 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.640741 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.640926 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.641060 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.641265 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.641392 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.641587 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.641723 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.641905 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.642031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.642210 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.642335 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.642524 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.642659 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.642840 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.642981 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.643176 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.643304 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.643491 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.643635 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.643805 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.643933 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.644123 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.644250 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.644441 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.644577 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.644756 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.644883 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.645071 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.645200 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.645392 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.645528 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.645702 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.645827 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.646013 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.646138 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.646326 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.646454 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.646636 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.646770 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.646944 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.647152 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.647288 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.647413 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.647586 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.647711 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.647899 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.648026 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.648229 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.648355 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.648512 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.648639 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.648851 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.649000 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.649313 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.649629 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.649754 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.649947 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.650195 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.650339 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.650464 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.650586 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.650716 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.650863 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.650989 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.651211 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.651341 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.651532 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.651667 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.651843 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.651970 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.652191 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.652325 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.652511 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.652637 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.652828 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.652954 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.653144 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.653272 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.653457 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.653592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.653772 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.653911 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.654085 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.654209 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.654392 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.654527 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.654707 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.654842 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.655018 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.655171 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.655347 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.655473 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.655663 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.655799 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.655972 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.656097 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.656286 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.656418 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.656595 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.656730 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.657015 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.657139 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.657328 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.657455 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.657642 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.657767 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.657951 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.658086 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.658273 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.658398 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.658586 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.658714 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.658907 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.659065 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.659251 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.659378 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.659561 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.659698 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.659935 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.660060 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.660251 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.660377 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.660583 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.660711 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.660898 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.661023 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.661206 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.661342 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.661514 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.661640 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.661821 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.661946 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.662150 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.662287 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.662457 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.662603 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.662766 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.662881 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.663096 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.663241 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.663426 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.663562 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.663734 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.663870 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.664060 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.664195 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.665008 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.665287 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.665631 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.665798 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.665923 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.666046 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.666046 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.666282 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.666420 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.666545 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.666668 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.666791 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.666922 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.667069 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.667194 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.667395 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.667523 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.667726 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.667866 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.668039 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.668167 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.668358 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.668485 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.668666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.668800 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.668968 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.669094 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.669286 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.669413 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.669593 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.669729 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.669919 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.670044 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.670227 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.670354 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.670554 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.670762 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.670890 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.671012 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.671200 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.671339 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.671528 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.671654 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.671839 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.671965 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.672152 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.672281 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.672465 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.672593 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.672776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.672903 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.673125 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.673254 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.673436 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.673564 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.673762 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.673888 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.674089 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.674223 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.674399 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.674527 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.674707 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.674834 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.675061 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.675205 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.675366 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.675486 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.675959 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.676108 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.676242 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.676367 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.676493 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.676624 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.676753 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.676876 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.677000 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.677131 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.677263 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.677386 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.677500 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.677622 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.677788 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.677917 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.678095 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.678221 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.678407 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.678536 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.678715 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.678852 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.679022 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.679185 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.679349 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.679477 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.679664 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.679790 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.679974 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.680139 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.680946 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.681075 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.681310 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.681438 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.681631 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.681760 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.681945 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.682082 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.682258 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.682385 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.682601 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.682736 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.682907 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.683099 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.683262 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.683387 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.683575 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.683702 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.683906 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.684043 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.684228 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.684353 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.684546 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.684671 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.684867 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.684994 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.685179 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.685305 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.685463 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.685591 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.685777 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.685905 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.686085 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.686212 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.686391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.686511 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.686697 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.686825 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.687007 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.687177 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.687336 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.687462 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.687642 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.687901 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.688029 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.688245 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.688373 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.688558 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.688692 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.688879 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.689013 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.689191 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.689326 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.689528 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.689655 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.689799 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.689927 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.690107 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.690261 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.690428 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.690586 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.690744 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.690870 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.691082 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.691213 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.691397 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.691524 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.691726 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.691853 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.692047 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.692185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.692367 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.692495 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.692685 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.692812 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.693004 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.693145 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.693323 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.693458 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.693640 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.693758 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.693958 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.694097 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.694269 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.694396 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.694586 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.694721 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.694902 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.695066 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.695242 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.695370 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.695559 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.695939 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.696132 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.696329 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.696459 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.696654 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.697004 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.697144 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.697334 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.697464 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.697681 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.697823 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.697979 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.698116 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.698301 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.698430 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.698622 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.698757 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.698957 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.699130 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.699327 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.699470 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.699657 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.699784 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.699978 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.700119 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.700301 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.700429 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.700624 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.700758 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.700951 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.701154 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.701281 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.701477 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.701607 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.701819 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.701961 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.702152 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.702280 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.702485 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.702614 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.702808 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.702936 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.703151 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.703281 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.703471 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.703597 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.703787 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.703914 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.704097 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.704232 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.704410 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.704535 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.704722 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.704850 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.705033 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.705161 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.705344 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.705469 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.705657 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.705786 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.705966 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.706076 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.706278 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.706413 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.706597 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.706715 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.706932 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.707141 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.707282 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.707499 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.707627 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.707823 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.707950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.708156 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.708291 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.708488 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.708707 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.708834 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.709025 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.709152 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.709361 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.709490 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.709692 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.709818 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.710021 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.710155 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.710341 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.710468 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.710658 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.710785 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.710970 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.711145 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.711307 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.711465 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.711649 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.711777 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.711964 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.712099 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.712272 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.712398 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.712576 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.712701 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.712885 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.713019 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.713198 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.713324 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.713508 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.713637 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.713815 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.713950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.714125 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.714253 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.714442 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.714657 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.714793 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.715009 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.715171 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.715354 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.715490 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.715661 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.715780 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.715979 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.716108 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.716292 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.716427 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.716606 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.716745 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.716914 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.717047 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.717231 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.717358 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.717539 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.717673 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.717855 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.717982 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.718165 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.718291 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.718473 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.718610 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.718782 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.718909 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.719116 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.719247 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.719430 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.719641 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.719768 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.719891 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.720022 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.720147 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.720329 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.720458 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.720658 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.720785 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.720967 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.721095 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.721275 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.721403 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.721582 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.721854 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.721981 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.722192 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.722326 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.722500 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.722636 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.722807 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.722935 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.723137 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.723285 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.723454 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.723583 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.723762 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.723890 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.724073 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.724199 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.724379 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.724505 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.724696 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.724822 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.725005 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.725132 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.725314 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.725438 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.725629 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.725764 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.725943 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.726071 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.726260 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.726380 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.726567 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.726694 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.726880 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.727549 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.727773 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.727895 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.728281 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.728575 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.728705 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.728895 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.729023 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.729208 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.729333 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.729521 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.729841 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.729968 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.730191 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.730319 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.730517 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.730817 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.730947 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.731174 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.731301 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.731500 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.731642 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.731814 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.731950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.732128 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.732255 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.732442 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.732579 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.732752 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.732884 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.733062 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.733189 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.733388 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.733529 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.733704 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.733829 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.734015 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.734150 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.734327 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.734466 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.734643 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.734771 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.734956 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.735104 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.735294 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.735424 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.735606 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.735740 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.735917 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.736045 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.736229 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.736363 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.736540 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.736676 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.736851 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.736978 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.737161 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.737298 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.737472 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.737599 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.737782 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.737904 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.738097 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.738217 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.738442 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.738579 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.738764 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.738901 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.739109 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.739241 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.739427 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.739556 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.739737 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.739877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.740046 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.740172 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.740355 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.740483 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.740659 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.740788 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.740966 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.741094 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.741278 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.741407 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.741587 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.741715 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.741894 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.742029 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.742249 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.742384 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.742519 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.742776 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.743011 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.743152 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.743367 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.743505 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.743692 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.743828 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.744006 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.744135 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.744322 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.744463 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.744631 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.744759 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.744938 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.745066 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.745252 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.745389 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.745562 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.745691 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.745870 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.745998 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.746182 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.746319 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.746490 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.746617 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.746800 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.746935 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.747160 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.747302 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.747467 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.747592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.747774 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.747902 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.748085 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.748213 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.748405 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.748541 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.748715 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.748843 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.749021 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.749149 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.749325 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.749453 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.749634 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.749769 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.749969 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.750095 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.750219 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.750342 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.750521 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.750657 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.750825 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.750960 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.751157 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.751286 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.751464 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.751600 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.751769 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.751898 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.752074 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.752201 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.752378 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.752515 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.752683 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.752817 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.752988 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.753103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.753302 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.753432 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.753612 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.753739 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.753917 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.754045 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.754223 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.754350 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.754527 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.754654 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.754831 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.754966 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.755189 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.755319 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.755506 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.755633 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.755824 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.755952 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.756138 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.756266 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.756450 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.756575 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.756769 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.756908 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.757077 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.757203 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.757392 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.757517 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.757706 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.757842 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.758020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.758145 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.758895 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.759022 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.759258 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.759404 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.759590 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.759736 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.759892 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.760020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.760205 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.760342 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.760519 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.760647 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.760831 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.760960 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.761141 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.761269 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.761471 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.761599 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.761800 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.761928 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.762109 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.762237 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.762438 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.762568 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.762742 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.762868 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.763001 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:12:06.763171 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.763402 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.763716 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.764047 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.764614 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.764928 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.765238 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.765551 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.765863 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.766181 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.766493 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.766804 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.767149 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.767466 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.767792 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.768118 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.768431 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.768830 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.769088 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.769436 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.769752 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.770096 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.770428 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.770742 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.771070 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.771381 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:12:06.771625 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:12:06.919654 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO dbcounter [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Registered counter for database nova_api Aug 31 00:12:06.926389 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO dbcounter [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Registered counter for database nova_api Aug 31 00:12:06.939602 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc87776-207d-4c40-b204-52f858621496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:12:06.946205 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_db.sqlalchemy.engines [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:12:06.946484 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writer thread running {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:12:06.952820 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writer thread running {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:12:07.005063 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.context [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),17a2f83e-804b-4b78-9634-80dd5da1cac2(cell1) {{(pid=111950) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:12:07.009598 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG oslo_concurrency.lockutils [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:12:07.010077 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG oslo_concurrency.lockutils [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:12:07.011337 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.context [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),17a2f83e-804b-4b78-9634-80dd5da1cac2(cell1) {{(pid=111949) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:12:07.011678 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG oslo_concurrency.lockutils [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:12:07.012416 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG oslo_concurrency.lockutils [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:12:07.012866 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG oslo_concurrency.lockutils [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:12:07.015132 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG oslo_concurrency.lockutils [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:12:07.015462 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:12:07.015942 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:12:07.017116 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO dbcounter [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Registered counter for database nova_cell0 Aug 31 00:12:07.017489 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:12:07.018220 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:12:07.018661 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:12:07.020784 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:12:07.021243 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO dbcounter [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Registered counter for database nova_cell1 Aug 31 00:12:07.022744 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO dbcounter [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Registered counter for database nova_cell0 Aug 31 00:12:07.027162 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO dbcounter [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Registered counter for database nova_cell1 Aug 31 00:12:07.028593 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc87776-207d-4c40-b204-52f858621496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:12:07.030323 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc87776-207d-4c40-b204-52f858621496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:12:07.035971 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writer thread running {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:12:07.037829 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_db.sqlalchemy.engines [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:12:07.038586 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_db.sqlalchemy.engines [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:12:07.038760 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writer thread running {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:12:07.045445 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writer thread running {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:12:07.046871 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writer thread running {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:12:07.182748 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO dbcounter [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Registered counter for database nova_cell0 Aug 31 00:12:07.189576 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc87776-207d-4c40-b204-52f858621496 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:12:07.190029 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO dbcounter [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Registered counter for database nova_cell0 Aug 31 00:12:07.193998 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writer thread running {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:12:07.198817 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_db.sqlalchemy.engines [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:12:07.203578 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writer thread running {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:12:07.534663 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: WARNING keystonemiddleware.auth_token [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:12:07.540896 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: WARNING keystonemiddleware.auth_token [None req-8dc87776-207d-4c40-b204-52f858621496 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:12:07.542616 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: WARNING keystonemiddleware.auth_token [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:12:07.548182 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: WARNING keystonemiddleware.auth_token [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:12:07.890024 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: WARNING keystonemiddleware.auth_token [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:12:07.896021 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: WARNING keystonemiddleware.auth_token [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:12:07.897829 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: WARNING keystonemiddleware.auth_token [None req-8dc87776-207d-4c40-b204-52f858621496 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:12:07.901800 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cba6c709c0 pid: 111949 (default app) Aug 31 00:12:07.903893 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:07.904657 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: WARNING keystonemiddleware.auth_token [None req-8dc87776-207d-4c40-b204-52f858621496 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:12:07.905078 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001756 Aug 31 00:12:07.905492 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Wed Aug 31 00:12:07 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:07.909976 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cba6c709c0 pid: 111950 (default app) Aug 31 00:13:28.184965 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:28.188391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002563 Aug 31 00:13:28.189914 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:28.203194 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writing DB stats nova_api:SELECT=3 {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:28.207816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writing DB stats nova_cell1:SELECT=3 {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:28.208620 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writing DB stats nova_cell0:SELECT=3 {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:28.209767 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:29.104962 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-2ad9c8b6-d6da-45ca-8178-61b7f3e32171 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:29.137787 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-2ad9c8b6-d6da-45ca-8178-61b7f3e32171 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.940552 Aug 31 00:13:29.138511 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 31 00:13:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:31.546046 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:31.548035 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-c3fa0ea0-ca3d-41e2-93b0-9194684250f5 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002479 Aug 31 00:13:31.554406 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:31 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:31.995233 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-f9941b58-5081-4cce-a1f8-9f7655d39ed5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "name": "cirros256", "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:32.045543 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-f9941b58-5081-4cce-a1f8-9f7655d39ed5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.489993 Aug 31 00:13:32.051328 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:32.273070 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-71b7e951-c1c7-4635-bef0-5c86b9bab7d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:32.279438 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writing DB stats nova_api:SELECT=3 {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:32.280243 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writing DB stats nova_cell0:SELECT=3 {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:32.281766 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writing DB stats nova_cell1:SELECT=3 {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:32.282424 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:32.346223 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-71b7e951-c1c7-4635-bef0-5c86b9bab7d7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289735 Aug 31 00:13:32.346223 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1336 bytes} [Wed Aug 31 00:13:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:34.761751 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-f9941b58-5081-4cce-a1f8-9f7655d39ed5 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:34.762826 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-f9941b58-5081-4cce-a1f8-9f7655d39ed5 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 31 00:13:34.763579 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:35.444017 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-04e3d721-38b0-4a11-af9b-1df29488d82c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "disk": 5}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:35.484925 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-04e3d721-38b0-4a11-af9b-1df29488d82c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.713024 Aug 31 00:13:35.487089 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:35.498319 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-c3c993eb-4cf3-4a78-b208-ddfa72e6e5a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:35.538496 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-c3c993eb-4cf3-4a78-b208-ddfa72e6e5a1 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043924 Aug 31 00:13:35.539109 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1336 bytes} [Wed Aug 31 00:13:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:13:37.994805 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-04e3d721-38b0-4a11-af9b-1df29488d82c admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:37.995863 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-04e3d721-38b0-4a11-af9b-1df29488d82c admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 31 00:13:37.996286 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:38.411809 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-f7665e0e-8a23-4dd5-b24b-5eb9b6317cec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "id": "d2", "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:38.430029 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-f7665e0e-8a23-4dd5-b24b-5eb9b6317cec admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427562 Aug 31 00:13:38.430561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:38.443743 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-5113fb26-2ac0-479c-9052-d02fe168a3e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:38.468289 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-5113fb26-2ac0-479c-9052-d02fe168a3e7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028395 Aug 31 00:13:38.469239 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1336 bytes} [Wed Aug 31 00:13:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:13:40.884075 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-f7665e0e-8a23-4dd5-b24b-5eb9b6317cec admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:40.885084 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-f7665e0e-8a23-4dd5-b24b-5eb9b6317cec admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 31 00:13:40.885682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:41.367621 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-2a43c619-eaf6-48d6-a88a-591ea8e58287 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:41.388059 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-2a43c619-eaf6-48d6-a88a-591ea8e58287 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495938 Aug 31 00:13:41.388687 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:13:41.401397 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-89f10925-0e63-4b25-a01e-930e36836e1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:41.426970 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-89f10925-0e63-4b25-a01e-930e36836e1a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029152 Aug 31 00:13:41.427606 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1336 bytes} [Wed Aug 31 00:13:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:43.813265 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-2a43c619-eaf6-48d6-a88a-591ea8e58287 admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:43.814206 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-2a43c619-eaf6-48d6-a88a-591ea8e58287 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Aug 31 00:13:43.814603 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:44.263448 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-2c30a411-c9b6-4181-8937-b380dfa537db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20}} {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:44.284924 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-2c30a411-c9b6-4181-8937-b380dfa537db admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464199 Aug 31 00:13:44.287113 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:44.297778 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-b6d0c1d7-bd30-48ea-aaa9-50297a77a288 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:44.323514 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-b6d0c1d7-bd30-48ea-aaa9-50297a77a288 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029465 Aug 31 00:13:44.324539 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1336 bytes} [Wed Aug 31 00:13:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:13:47.115768 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-2c30a411-c9b6-4181-8937-b380dfa537db admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:47.116794 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-2c30a411-c9b6-4181-8937-b380dfa537db admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 31 00:13:47.117159 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:47.559237 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-6a2011db-db75-4088-a547-dd6877a5bb95 admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:47.590038 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-6a2011db-db75-4088-a547-dd6877a5bb95 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466443 Aug 31 00:13:47.590715 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 31 00:13:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:13:50.410934 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-2c30a411-c9b6-4181-8937-b380dfa537db admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:50.411984 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-2c30a411-c9b6-4181-8937-b380dfa537db admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 31 00:13:50.412416 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:50.846613 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-c8f1ae22-854c-458c-97fc-236b3f3fad4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:50.868235 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-c8f1ae22-854c-458c-97fc-236b3f3fad4a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.447907 Aug 31 00:13:50.869003 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:13:50.880940 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-58dae4a4-a3c6-459e-9065-7bab77e30575 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:50.906337 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-58dae4a4-a3c6-459e-9065-7bab77e30575 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028444 Aug 31 00:13:50.907006 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1333 bytes} [Wed Aug 31 00:13:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:53.262085 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-c8f1ae22-854c-458c-97fc-236b3f3fad4a admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:53.263128 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-c8f1ae22-854c-458c-97fc-236b3f3fad4a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 31 00:13:53.263542 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:53.684515 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a229d8f8-536c-417b-9bf8-a4eadb5d0755 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048}} {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:53.703753 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a229d8f8-536c-417b-9bf8-a4eadb5d0755 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.433396 Aug 31 00:13:53.704307 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:53.716201 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-8a05897e-b1de-4093-9f56-b0f3dd9cfcdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:53.741753 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-8a05897e-b1de-4093-9f56-b0f3dd9cfcdd admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029141 Aug 31 00:13:53.742364 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1333 bytes} [Wed Aug 31 00:13:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:13:56.178401 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a229d8f8-536c-417b-9bf8-a4eadb5d0755 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:56.180283 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a229d8f8-536c-417b-9bf8-a4eadb5d0755 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002344 Aug 31 00:13:56.180969 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:56.627785 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-ba7b3a6e-09b2-46e8-a24a-36effb405f5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "id": "3"}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:56.654833 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-ba7b3a6e-09b2-46e8-a24a-36effb405f5d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.466786 Aug 31 00:13:56.657322 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:56.667695 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-00710b44-5d8a-42fd-af77-02ae5a9efe61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:56.694847 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-00710b44-5d8a-42fd-af77-02ae5a9efe61 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030744 Aug 31 00:13:56.695845 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1333 bytes} [Wed Aug 31 00:13:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:59.139681 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-ba7b3a6e-09b2-46e8-a24a-36effb405f5d admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:59.144071 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-ba7b3a6e-09b2-46e8-a24a-36effb405f5d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.007273 Aug 31 00:13:59.145170 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:13:59 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:59.610901 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-aeb868e4-125d-4ad9-b4fb-3b6ae67d4e31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:59.618081 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:59.632677 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-aeb868e4-125d-4ad9-b4fb-3b6ae67d4e31 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.480136 Aug 31 00:13:59.633747 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 31 00:13:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:13:59.646892 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-1f06b375-e044-4245-ac89-88614c55c3b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:13:59.673618 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-1f06b375-e044-4245-ac89-88614c55c3b5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030216 Aug 31 00:13:59.674540 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1333 bytes} [Wed Aug 31 00:13:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:14:02.089331 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-aeb868e4-125d-4ad9-b4fb-3b6ae67d4e31 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:02.090435 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-aeb868e4-125d-4ad9-b4fb-3b6ae67d4e31 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 31 00:14:02.090838 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:14:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:02.558956 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-598fe0cd-f253-44e5-ba5d-4b50469c20bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:14:02.566595 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:02.582860 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-598fe0cd-f253-44e5-ba5d-4b50469c20bc admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.484734 Aug 31 00:14:02.591245 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 31 00:14:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:14:02.596589 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-e67c83bb-50af-40c0-8887-0ba7da993df7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:14:02.621765 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-e67c83bb-50af-40c0-8887-0ba7da993df7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029500 Aug 31 00:14:02.622544 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1333 bytes} [Wed Aug 31 00:14:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:14:20.996490 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-598fe0cd-f253-44e5-ba5d-4b50469c20bc admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:20.997531 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-598fe0cd-f253-44e5-ba5d-4b50469c20bc admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 31 00:14:20.998674 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:21.009549 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:21.386102 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-2e7b3cdb-2ae3-4e49-8483-20737e576a80 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:21.406006 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-2e7b3cdb-2ae3-4e49-8483-20737e576a80 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400906 Aug 31 00:14:21.406543 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 31 00:14:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:14:22.467991 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-598fe0cd-f253-44e5-ba5d-4b50469c20bc admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:22.468997 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-598fe0cd-f253-44e5-ba5d-4b50469c20bc admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002262 Aug 31 00:14:22.469394 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:23.053331 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a41310be-669e-48a2-b5c6-558b78ba7232 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:23.059187 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.wsgi [None req-a41310be-669e-48a2-b5c6-558b78ba7232 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a41310be-669e-48a2-b5c6-558b78ba7232 admin admin] Request method failure captured: Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Accept: application/json Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Accept-Encoding: gzip, deflate Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Connection: keep-alive Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Content-Length: 0 Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Host: 10.222.0.67 Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Openstack-Api-Version: compute 2.90 Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Openstack-System-Scope: None Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: User-Agent: python-novaclient Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Auth-Token: gAAAAABjDqfevt-qX9rH9-oOPbbSngukcllxnOYxIrT5109uH50Z0zkyJvpJ6YyFvVoALphbnTvGTQJnbwDR0SC6H7cauqtkceNuOKi0TKmk8EWUZ3O2P3ebTsDQeGjPw9DeF_FgjSpbXllTnhxXLLh_InTS8EZcqTJGQyT6LOeg2wfKSrKVBJw Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Domain-Id: None Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Domain-Name: None Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Identity-Status: Confirmed Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Is-Admin-Project: True Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Domain-Id: default Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Domain-Name: Default Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Name: admin Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Role: admin,reader,member Aug 31 00:14:23.063185 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Roles: admin,reader,member Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1509e8ef0c6042559698c40a7a07a646", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Tenant: admin Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Tenant-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Tenant-Name: admin Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User: admin Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Domain-Id: default Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Domain-Name: Default Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Id: 19ddd6d02b884bcab507cb5ed1181266 Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Name: admin Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: method: > Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: exception: Flavor 42 could not be found. Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: action_args: {'id': '42'} Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:14:23.064816 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:23.065776 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:23.067140 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a41310be-669e-48a2-b5c6-558b78ba7232 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:14:23.068437 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a41310be-669e-48a2-b5c6-558b78ba7232 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.431782 Aug 31 00:14:23.068437 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 31 00:14:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 00:14:23.075799 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-69537b34-70a6-4327-878a-6db64e4b6cfc admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:23.098895 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-69537b34-70a6-4327-878a-6db64e4b6cfc admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027028 Aug 31 00:14:23.099498 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 31 00:14:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:14:23.110068 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a947fab9-6154-4ff3-abb9-e0589fabe11a admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:23.132834 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a947fab9-6154-4ff3-abb9-e0589fabe11a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026992 Aug 31 00:14:23.133592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 31 00:14:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:14:23.143838 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-6af336a7-44e9-468d-83b6-e5135f8fcb89 admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:23.150078 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.wsgi [None req-6af336a7-44e9-468d-83b6-e5135f8fcb89 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-6af336a7-44e9-468d-83b6-e5135f8fcb89 admin admin] Request method failure captured: Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Accept: application/json Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Accept-Encoding: gzip, deflate Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Connection: keep-alive Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Content-Length: 0 Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Host: 10.222.0.67 Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Openstack-Api-Version: compute 2.90 Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Openstack-System-Scope: None Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: User-Agent: python-novaclient Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Auth-Token: gAAAAABjDqfevt-qX9rH9-oOPbbSngukcllxnOYxIrT5109uH50Z0zkyJvpJ6YyFvVoALphbnTvGTQJnbwDR0SC6H7cauqtkceNuOKi0TKmk8EWUZ3O2P3ebTsDQeGjPw9DeF_FgjSpbXllTnhxXLLh_InTS8EZcqTJGQyT6LOeg2wfKSrKVBJw Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Domain-Id: None Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Domain-Name: None Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Identity-Status: Confirmed Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Is-Admin-Project: True Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Domain-Id: default Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Domain-Name: Default Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Name: admin Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Role: admin,reader,member Aug 31 00:14:23.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Roles: admin,reader,member Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1509e8ef0c6042559698c40a7a07a646", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Tenant: admin Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Tenant-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Tenant-Name: admin Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User: admin Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Domain-Id: default Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Domain-Name: Default Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Id: 19ddd6d02b884bcab507cb5ed1181266 Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Name: admin Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: method: > Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: exception: Flavor 42 could not be found. Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: action_args: {'id': '42'} Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:14:23.155284 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:23.156317 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:23.157610 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-6af336a7-44e9-468d-83b6-e5135f8fcb89 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:14:23.158864 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-6af336a7-44e9-468d-83b6-e5135f8fcb89 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015083 Aug 31 00:14:23.158864 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 31 00:14:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:24.146136 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a947fab9-6154-4ff3-abb9-e0589fabe11a admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:24.147211 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a947fab9-6154-4ff3-abb9-e0589fabe11a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 31 00:14:24.147599 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:24.681111 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-8af96b2c-9600-44b9-9897-f5bf11d9e01d admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:24.687423 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.wsgi [None req-8af96b2c-9600-44b9-9897-f5bf11d9e01d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-8af96b2c-9600-44b9-9897-f5bf11d9e01d admin admin] Request method failure captured: Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Accept: application/json Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Accept-Encoding: gzip, deflate Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Connection: keep-alive Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Content-Length: 0 Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Host: 10.222.0.67 Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Openstack-Api-Version: compute 2.90 Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Openstack-System-Scope: None Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: User-Agent: python-novaclient Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Auth-Token: gAAAAABjDqfgxEexYLO9PNnHrRWgnnR-zoqm-bjDkaN-1rqIV8sbWbx06qVtpqk5Bv0SX3dfmj_nL77pirQttyk4l9pC21g1rJJfhnqi9EOSCFnYqT04SL1qpvC9llZ01sVYsmyg0tnnbiqfEDKOlu5fZITPySVTAHUPuoJVOYtf0nGBxw1mUeU Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Domain-Id: None Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Domain-Name: None Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Identity-Status: Confirmed Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Is-Admin-Project: True Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Domain-Id: default Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Domain-Name: Default Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Name: admin Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Role: admin,reader,member Aug 31 00:14:24.688950 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Roles: admin,reader,member Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1509e8ef0c6042559698c40a7a07a646", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Tenant: admin Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Tenant-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Tenant-Name: admin Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User: admin Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Domain-Id: default Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Domain-Name: Default Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Id: 19ddd6d02b884bcab507cb5ed1181266 Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Name: admin Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: method: > Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: exception: Flavor 84 could not be found. Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: action_args: {'id': '84'} Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:14:24.690443 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:24.691518 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:24.692877 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-8af96b2c-9600-44b9-9897-f5bf11d9e01d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:14:24.694100 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-8af96b2c-9600-44b9-9897-f5bf11d9e01d admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.405306 Aug 31 00:14:24.694100 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 31 00:14:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:24.700009 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-78c42df0-0551-4562-bc9b-77e0469c2bbd admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:24.715601 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-78c42df0-0551-4562-bc9b-77e0469c2bbd admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019160 Aug 31 00:14:24.716638 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 31 00:14:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:14:24.726377 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-ffa98767-cca0-42ab-96f4-40680798963e admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:24.742172 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-ffa98767-cca0-42ab-96f4-40680798963e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019399 Aug 31 00:14:24.742728 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 31 00:14:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:14:24.752058 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-c3f05b50-97c8-4001-9065-93e915a58de1 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:24.757570 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.wsgi [None req-c3f05b50-97c8-4001-9065-93e915a58de1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-c3f05b50-97c8-4001-9065-93e915a58de1 admin admin] Request method failure captured: Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Accept: application/json Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Accept-Encoding: gzip, deflate Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Connection: keep-alive Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Content-Length: 0 Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Host: 10.222.0.67 Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Openstack-Api-Version: compute 2.90 Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Openstack-System-Scope: None Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: User-Agent: python-novaclient Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Auth-Token: gAAAAABjDqfgxEexYLO9PNnHrRWgnnR-zoqm-bjDkaN-1rqIV8sbWbx06qVtpqk5Bv0SX3dfmj_nL77pirQttyk4l9pC21g1rJJfhnqi9EOSCFnYqT04SL1qpvC9llZ01sVYsmyg0tnnbiqfEDKOlu5fZITPySVTAHUPuoJVOYtf0nGBxw1mUeU Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Domain-Id: None Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Domain-Name: None Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Identity-Status: Confirmed Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Is-Admin-Project: True Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Domain-Id: default Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Domain-Name: Default Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Name: admin Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Role: admin,reader,member Aug 31 00:14:24.759103 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Roles: admin,reader,member Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1509e8ef0c6042559698c40a7a07a646", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Tenant: admin Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Tenant-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Tenant-Name: admin Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User: admin Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Domain-Id: default Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Domain-Name: Default Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Id: 19ddd6d02b884bcab507cb5ed1181266 Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Name: admin Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: method: > Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: exception: Flavor 84 could not be found. Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: action_args: {'id': '84'} Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:14:24.760682 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:24.761666 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:24.763031 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-c3f05b50-97c8-4001-9065-93e915a58de1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:14:24.764322 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-c3f05b50-97c8-4001-9065-93e915a58de1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011983 Aug 31 00:14:24.764322 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 31 00:14:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:25.762751 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-ffa98767-cca0-42ab-96f4-40680798963e admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:25.764213 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-ffa98767-cca0-42ab-96f4-40680798963e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001838 Aug 31 00:14:25.764608 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:26.323012 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-0a98e86d-52d0-460c-afc7-be2d584013d4 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:26.330373 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.wsgi [None req-0a98e86d-52d0-460c-afc7-be2d584013d4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-0a98e86d-52d0-460c-afc7-be2d584013d4 admin admin] Request method failure captured: Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Accept: application/json Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Accept-Encoding: gzip, deflate Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Connection: keep-alive Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Content-Length: 0 Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Host: 10.222.0.67 Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Openstack-Api-Version: compute 2.90 Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Openstack-System-Scope: None Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: User-Agent: python-novaclient Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Auth-Token: gAAAAABjDqfhcDOcI9JT9KaKFQxR9Q6N4Gakc9BSdBxncKxxXWmSElSitRvhbH1c0jp_FKTJWnWk8vospjSXTdxtyPYFYc4cVa9MWjVNz181my8c9_j7YtolOfS_W0HH25JLHDMRIwgIKA_WRgCp7vJaGSxR0MiqGfTL1RY11pK57hYnE3RZsxg Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Domain-Id: None Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Domain-Name: None Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Identity-Status: Confirmed Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Is-Admin-Project: True Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Domain-Id: default Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Domain-Name: Default Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Project-Name: admin Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Role: admin,reader,member Aug 31 00:14:26.331925 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Roles: admin,reader,member Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1509e8ef0c6042559698c40a7a07a646", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Tenant: admin Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Tenant-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-Tenant-Name: admin Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User: admin Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Domain-Id: default Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Domain-Name: Default Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Id: 19ddd6d02b884bcab507cb5ed1181266 Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: X-User-Name: admin Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: method: > Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: exception: Flavor 451 could not be found. Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: action_args: {'id': '451'} Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:14:26.333561 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:26.334434 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: ERROR nova.api.openstack.wsgi Aug 31 00:14:26.335592 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-0a98e86d-52d0-460c-afc7-be2d584013d4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:14:26.336650 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-0a98e86d-52d0-460c-afc7-be2d584013d4 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.430517 Aug 31 00:14:26.336650 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 31 00:14:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:26.343132 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-284e7c05-de8c-45e2-b59b-26c5576d6956 admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:26.358309 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-284e7c05-de8c-45e2-b59b-26c5576d6956 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018906 Aug 31 00:14:26.358851 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 31 00:14:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:14:26.368194 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:26.383610 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018959 Aug 31 00:14:26.384136 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 31 00:14:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:14:26.394449 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-9d4b8d77-0544-4b8f-87fe-f2f6968899dc admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:26.399858 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.wsgi [None req-9d4b8d77-0544-4b8f-87fe-f2f6968899dc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-9d4b8d77-0544-4b8f-87fe-f2f6968899dc admin admin] Request method failure captured: Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Accept: application/json Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Accept-Encoding: gzip, deflate Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Connection: keep-alive Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Content-Length: 0 Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Host: 10.222.0.67 Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Openstack-Api-Version: compute 2.90 Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Openstack-System-Scope: None Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: User-Agent: python-novaclient Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Auth-Token: gAAAAABjDqfhcDOcI9JT9KaKFQxR9Q6N4Gakc9BSdBxncKxxXWmSElSitRvhbH1c0jp_FKTJWnWk8vospjSXTdxtyPYFYc4cVa9MWjVNz181my8c9_j7YtolOfS_W0HH25JLHDMRIwgIKA_WRgCp7vJaGSxR0MiqGfTL1RY11pK57hYnE3RZsxg Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Domain-Id: None Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Domain-Name: None Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Identity-Status: Confirmed Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Is-Admin-Project: True Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Domain-Id: default Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Domain-Name: Default Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Project-Name: admin Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Role: admin,reader,member Aug 31 00:14:26.401350 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Roles: admin,reader,member Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1509e8ef0c6042559698c40a7a07a646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1509e8ef0c6042559698c40a7a07a646", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Tenant: admin Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Tenant-Id: 1509e8ef0c6042559698c40a7a07a646 Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-Tenant-Name: admin Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User: admin Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Domain-Id: default Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Domain-Name: Default Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Id: 19ddd6d02b884bcab507cb5ed1181266 Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: X-User-Name: admin Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: method: > Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: exception: Flavor 451 could not be found. Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: action_args: {'id': '451'} Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:14:26.403020 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:26.404080 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: ERROR nova.api.openstack.wsgi Aug 31 00:14:26.405391 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-9d4b8d77-0544-4b8f-87fe-f2f6968899dc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:14:26.406626 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-9d4b8d77-0544-4b8f-87fe-f2f6968899dc admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012054 Aug 31 00:14:26.406626 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 31 00:14:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 00:14:27.382478 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:27.383511 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 31 00:14:27.383931 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:27.918001 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-7d1dd573-954b-4a00-98b6-acfa5885e870 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:14:27.937740 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-7d1dd573-954b-4a00-98b6-acfa5885e870 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.415091 Aug 31 00:14:27.938276 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 31 00:14:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:14:28.909154 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:28.910209 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 31 00:14:28.910611 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:29.438167 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-175fe5f1-f016-4c44-bb7e-4193953444fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:14:29.457180 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-175fe5f1-f016-4c44-bb7e-4193953444fe admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403433 Aug 31 00:14:29.457719 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 31 00:14:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:14:30.424327 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:30.425417 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 31 00:14:30.425818 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:30.949421 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-be77fa19-0214-4ad1-b9ae-90b6f94083cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:14:30.969530 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-be77fa19-0214-4ad1-b9ae-90b6f94083cc admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406260 Aug 31 00:14:30.970084 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 31 00:14:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:14:31.943665 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:31.944703 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 31 00:14:31.945097 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:32.472496 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-bd98bafa-5800-4c2c-8c6c-453364660e4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:14:32.492340 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-bd98bafa-5800-4c2c-8c6c-453364660e4a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.409541 Aug 31 00:14:32.492896 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 31 00:14:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:14:33.475158 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:33.476163 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 31 00:14:33.476553 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:14:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:14:34.010722 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-5631fa3a-3960-4f77-bd4a-15c016986abc admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:14:34.032458 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-5631fa3a-3960-4f77-bd4a-15c016986abc admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.411259 Aug 31 00:14:34.032992 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1202 bytes} [Wed Aug 31 00:14:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:15:28.309889 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:28.310907 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-a97f7ad3-a0c9-42d4-8c42-02ffab5de5d2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 31 00:15:28.311347 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 31 00:15:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:15:28.321911 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:28.714318 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-660bcd5d-1610-4d29-8eb2-4661bfe7626d admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:28.735053 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-660bcd5d-1610-4d29-8eb2-4661bfe7626d admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.417544 Aug 31 00:15:28.735608 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 31 00:15:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:15:28.756787 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG dbcounter [-] [111950] Writing DB stats nova_api:SELECT=14 {{(pid=111950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:28.760754 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-b29c028e-4657-48ff-bde9-0505c4b2f1da admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:28.768642 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-b29c028e-4657-48ff-bde9-0505c4b2f1da admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013284 Aug 31 00:15:28.769151 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1283 bytes} [Wed Aug 31 00:15:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:28.780800 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-70a56006-b0ac-4c9d-bdac-4359ee068a4f admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:28.788362 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-70a56006-b0ac-4c9d-bdac-4359ee068a4f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011138 Aug 31 00:15:28.788872 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1286 bytes} [Wed Aug 31 00:15:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:28.800908 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-beae2b0d-9c57-44f2-b697-3449d2e00cf1 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:28.809728 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-beae2b0d-9c57-44f2-b697-3449d2e00cf1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012262 Aug 31 00:15:28.810263 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1286 bytes} [Wed Aug 31 00:15:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:28.822116 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-4bbe285e-eff9-47a8-a2c7-ba2a9bcc72a1 admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:15:28.829672 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-4bbe285e-eff9-47a8-a2c7-ba2a9bcc72a1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011130 Aug 31 00:15:28.830191 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1283 bytes} [Wed Aug 31 00:15:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:18:27.899137 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-beae2b0d-9c57-44f2-b697-3449d2e00cf1 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:27.900177 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-beae2b0d-9c57-44f2-b697-3449d2e00cf1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 31 00:18:27.900568 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 34/69] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:18:28.046024 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writing DB stats nova_api:SELECT=6 {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:28.205488 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-bf27fce9-5b7e-4733-8a5a-c9a03eb767d4 admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:28.208885 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-bf27fce9-5b7e-4733-8a5a-c9a03eb767d4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:28.209368 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-bf27fce9-5b7e-4733-8a5a-c9a03eb767d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:28.209799 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-bf27fce9-5b7e-4733-8a5a-c9a03eb767d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:28.210522 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-bf27fce9-5b7e-4733-8a5a-c9a03eb767d4 admin admin] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:28.210969 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-bf27fce9-5b7e-4733-8a5a-c9a03eb767d4 admin admin] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:28.211412 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-bf27fce9-5b7e-4733-8a5a-c9a03eb767d4 admin admin] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:28.245524 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-bf27fce9-5b7e-4733-8a5a-c9a03eb767d4 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200745 Aug 31 00:18:28.246008 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 36/70] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 31 00:18:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:18:29.076158 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-beae2b0d-9c57-44f2-b697-3449d2e00cf1 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:29.077165 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-beae2b0d-9c57-44f2-b697-3449d2e00cf1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 31 00:18:29.077559 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 35/71] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:18:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:18:29.270169 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-20819fde-4f4e-4feb-99ef-e24c0481c859 admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:29.273707 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-20819fde-4f4e-4feb-99ef-e24c0481c859 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:29.274185 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-20819fde-4f4e-4feb-99ef-e24c0481c859 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:29.274612 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-20819fde-4f4e-4feb-99ef-e24c0481c859 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:29.275358 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-20819fde-4f4e-4feb-99ef-e24c0481c859 admin admin] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:29.275806 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-20819fde-4f4e-4feb-99ef-e24c0481c859 admin admin] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:29.276220 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-20819fde-4f4e-4feb-99ef-e24c0481c859 admin admin] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:29.295233 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-20819fde-4f4e-4feb-99ef-e24c0481c859 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076843 Aug 31 00:18:29.295785 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 37/72] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 31 00:18:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:18:40.544025 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-beae2b0d-9c57-44f2-b697-3449d2e00cf1 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:40.545028 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-beae2b0d-9c57-44f2-b697-3449d2e00cf1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 31 00:18:40.545409 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 36/73] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:18:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:18:40.690175 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writing DB stats nova_cell0:SELECT=4 {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:40.690888 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writing DB stats nova_cell1:SELECT=4 {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:40.691530 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG dbcounter [-] [111949] Writing DB stats nova_api:SELECT=8 {{(pid=111949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:40.739468 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-d4d9bea8-c610-4019-8af3-53a72c6f5367 admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:40.743666 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-d4d9bea8-c610-4019-8af3-53a72c6f5367 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:40.744186 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-d4d9bea8-c610-4019-8af3-53a72c6f5367 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:40.744621 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-d4d9bea8-c610-4019-8af3-53a72c6f5367 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:40.745345 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-d4d9bea8-c610-4019-8af3-53a72c6f5367 admin admin] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:40.745797 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-d4d9bea8-c610-4019-8af3-53a72c6f5367 admin admin] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:40.746219 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-d4d9bea8-c610-4019-8af3-53a72c6f5367 admin admin] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:40.772967 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-d4d9bea8-c610-4019-8af3-53a72c6f5367 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087081 Aug 31 00:18:40.773450 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 38/74] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 31 00:18:40 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:18:41.606852 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: DEBUG nova.api.openstack.wsgi [None req-beae2b0d-9c57-44f2-b697-3449d2e00cf1 admin admin] Calling method '>' {{(pid=111950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:41.607897 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: INFO nova.api.openstack.requestlog [None req-beae2b0d-9c57-44f2-b697-3449d2e00cf1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 31 00:18:41.608297 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: [pid: 111950|app: 0|req: 37/75] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 31 00:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:18:41.800683 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG nova.api.openstack.wsgi [None req-573fb440-27eb-4527-b19b-33055c2b2c3b admin admin] Calling method '>' {{(pid=111949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:18:41.804134 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-573fb440-27eb-4527-b19b-33055c2b2c3b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:41.804606 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-573fb440-27eb-4527-b19b-33055c2b2c3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:41.805030 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-573fb440-27eb-4527-b19b-33055c2b2c3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:41.805731 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-573fb440-27eb-4527-b19b-33055c2b2c3b admin admin] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:41.806172 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-573fb440-27eb-4527-b19b-33055c2b2c3b admin admin] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:41.806583 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: DEBUG oslo_concurrency.lockutils [None req-573fb440-27eb-4527-b19b-33055c2b2c3b admin admin] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:41.827993 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: INFO nova.api.openstack.requestlog [None req-573fb440-27eb-4527-b19b-33055c2b2c3b admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080276 Aug 31 00:18:41.828538 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: [pid: 111949|app: 0|req: 39/76] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 31 00:18:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:42.904448 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: Wed Aug 31 00:19:42 2022 - graceful shutdown triggered... Aug 31 00:19:42.904580 dv-cinder-855060-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 00:19:42.905568 dv-cinder-855060-1-iscsi devstack@n-api.service[111949]: Gracefully killing worker 1 (pid: 111949)... Aug 31 00:19:42.905964 dv-cinder-855060-1-iscsi devstack@n-api.service[111950]: Gracefully killing worker 2 (pid: 111950)... Aug 31 00:19:43.906669 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: worker 1 buried after 1 seconds Aug 31 00:19:43.907283 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: worker 2 buried after 1 seconds Aug 31 00:19:43.907283 dv-cinder-855060-1-iscsi devstack@n-api.service[111948]: goodbye to uWSGI. Aug 31 00:19:43.908296 dv-cinder-855060-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 00:19:43.908940 dv-cinder-855060-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 00:19:43.912599 dv-cinder-855060-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 00:19:43.922076 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 00:19:43.924164 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:19:43 2022] *** Aug 31 00:19:43.924164 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:19:43.924164 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:19:43.924164 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: nodename: dv-cinder-855060-1-iscsi Aug 31 00:19:43.924164 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: machine: x86_64 Aug 31 00:19:43.924164 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: clock source: unix Aug 31 00:19:43.924164 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: pcre jit disabled Aug 31 00:19:43.924164 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: detected number of CPU cores: 4 Aug 31 00:19:43.924164 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: current working directory: / Aug 31 00:19:43.924164 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:19:43.924828 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: your processes number limit is 47680 Aug 31 00:19:43.924828 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: your memory page size is 4096 bytes Aug 31 00:19:43.924828 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: detected max file descriptor number: 2048 Aug 31 00:19:43.924828 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: lock engine: pthread robust mutexes Aug 31 00:19:43.924828 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: thunder lock: enabled Aug 31 00:19:43.924828 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 00:19:43.924828 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:19:43.964630 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: Python main interpreter initialized at 0x55cd7feeb9c0 Aug 31 00:19:43.964630 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: python threads support enabled Aug 31 00:19:43.964630 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: your server socket listen backlog is limited to 100 connections Aug 31 00:19:43.964630 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:19:43.965063 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:19:43.965063 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: *** Operational MODE: preforking *** Aug 31 00:19:43.965362 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:19:43.965525 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: spawned uWSGI master process (pid: 126956) Aug 31 00:19:43.965864 dv-cinder-855060-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 00:19:43.966607 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: spawned uWSGI worker 1 (pid: 126975, cores: 1) Aug 31 00:19:43.967099 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: spawned uWSGI worker 2 (pid: 126976, cores: 1) Aug 31 00:19:43.967388 dv-cinder-855060-1-iscsi devstack@n-api.service[126956]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:19:44.651107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:19:44.674370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:19:45.847494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:19:45.847494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: from cryptography.utils import int_from_bytes Aug 31 00:19:45.848203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:19:45.848203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: from cryptography.utils import int_from_bytes Aug 31 00:19:45.861225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:19:45.861225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: from cryptography.utils import int_from_bytes Aug 31 00:19:45.862379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:19:45.862379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: from cryptography.utils import int_from_bytes Aug 31 00:19:48.328095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:19:48.328751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:19:48.328942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:19:48.329253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:19:48.329719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:19:48.329878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.330202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.330525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.330841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.331368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.331680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.332004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.332336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.332646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.332906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.333296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.333929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855060-1-iscsi {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.333929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.334248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.335224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.335551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.335863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.336182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.336490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.336998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.337454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.337763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.338076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.338417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.338729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.339166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.339387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.339694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.340019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.340327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.340739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855060-1-iscsi {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.341056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.341366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.341675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.342094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.342402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.342731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.343028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.343381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.343689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.344013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.344326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.344640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.344953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.345251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.345555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.345859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.346176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.346478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.346779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.347027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.347355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.347674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.347991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.348312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.348565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.348817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.349124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.349441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.349743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.350096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.350473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.350751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.351076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.351385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.351688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.351989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.352304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.352616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.352936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.353239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.353554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.353963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.354209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.354511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.354852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.355205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.355508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.355834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.356139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.356441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.356747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.357051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.357367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.357701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.358006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.358254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.358549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.358852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.359192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.359495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.359800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.360098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.360597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.360901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.361202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.361662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.361980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.362275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.362732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.363392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.363800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.364035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.364447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.364777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.365222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.365559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.365946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.366230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.366625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.367013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.367372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.367775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.368222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.368499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.368816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.369212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.369605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.369949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.370234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.370546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.370948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.371388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.371741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.372101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.372483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.372794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.373103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.373413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.373715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.374014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.374330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.374649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.374957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.375293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.375601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.375919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.376259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.376587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.376928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.377239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.377571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.377899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.378215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.378522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.378835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.379176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.379490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.379798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.380109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.380425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.380739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.381064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.381907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.382222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.382539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.382941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.383286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.383870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.384192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.384500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.384942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.385171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.385485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.385806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.386314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.386806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.387152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.387467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.387794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.387951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:19:48.388388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.388518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:19:48.388641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.388760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.388896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:19:48.389093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.389231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:19:48.389354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:19:48.393559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.393559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.393736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.393814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.393897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.393981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.394055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.394134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.394214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.394287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.394429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.394505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.394575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.394645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.394715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.394784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.394868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.394940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.395011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.395429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.395569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.395650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.395732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.395805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.395875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855060-1-iscsi {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.395954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.396033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.396123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.396204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.396276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.396276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.396419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.396498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.396583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.396663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.396747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.396828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.396974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.397075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.397702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.397806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.397889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.397986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.398071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.398152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.398231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.398302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.398380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.398460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.398460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.398604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.398684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.398684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.398827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.398898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.399063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.399210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.399523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.399854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.399982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.400168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.400480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.400771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.400886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.401103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.401486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.401656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.401817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.402012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.402165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.402320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.402464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855060-1-iscsi {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.402625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.402781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.402927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.403154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.403360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.403532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.403695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.403842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.403996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.404151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.404306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.404452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.404610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.404756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.404901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.405046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.405201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.405363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.405509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.405684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.405832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.406563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.406721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.406877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.407060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.407230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.407385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.407538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.407690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.407856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.408003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.408146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.408301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.408448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.408608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.408763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.408908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.409059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.409210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.409363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.409518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.409723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.409965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.410203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.410364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.410510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.410674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.410838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.410838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.411311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.411311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.411784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.411938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.412102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.412256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.412401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.412569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.412755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.412921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.413067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.413216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.413426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.413589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.413736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.413890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.414037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.414194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.414339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.414339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.414676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.414837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.414990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.415167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.415324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.415477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.415623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.415776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.415923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.416183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.416344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.416491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.416645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.416805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.416961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.417113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.417113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.417396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.417555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.417710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.417864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.418010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.418180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.418330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.418484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.418673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.418822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.418976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.419159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.419314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.419470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.419623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.419895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.420139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.420382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.420555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.420785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.420945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.421109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.421351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.421503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.421679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.421919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.422155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.422305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.422450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.422450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.422751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.422909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.423090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.423254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.423409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.423566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.423862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.424037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.424186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.424340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.424493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.424639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.424793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.424939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.425102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.425249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.425393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.425551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.425696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.425849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.426009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.426174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.426400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.426560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.426714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.426859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.427022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.427194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.427340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.427497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.427651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.428294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.428496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.428688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.428845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.429001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.429296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.429489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.429659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.429873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.430041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.430288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.430535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.430535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.430838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.430838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.431139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.431139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.431521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.431687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.431841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.432085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.432344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.432503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.432503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.432789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.432942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.433087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.433240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.433393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.433537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.433691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.433962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.434138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.434295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.434464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.434611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.434766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.434912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.435093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.435246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.435411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.435567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.435729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.435884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.436036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.436189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.436342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.436602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.436762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.436924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.437078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.437230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.437383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.437757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.437925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.438087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.438238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.438390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.438536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.438706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.438861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.439008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.439190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.439337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.439496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.439651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.439796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.439990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.440149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:19:48.440313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.440563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.440796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.440959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.441105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.441249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.441404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.441576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.441819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.441819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.442129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.442363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.442611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.442776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.442922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.443130 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.443295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.443441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.443604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.444276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.444462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.444462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.444823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.445015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.445227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.445377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.445530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.445684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.445859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.446014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.446170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.446326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.446480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.446724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.446892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.447057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.447217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.447383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.447530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.447694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.447893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.448067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.448214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.448360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.448513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.448673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.448819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.448964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.449109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.449262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.449416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.449416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.449416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.449416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.450025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.450025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.450025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.450025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.450025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.450025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.450025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.450025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.451533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.451533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.451533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.451533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.451533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.452384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.452384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.452384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.452384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.453188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.453343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.453499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.453733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.453894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.454047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.454257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.454410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.454611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.454765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.455001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.455228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.455374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.455612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.455782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.455976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.456127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.456281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.456435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.456624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.456886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.457049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.457195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.457347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.457500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.457654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.457818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.457971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.458117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.458276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.458425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.458579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.458724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.458870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.459071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.459227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.459384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.460205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.460371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.460524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.460825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.461004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.461243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.461409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.461585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.461796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.461960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.462123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.463203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.463203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.463510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.463738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.464073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.464345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.464508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.464797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.465255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.465408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.465605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.465817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.465985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.466259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.466421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.466813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.467166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.467511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.467677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.467835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.467981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.468134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.468281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.468462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.468635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.468782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.468935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.469081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.469232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.469389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.469542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.469716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.469875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.470050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.470254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.470422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.470575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.470731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.470894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.471154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.471415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.471619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.471766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.471918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.472063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.472207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.472352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.472624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.472863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.473034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.473208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.473457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.473624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.473771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.473923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.473923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.474204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.474357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.474518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.474665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.474817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.474970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.475219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.475470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.475470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.475911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.476063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.476217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.476363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.476508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.476669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.476815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.476967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.477223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.477223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.477570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.477719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.477863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.477863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.478137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.478281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.478440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.478440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.478767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.478926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.479091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.479275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.479438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.479596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.479753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.479907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.480053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.480207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.480407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.480558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.480710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.480864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.481018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.481319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.481571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.481723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.481881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.482039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.482186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.482344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.482490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.482660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.482997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.483215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.483379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.483667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.483840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.484002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.484177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.484331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.484482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.484642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.484795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.484945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.485240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.485240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.485571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.485731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.485890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.486044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.486194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.486380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.486675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.486841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.487000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.487326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.487486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.487638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.487802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.487957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.488107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.488260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.488418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.488577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.488750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.488903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.489068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.489290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.489481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.489728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.489893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.490045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.490196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.490988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.491173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.491617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.491861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.492047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.492202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.492363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.492524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.492686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.492839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.493173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.493344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.493507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.493679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.493937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.494095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.494254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.494426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.494582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.494743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.494904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.495096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.495257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.495420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.495582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.495744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.495897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.496047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.496206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.496373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.496533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.496695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.496856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.497009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.497161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.497329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.497561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.497731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.497893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.497893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.498181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.498340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.498576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.498739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.498892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.499071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.499243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.499403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.499565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.499728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.499889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.500050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.500210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.500363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.500522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.500686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.500845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.501041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.501198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.501349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.501532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.501770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.502017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.502187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.502347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.502500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.502660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.502821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.502985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.503345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.503507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.503676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.503830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.504096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.504255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.504422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.504582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.504764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.504987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.505145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.505308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.505459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.505611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.505771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.505930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.506084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.506084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.506990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.507336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.507503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.507764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.507930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.508092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.508261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.508675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.508845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.508999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.509160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.509321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.509482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.509645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.509806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.509959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.509959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.510254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.510411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.510583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.510736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.510887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.511142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.511306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.511458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.511621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.511792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.512045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.512285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.512453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.512621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.512783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.512783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.512783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.513227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.513227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.513733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.513889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.514048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.514048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.514472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.514472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.514813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.514981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.515169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.515342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.515507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.515661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.515981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.516142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.516304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.516465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.516617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.516768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.516920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.517078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.517259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.517412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.517572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.517749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.517978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.518137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.518298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.518459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.518614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.518765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.518917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.519116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.519285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.519456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.519619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.519772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.519923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.519923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.520248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.520508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.520670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.520830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.520991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.521197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.521368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.521522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.521691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.521846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.522784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.522964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.523147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.523302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.523483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.523826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.524136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.524312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.524468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.524725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.524897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.525058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.525221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.525374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.525539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.525701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.525861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.526016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.526178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.526331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.526483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.526642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.526794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.526971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.527172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.527328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.527486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.527639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.527792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.527972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.528207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.528373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.528533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.528686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.528840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.529001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.529166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.529327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.529479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.529713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.529883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.530047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.530202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.530372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.530526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.530526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.530893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.531080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.531295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.531468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.531622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.531622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.531924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.532078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.532230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.532381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.532532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.532701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.533021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.533177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.533330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.533493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.533645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.534072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.534264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.534431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.534594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.534764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.535018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.535257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.535422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.535575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.535727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.535878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.536040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.536207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.536361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.536513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.536673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.536840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.537001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.537168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.537328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.537488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.537691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.537852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.538004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.538229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.538499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.538660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.538660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.538949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.539134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.539294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.539453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.539608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.539767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.539928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.539928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.540251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.540251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.540251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.540251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.540824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.540993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.540993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.541300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.541498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.541671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.541826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.541826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.542122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.542299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.542299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.542612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.542802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.543156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.543318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.543469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.543620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.543785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.544022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.544292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.544452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.544603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.544776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.544945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.545207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.545374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.545572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.545768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.545940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.546102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.546255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.546414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.546575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.546728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.546902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.547076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.547236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.547400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.547554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.547706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.547872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.547872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.548190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.548384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.548636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.548806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.548968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.548968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.549272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.549423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.549584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.549746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.549908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.550062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.550220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.550383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.550383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.550689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.550849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.551021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.551200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.551352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.551559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.551725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.551893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.552053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.552206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.552366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.552527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.552680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.552680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.552987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.553424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.553653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.553825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.554009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.554246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.554517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.554684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.554915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.555100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.555366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.555537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.555700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.555873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.555873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.556176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.556337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.556497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.556650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.556802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.556968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.557122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.557282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.557436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.557588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.557747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.557920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.558073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.558225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.558377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.558537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.558786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.558955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.559143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.559300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.559300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.559598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.559770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.559942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.559942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.560259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.560422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.560575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.560735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.560896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.561049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.561201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.561352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.561510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.561745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.561899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.561899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.562218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.562379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.562545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.562700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.562852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.563003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.563217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.563545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.563716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.563871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.563871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.564161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.564416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.564674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.564848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.565010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.565163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.565320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.565587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.565757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.565920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.566073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.566225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.566383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.566544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.566721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.566876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.567112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.567274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.567426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.567588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.567750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.567750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.568040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.568191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.568342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.568500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.568672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.569466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.569656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.569812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.569975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.570128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.570291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.570445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.570605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.571370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.571536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.571747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.571906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.572080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.572234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.572393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.572554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.572717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.572870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.573029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.573191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.573345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.573345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.573824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.573985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.574155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.574329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.574571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.574738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.574906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.575088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.575261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.575526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.575795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.575965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.576120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.576281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.576442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.576601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.576770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.576936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.577097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.577250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.577403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.577554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.577706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.577868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.578028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.578243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.578441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.578441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.578744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.578942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.579118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.579274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.579454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.579692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.579862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.580017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.580177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.580331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.580483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.580642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.580642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.580963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.580963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.581252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.582167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.582327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.582491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.582646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.582828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.583020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.583288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.583451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.583785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.583963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.584132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.584300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.585280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.585452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.585736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.586023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.586184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.586347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.586501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.586653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.586814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.586968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.587175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.587340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.587494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.587646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.587799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.587950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.588111 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.588265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.588417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.588569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.588728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.588891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.589133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.589297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.589450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.589608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.589870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.590041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.590196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.590355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.590517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.590680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.590841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.591005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.591213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.591378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.591541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.591703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.591912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.592085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.592247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.592400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.592559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.592719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.592872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.593040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.593193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.593364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.593780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.594124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.594124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.594428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.594581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.594734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.594734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.595232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.595232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.595656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.595944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.596212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.596393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.596564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.596728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.596882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.597042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.597196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.597355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.597517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.597670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.597821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.597972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.598131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.598301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.598301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.598607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.598768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.598921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.599090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.599248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.599248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.599557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.599709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.599709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.600128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.600298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.600473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.600642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.600800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.600951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.601103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.601264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.601419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.601578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.601737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.601923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.602081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.602247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.602412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.602583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.602743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.602895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.602895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.603274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.603435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.603596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.603748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.603748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.604201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.604371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.604534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.604699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.604850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.605008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.605170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.605170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.605486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.605645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.605796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.605964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.606229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.606478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.606639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.606798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.606991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.606991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.607321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.607489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.607642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.607802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.607955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.608116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.608279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.608433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.608593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.608747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.608910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.609077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.609231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.609389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.609550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.609703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.609855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.610022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.610266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.610266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.610589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.610754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.610929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.611113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.611279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.611438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.611653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.611860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.612027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.612181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.612340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.612495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.612646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.612797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.612959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.613364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.613585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.613741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.613901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.614065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.614420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.614706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.614967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.615231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.615432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.615598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.616421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.616736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.616897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.617050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.617215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.617382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.617382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.617689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.617850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.618010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.618178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.618338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.618491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.618654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.618805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.618957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.618957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.619316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.619477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.619631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.619782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.619933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.620131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.620396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.620565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.620747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.621000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.621182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.621337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.622089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.622203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.622284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.622357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.622513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.622598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.622706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.622706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.622873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.622966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.623985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:19:48.624547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.624547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.625708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.626883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.627544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.627544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.627544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.627544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.627544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.627544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.627544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.627544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.628724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.629241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.629333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.629728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.629942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.630325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.630601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.630916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.631282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.632131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.632485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.633172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.633745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.634059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.634376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.634709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.635023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.635350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.635778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.636093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.636412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.636733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.637047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.637372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.637697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.638451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.638451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.638682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.638938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.639312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.639640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.639964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.640270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.640564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.640866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.641410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.641546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.641780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.642187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.642370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.642701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.642974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.643303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.643607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.643910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.644217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.644516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.644817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.645147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.645420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.645722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.646022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.646643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.646643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.646959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.647494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.647797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.648099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.648432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.648765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.649081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.649452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.650818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.651193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.651528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.651869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.652212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.652543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.652867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.653216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.653528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.653848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.654166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.654484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.654801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.655147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.655483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.655811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.656120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.656449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.656768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.657089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.657409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.657723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.658058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.658374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.658693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.659001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.659349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.659663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.659982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.660293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.660623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.660925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.661243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.661573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.661902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.662218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.662576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.663020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.663392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.663706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.664053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.664384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.664699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.665012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.665320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:19:48.665563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:19:48.671762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO dbcounter [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Registered counter for database nova_api Aug 31 00:19:48.692407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_db.sqlalchemy.engines [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:48.699995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writer thread running {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:48.728989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO dbcounter [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Registered counter for database nova_api Aug 31 00:19:48.749809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_db.sqlalchemy.engines [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:48.755999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.context [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),17a2f83e-804b-4b78-9634-80dd5da1cac2(cell1) {{(pid=126976) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:19:48.758141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writer thread running {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:48.760978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:48.761450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:48.763022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.763781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:48.764222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:48.766225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.768255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO dbcounter [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Registered counter for database nova_cell0 Aug 31 00:19:48.772347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO dbcounter [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Registered counter for database nova_cell1 Aug 31 00:19:48.780909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_db.sqlalchemy.engines [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:48.782069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_db.sqlalchemy.engines [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:48.787865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writer thread running {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:48.816156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.context [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),17a2f83e-804b-4b78-9634-80dd5da1cac2(cell1) {{(pid=126975) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:19:48.821200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:48.821677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:48.823605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.824344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:48.824804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:48.826826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.828937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO dbcounter [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Registered counter for database nova_cell0 Aug 31 00:19:48.833165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO dbcounter [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Registered counter for database nova_cell1 Aug 31 00:19:48.841187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_db.sqlalchemy.engines [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:48.846474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writer thread running {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:48.847161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_db.sqlalchemy.engines [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:48.931954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writer thread running {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:48.942132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO dbcounter [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Registered counter for database nova_cell0 Aug 31 00:19:48.949733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_db.sqlalchemy.engines [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:48.954245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writer thread running {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:48.997050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writer thread running {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:49.006412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO dbcounter [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Registered counter for database nova_cell0 Aug 31 00:19:49.015348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_db.sqlalchemy.engines [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:19:49.019763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writer thread running {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:19:49.281489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: WARNING keystonemiddleware.auth_token [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:19:49.289283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: WARNING keystonemiddleware.auth_token [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:19:49.345606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: WARNING keystonemiddleware.auth_token [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:19:49.353069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: WARNING keystonemiddleware.auth_token [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:19:49.634671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: WARNING keystonemiddleware.auth_token [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:19:49.640729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: WARNING keystonemiddleware.auth_token [None req-16786d6b-2cc9-49ec-a9ca-e3551f7345a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:19:49.646058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd7feeb9c0 pid: 126976 (default app) Aug 31 00:19:49.706326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: WARNING keystonemiddleware.auth_token [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:19:49.712560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: WARNING keystonemiddleware.auth_token [None req-26efce8f-e802-4ab1-80c3-37ee4ab48012 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:19:49.718012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd7feeb9c0 pid: 126975 (default app) Aug 31 00:20:26.932351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:26.933323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:26.934247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:26.935352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:27.415943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:27.416819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:27.419012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:27.422338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:28.603188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-05ab2e34-1ade-4304-b261-944721ed56e2 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Action: 'create', calling method: .version_select at 0x7fa7f4e22e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-888555880", "metadata": {"Type": "work"}}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-05ab2e34-1ade-4304-b261-944721ed56e2 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Request method failure captured: Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 121 Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlKBqcZms38u1zKwCiDE6IdZ2sxx49nLJWiaWh5Nv-1iRUPj9STa64E6xjNA99mgQ7MiV4x_uA14gKfcwhakeaAI-h25sjan6nP4VAg-cTnWJNqMIjs7LuM9w7thB29i6qvKy7WM3VuAfFc8vk47j3ABXsLjUMHpy_6QXpxXpQ_fUI Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:20:28.609777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a71dcf1bec324a38bb5f120f295809e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: f6dc93317d5f473586dd2682f484c203 Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-888555880", "metadata": {"Type": "work"}}} Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: Aug 31 00:20:28.611442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-888555880', 'metadata': {'Type': 'work'}}}} Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:28.612300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:20:28.613611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:20:28.614736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:20:28.614736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.619015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-05ab2e34-1ade-4304-b261-944721ed56e2 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:28.620380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-05ab2e34-1ade-4304-b261-944721ed56e2 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.696119 Aug 31 00:20:28.625799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 31 00:20:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1703 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 00:20:28.632783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-556b57b7-f4a3-4f49-8e5f-bbd48d762515 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Action: 'create', calling method: .version_select at 0x7fa7f4dee940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1228813186", "metadata": {"Type": "work"}}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-556b57b7-f4a3-4f49-8e5f-bbd48d762515 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Request method failure captured: Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 120 Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlKBqcZms38u1zKwCiDE6IdZ2sxx49nLJWiaWh5Nv-1iRUPj9STa64E6xjNA99mgQ7MiV4x_uA14gKfcwhakeaAI-h25sjan6nP4VAg-cTnWJNqMIjs7LuM9w7thB29i6qvKy7WM3VuAfFc8vk47j3ABXsLjUMHpy_6QXpxXpQ_fUI Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:20:28.637838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a71dcf1bec324a38bb5f120f295809e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: f6dc93317d5f473586dd2682f484c203 Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1228813186", "metadata": {"Type": "work"}}} Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: Aug 31 00:20:28.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1228813186', 'metadata': {'Type': 'work'}}}} Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi '0' Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:28.639973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:20:28.641308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:20:28.642386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:20:28.642386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.645969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-556b57b7-f4a3-4f49-8e5f-bbd48d762515 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:28.647077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-556b57b7-f4a3-4f49-8e5f-bbd48d762515 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019621 Aug 31 00:20:28.652547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 2/2] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 31 00:20:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:20:28.658292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93123963-92ec-4da9-8db0-a7423f2be7f0 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Action: 'create', calling method: .version_select at 0x7fa7f4ced9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-858586970", "metadata": {"Type": "work"}}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93123963-92ec-4da9-8db0-a7423f2be7f0 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Request method failure captured: Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 118 Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlKBqcZms38u1zKwCiDE6IdZ2sxx49nLJWiaWh5Nv-1iRUPj9STa64E6xjNA99mgQ7MiV4x_uA14gKfcwhakeaAI-h25sjan6nP4VAg-cTnWJNqMIjs7LuM9w7thB29i6qvKy7WM3VuAfFc8vk47j3ABXsLjUMHpy_6QXpxXpQ_fUI Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:20:28.663228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a71dcf1bec324a38bb5f120f295809e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: f6dc93317d5f473586dd2682f484c203 Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-858586970", "metadata": {"Type": "work"}}} Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: Aug 31 00:20:28.665062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-858586970', 'metadata': {'Type': 'work'}}}} Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi '' Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:28.666047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:20:28.668096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:20:28.670765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:20:28.670765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:28.670765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93123963-92ec-4da9-8db0-a7423f2be7f0 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:28.671874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-93123963-92ec-4da9-8db0-a7423f2be7f0 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018063 Aug 31 00:20:28.672429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 3/3] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 31 00:20:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:20:28.688816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-28a9f569-fda6-4392-9a4e-13367e315959 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Calling method '.version_select at 0x7fa7f4ced700>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:28.887306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5f7ddaa4-1b5c-4ad5-90c4-2db50ec9972f tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] Action: 'create', calling method: .version_select at 0x7fa7f4e24e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-508765865", "metadata": {"Type": "work"}}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:29.363397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-28a9f569-fda6-4392-9a4e-13367e315959 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] HTTP exception thrown: Volume tempest-invalid-1543533675 could not be found. Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-28a9f569-fda6-4392-9a4e-13367e315959 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Request method failure captured: Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1543533675 HTTP/1.1 Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlKBqcZms38u1zKwCiDE6IdZ2sxx49nLJWiaWh5Nv-1iRUPj9STa64E6xjNA99mgQ7MiV4x_uA14gKfcwhakeaAI-h25sjan6nP4VAg-cTnWJNqMIjs7LuM9w7thB29i6qvKy7WM3VuAfFc8vk47j3ABXsLjUMHpy_6QXpxXpQ_fUI Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:20:29.375615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a71dcf1bec324a38bb5f120f295809e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: f6dc93317d5f473586dd2682f484c203 Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Volume tempest-invalid-1543533675 could not be found. Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'tempest-invalid-1543533675'} Aug 31 00:20:29.376898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1543533675 could not be found. (HTTP 404) (Request-ID: req-582f149f-0394-42fc-ae3e-d97787f4137f) Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:29.377739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:20:29.378916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1543533675 could not be found. Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:20:29.382937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1543533675 could not be found. Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1543533675 could not be found. Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-28a9f569-fda6-4392-9a4e-13367e315959 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Returning 404 to user: Volume tempest-invalid-1543533675 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-28a9f569-fda6-4392-9a4e-13367e315959 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1543533675" status: 404 len: 99 microversion: 2.1 time: 0.701534 Aug 31 00:20:29.385402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 4/4] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 31 00:20:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1543533675 => generated 99 bytes in 703 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:20:29.399122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-642da3f4-c4b2-435c-af75-d713cf4ba7fa tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008843 Aug 31 00:20:29.402568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 5/5] 10.222.0.67 () {58 vars in 1140 bytes} [Wed Aug 31 00:20:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 00:20:29.409118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-47e387fb-78ea-4baa-923a-58b13184e334 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004402 Aug 31 00:20:29.414963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 6/6] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 31 00:20:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 31 00:20:29.420080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-29998728-17df-4784-9e52-3b6aeb999f38 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Calling method '.version_select at 0x7fa7f4c31ca0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:29.914063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-29998728-17df-4784-9e52-3b6aeb999f38 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] HTTP exception thrown: Volume bd8035a5-886e-4a8c-b9f5-5acf616b95bb could not be found. Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-29998728-17df-4784-9e52-3b6aeb999f38 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Request method failure captured: Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/os-volumes/bd8035a5-886e-4a8c-b9f5-5acf616b95bb HTTP/1.1 Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlKBqcZms38u1zKwCiDE6IdZ2sxx49nLJWiaWh5Nv-1iRUPj9STa64E6xjNA99mgQ7MiV4x_uA14gKfcwhakeaAI-h25sjan6nP4VAg-cTnWJNqMIjs7LuM9w7thB29i6qvKy7WM3VuAfFc8vk47j3ABXsLjUMHpy_6QXpxXpQ_fUI Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:20:29.916564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a71dcf1bec324a38bb5f120f295809e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: f6dc93317d5f473586dd2682f484c203 Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Volume bd8035a5-886e-4a8c-b9f5-5acf616b95bb could not be found. Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'bd8035a5-886e-4a8c-b9f5-5acf616b95bb'} Aug 31 00:20:29.918062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd8035a5-886e-4a8c-b9f5-5acf616b95bb could not be found. (HTTP 404) (Request-ID: req-469a8fe7-8a3b-4ff8-bbdf-e3035fe4c4b5) Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:29.918844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:20:29.919958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd8035a5-886e-4a8c-b9f5-5acf616b95bb could not be found. Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:20:29.921127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd8035a5-886e-4a8c-b9f5-5acf616b95bb could not be found. Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd8035a5-886e-4a8c-b9f5-5acf616b95bb could not be found. Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-29998728-17df-4784-9e52-3b6aeb999f38 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Returning 404 to user: Volume bd8035a5-886e-4a8c-b9f5-5acf616b95bb could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:29.924268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-29998728-17df-4784-9e52-3b6aeb999f38 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/bd8035a5-886e-4a8c-b9f5-5acf616b95bb" status: 404 len: 109 microversion: 2.1 time: 0.503331 Aug 31 00:20:29.925980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 7/7] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 31 00:20:29 2022] DELETE /compute/v2.1/os-volumes/bd8035a5-886e-4a8c-b9f5-5acf616b95bb => generated 109 bytes in 510 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:29.937785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-805f3bbb-c472-49d2-a1af-57e9fd00b517 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Calling method '.version_select at 0x7fa7f4c31670>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:30.067523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-805f3bbb-c472-49d2-a1af-57e9fd00b517 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] HTTP exception thrown: Volume cd42d35a-fc1b-4b2a-b753-3e258949a6d6 could not be found. Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-805f3bbb-c472-49d2-a1af-57e9fd00b517 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Request method failure captured: Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/os-volumes/cd42d35a-fc1b-4b2a-b753-3e258949a6d6 HTTP/1.1 Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlKBqcZms38u1zKwCiDE6IdZ2sxx49nLJWiaWh5Nv-1iRUPj9STa64E6xjNA99mgQ7MiV4x_uA14gKfcwhakeaAI-h25sjan6nP4VAg-cTnWJNqMIjs7LuM9w7thB29i6qvKy7WM3VuAfFc8vk47j3ABXsLjUMHpy_6QXpxXpQ_fUI Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:20:30.069802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a71dcf1bec324a38bb5f120f295809e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a71dcf1bec324a38bb5f120f295809e2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: a71dcf1bec324a38bb5f120f295809e2 Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesNegativeTest-497644041 Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: f6dc93317d5f473586dd2682f484c203 Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesNegativeTest-497644041-project Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Volume cd42d35a-fc1b-4b2a-b753-3e258949a6d6 could not be found. Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'cd42d35a-fc1b-4b2a-b753-3e258949a6d6'} Aug 31 00:20:30.071181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd42d35a-fc1b-4b2a-b753-3e258949a6d6 could not be found. (HTTP 404) (Request-ID: req-4deb4ef7-1207-4f73-b044-14585815c3eb) Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:30.071961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:20:30.073095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd42d35a-fc1b-4b2a-b753-3e258949a6d6 could not be found. Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:20:30.080233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd42d35a-fc1b-4b2a-b753-3e258949a6d6 could not be found. Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd42d35a-fc1b-4b2a-b753-3e258949a6d6 could not be found. Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-805f3bbb-c472-49d2-a1af-57e9fd00b517 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] Returning 404 to user: Volume cd42d35a-fc1b-4b2a-b753-3e258949a6d6 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-805f3bbb-c472-49d2-a1af-57e9fd00b517 tempest-VolumesNegativeTest-497644041 tempest-VolumesNegativeTest-497644041-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/cd42d35a-fc1b-4b2a-b753-3e258949a6d6" status: 404 len: 109 microversion: 2.1 time: 0.145228 Aug 31 00:20:30.081313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 8/8] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:29 2022] GET /compute/v2.1/os-volumes/cd42d35a-fc1b-4b2a-b753-3e258949a6d6 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:30.243715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5f7ddaa4-1b5c-4ad5-90c4-2db50ec9972f tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.834218 Aug 31 00:20:30.244896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1/9] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 31 00:20:27 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2837 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 00:20:30.261895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-530367e3-9b28-4660-8921-4f099573072c tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] Calling method '.version_select at 0x7fa7f4c31b80>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:30.339358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-530367e3-9b28-4660-8921-4f099573072c tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5" status: 200 len: 352 microversion: 2.1 time: 0.084428 Aug 31 00:20:30.346177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 9/10] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:30 2022] GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5 => generated 352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:31.359649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7f74b025-478f-477c-a469-df8a1dbd6d54 tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] Calling method '.version_select at 0x7fa7f4ca5ca0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:31.455415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7f74b025-478f-477c-a469-df8a1dbd6d54 tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5" status: 200 len: 352 microversion: 2.1 time: 0.103795 Aug 31 00:20:31.456334 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 2/11] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:31 2022] GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:32.481399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d101237d-20af-41f7-8036-62db0dd2fa4f tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] Calling method '.version_select at 0x7fa7f4c313a0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:32.622206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d101237d-20af-41f7-8036-62db0dd2fa4f tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5" status: 200 len: 353 microversion: 2.1 time: 0.154626 Aug 31 00:20:32.623889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 10/12] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:32 2022] GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:32.639484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5bb04f7e-4435-4b6a-9b67-4d996bbe72de tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] Calling method '.version_select at 0x7fa7f4cbc3a0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:32.757105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5bb04f7e-4435-4b6a-9b67-4d996bbe72de tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5" status: 200 len: 353 microversion: 2.1 time: 0.122213 Aug 31 00:20:32.760858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 3/13] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:32 2022] GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:32.825529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5246c607-98b2-4686-9cd2-4b9c87adb10b tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] Calling method '.version_select at 0x7fa7f4bc9430>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:33.128458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5246c607-98b2-4686-9cd2-4b9c87adb10b tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5" status: 202 len: 0 microversion: 2.1 time: 0.349574 Aug 31 00:20:33.130650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 11/14] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 31 00:20:32 2022] DELETE /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:20:33.138710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b7583849-feef-4855-a519-6d861755c880 tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] Calling method '.version_select at 0x7fa7f4cbca60>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:33.249206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b7583849-feef-4855-a519-6d861755c880 tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5" status: 200 len: 352 microversion: 2.1 time: 0.114873 Aug 31 00:20:33.255693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 4/15] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:33 2022] GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:34.264066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0b4c22f5-b9ab-4e7d-8d1a-f88dd10a744b tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] Calling method '.version_select at 0x7fa7f4bc99d0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:34.332818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-0b4c22f5-b9ab-4e7d-8d1a-f88dd10a744b tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] HTTP exception thrown: Volume 41abd2e7-fc00-457d-93ca-3d2760eaccc5 could not be found. Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0b4c22f5-b9ab-4e7d-8d1a-f88dd10a744b tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] Request method failure captured: Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5 HTTP/1.1 Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlL0YGdtLbCZb_XPJoIXwUQ-Dw2m2Mt62EY0_0WgzI7Gih1zdF7Reeh_L9lMLJPHCiFA9SYxV4hhzWqYc9Sfivs1VOEyQvTZ7wEo_vAPByUVtWPK-_ttQp6cRcIjfuaNz4do-8ttpgudMNHGqxCHmQyFwKEmr8HtJJV95gvU8PZYwE Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6d33f302a33c427a8c2603ff5a6c1688 Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesGetTestJSON-1413846111 Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:20:34.335026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6d33f302a33c427a8c2603ff5a6c1688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6d33f302a33c427a8c2603ff5a6c1688"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6d33f302a33c427a8c2603ff5a6c1688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6d33f302a33c427a8c2603ff5a6c1688", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesGetTestJSON-1413846111 Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6d33f302a33c427a8c2603ff5a6c1688 Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesGetTestJSON-1413846111 Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesGetTestJSON-1413846111-project Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: da22f994cb84433a8269ddc025727273 Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesGetTestJSON-1413846111-project Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Volume 41abd2e7-fc00-457d-93ca-3d2760eaccc5 could not be found. Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '41abd2e7-fc00-457d-93ca-3d2760eaccc5'} Aug 31 00:20:34.336354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41abd2e7-fc00-457d-93ca-3d2760eaccc5 could not be found. (HTTP 404) (Request-ID: req-e037f3fc-8bba-4e83-b315-4702b2a8780b) Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:34.337212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:20:34.338245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41abd2e7-fc00-457d-93ca-3d2760eaccc5 could not be found. Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:20:34.340568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41abd2e7-fc00-457d-93ca-3d2760eaccc5 could not be found. Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41abd2e7-fc00-457d-93ca-3d2760eaccc5 could not be found. Aug 31 00:20:34.342006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:20:34.346080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0b4c22f5-b9ab-4e7d-8d1a-f88dd10a744b tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] Returning 404 to user: Volume 41abd2e7-fc00-457d-93ca-3d2760eaccc5 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:34.352181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0b4c22f5-b9ab-4e7d-8d1a-f88dd10a744b tempest-VolumesGetTestJSON-1413846111 tempest-VolumesGetTestJSON-1413846111-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5" status: 404 len: 109 microversion: 2.1 time: 0.091875 Aug 31 00:20:34.360645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 12/16] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:34 2022] GET /compute/v2.1/os-volumes/41abd2e7-fc00-457d-93ca-3d2760eaccc5 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:40.595487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-761994058", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "networks": [{"uuid": "d53b2e2d-612b-47df-b82f-c846abf61444"}]}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:40.863637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] validate_networks() for [('d53b2e2d-612b-47df-b82f-c846abf61444', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:42.280646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-51c885c9-55b8-414c-82f3-59e2adacbff3 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f4c31160>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:42.471084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-51c885c9-55b8-414c-82f3-59e2adacbff3 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/9d13a9e7-f3a5-44c9-9cb9-556da0a47180" status: 200 len: 351 microversion: 2.1 time: 0.200726 Aug 31 00:20:42.472151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 13/17] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:42 2022] GET /compute/v2.1/os-volumes/9d13a9e7-f3a5-44c9-9cb9-556da0a47180 => generated 351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:42.923690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:42.924215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:42.924566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:42.925135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:42.925552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:42.980603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:42.981118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:42.984476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:42.988820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:42.995527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:42.995972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:43.104047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Getting quotas for project 788926197c5042b99931f959426cff47. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:43.120095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Getting quotas for user d10b50451d4b48f0b2377626ed609de4 and project 788926197c5042b99931f959426cff47. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:43.150773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:43.153722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:43.281726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-545bb6ca-4abb-4198-a933-e87647f0785a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.275246 Aug 31 00:20:43.282538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 5/18] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:20:43.296400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2ee180d4-d26c-468e-8e9b-62eab1dbf440 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:43.305253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2ee180d4-d26c-468e-8e9b-62eab1dbf440 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:43.408320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-743b87b1-aea1-4049-9bbb-d11128d3ed38 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Action: 'create', calling method: .version_select at 0x7fa7f4bc9c10>, body: {"keypair": {"name": "tempest-keypair-371279552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6iXXbJGpA+8J0fBCLDcLxNCCV/cqPLpzQxJzDI0tGTnXJIVn4489Ixt3qquRSN1zvvTYmaLe3gHXODC8EEXeR0dBoFBLUDo7mAxFujY4mbmxtV3d6BkQS35stCNUsLQA=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:43.510189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2ee180d4-d26c-468e-8e9b-62eab1dbf440 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:43.565315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2ee180d4-d26c-468e-8e9b-62eab1dbf440 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1214 microversion: 2.1 time: 0.272701 Aug 31 00:20:43.567720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 6/19] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:43 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1214 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:43.617164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-743b87b1-aea1-4049-9bbb-d11128d3ed38 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Getting quotas for project 885b952a63b34e1ba97215831cffc58e. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:43.648114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-743b87b1-aea1-4049-9bbb-d11128d3ed38 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Getting quotas for user 6d1a15d59d5d476ca6e0ab5176d310cd and project 885b952a63b34e1ba97215831cffc58e. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:43.750130 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-743b87b1-aea1-4049-9bbb-d11128d3ed38 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.628842 Aug 31 00:20:43.751715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 14/20] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 31 00:20:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:44.590452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-80025f93-3e4e-4055-9071-044a611a039e tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:44.591701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-80025f93-3e4e-4055-9071-044a611a039e tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:44.775321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-80025f93-3e4e-4055-9071-044a611a039e tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:44.782742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-80025f93-3e4e-4055-9071-044a611a039e tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1214 microversion: 2.1 time: 0.199604 Aug 31 00:20:44.790509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 7/21] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:44 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:45.813393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0a8f1ab4-5de7-4184-bd6a-b4c4becb885c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:45.816161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0a8f1ab4-5de7-4184-bd6a-b4c4becb885c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:45.859301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab4-5de7-4184-bd6a-b4c4becb885c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:45.865249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab4-5de7-4184-bd6a-b4c4becb885c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:45.866039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab4-5de7-4184-bd6a-b4c4becb885c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:45.867706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab4-5de7-4184-bd6a-b4c4becb885c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:45.868411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab4-5de7-4184-bd6a-b4c4becb885c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:45.870460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a8f1ab4-5de7-4184-bd6a-b4c4becb885c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.165229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0a8f1ab4-5de7-4184-bd6a-b4c4becb885c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:46.195573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0a8f1ab4-5de7-4184-bd6a-b4c4becb885c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1218 microversion: 2.1 time: 0.387362 Aug 31 00:20:46.196719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 15/22] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:45 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1218 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:47.219356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ecefcc9-8168-40df-8cf2-7e1d36369670 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:47.222578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ecefcc9-8168-40df-8cf2-7e1d36369670 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:47.239663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ecefcc9-8168-40df-8cf2-7e1d36369670 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:47.241718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ecefcc9-8168-40df-8cf2-7e1d36369670 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:47.242703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ecefcc9-8168-40df-8cf2-7e1d36369670 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:47.245368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ecefcc9-8168-40df-8cf2-7e1d36369670 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:47.246778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ecefcc9-8168-40df-8cf2-7e1d36369670 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:47.249368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ecefcc9-8168-40df-8cf2-7e1d36369670 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:47.407002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-890392414", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27ead1ec-406a-4401-90a4-a64803333a3a"}], "security_groups": [{"name": "tempest-securitygroup--1455790512"}], "key_name": "tempest-keypair-371279552", "user_data": "}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:47.499553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ecefcc9-8168-40df-8cf2-7e1d36369670 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:47.542048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ecefcc9-8168-40df-8cf2-7e1d36369670 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1266 microversion: 2.1 time: 0.329418 Aug 31 00:20:47.552302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 8/23] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:47 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:47.680138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] validate_networks() for [('27ead1ec-406a-4401-90a4-a64803333a3a', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:47.793972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-92ec4da2-7b3a-44a1-b4f4-cf66e339d9f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'create', calling method: .version_select at 0x7fa7f42fde50>, body: {"keypair": {"name": "tempest-keypair-1413754213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQfae/kgQsrUyRB79XAe1fShTv3jF/DWXdLmt8q3xEN+4fY7jPrVPjYlWnEx3mZhlQUGyIgs6IyMKoq0NNGYSRJNU6zoQ8o4BOfzXyA8KO03j81aClJdDDUjaLVuQ2weQ=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:47.843814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-92ec4da2-7b3a-44a1-b4f4-cf66e339d9f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Getting quotas for project 5694aa9e83804fe19311f97ed6af1152. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:47.848887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-92ec4da2-7b3a-44a1-b4f4-cf66e339d9f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Getting quotas for user 7d7582f9cdd646f39404f7adc99ad9ac and project 5694aa9e83804fe19311f97ed6af1152. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:47.900103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-92ec4da2-7b3a-44a1-b4f4-cf66e339d9f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.299247 Aug 31 00:20:47.901110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 9/24] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 31 00:20:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 301 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 00:20:48.045934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1392324466", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:48.209800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] validate_networks() for [('b02c08c3-060e-47b9-b9e9-e82b81bdce52', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:49.024329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:49.024800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:49.025223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:49.025633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:49.026049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:49.060243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:49.060728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:49.061161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:49.062247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:49.077592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:49.078156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:49.144262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Getting quotas for project 885b952a63b34e1ba97215831cffc58e. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:49.156397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Getting quotas for user 6d1a15d59d5d476ca6e0ab5176d310cd and project 885b952a63b34e1ba97215831cffc58e. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:49.196646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:49.206683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:49.415331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5a42d9ed-b1ac-46a8-acbb-91b072087e77 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.011914 Aug 31 00:20:49.419072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 16/25] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:20:49.441482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9d99a2ed-13f8-4a29-a52d-00d640b81960 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:49.445926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9d99a2ed-13f8-4a29-a52d-00d640b81960 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:49.452996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d99a2ed-13f8-4a29-a52d-00d640b81960 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:49.453719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d99a2ed-13f8-4a29-a52d-00d640b81960 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:49.454315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d99a2ed-13f8-4a29-a52d-00d640b81960 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:49.455216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d99a2ed-13f8-4a29-a52d-00d640b81960 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:49.456243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d99a2ed-13f8-4a29-a52d-00d640b81960 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:49.456839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d99a2ed-13f8-4a29-a52d-00d640b81960 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:49.948944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9d99a2ed-13f8-4a29-a52d-00d640b81960 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:49.957206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9d99a2ed-13f8-4a29-a52d-00d640b81960 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1272 microversion: 2.1 time: 0.536703 Aug 31 00:20:49.964027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 17/26] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:49 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1272 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:49.984499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-101842e6-cdec-4c2e-90e0-71ab16f12e20 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f49ef5e0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:50.229077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-101842e6-cdec-4c2e-90e0-71ab16f12e20 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/7a2a658f-4105-4075-8dae-8b3a3cc4aff1" status: 200 len: 350 microversion: 2.1 time: 0.263222 Aug 31 00:20:50.230825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 18/27] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:49 2022] GET /compute/v2.1/os-volumes/7a2a658f-4105-4075-8dae-8b3a3cc4aff1 => generated 350 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:50.245459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-56018cff-04c9-48ef-a50d-0cb83e1bf7b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:50.245921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-56018cff-04c9-48ef-a50d-0cb83e1bf7b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:50.924329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-56018cff-04c9-48ef-a50d-0cb83e1bf7b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:51.002207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-56018cff-04c9-48ef-a50d-0cb83e1bf7b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1236 microversion: 2.1 time: 0.763242 Aug 31 00:20:51.005384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 19/28] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:50 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1236 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:51.044467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-688e2716-17c2-4ab6-957c-abad5fa11acd tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:51.045128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-688e2716-17c2-4ab6-957c-abad5fa11acd tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:51.087799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-688e2716-17c2-4ab6-957c-abad5fa11acd tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:51.094114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-688e2716-17c2-4ab6-957c-abad5fa11acd tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:51.094749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-688e2716-17c2-4ab6-957c-abad5fa11acd tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:51.098596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-688e2716-17c2-4ab6-957c-abad5fa11acd tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:51.099116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-688e2716-17c2-4ab6-957c-abad5fa11acd tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:51.104898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-688e2716-17c2-4ab6-957c-abad5fa11acd tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:51.850149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:51.851475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:51.852124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:51.852704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:51.853277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:51.853742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-688e2716-17c2-4ab6-957c-abad5fa11acd tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:51.861522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-688e2716-17c2-4ab6-957c-abad5fa11acd tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1272 microversion: 2.1 time: 0.841905 Aug 31 00:20:51.862839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 20/29] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:51 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1272 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:51.889098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:51.909806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:51.910276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:51.911145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:51.911632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:51.912125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:51.954027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Getting quotas for project 6a4d75f50b854a909607941db6debb87. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:51.973570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Getting quotas for user 3ff39cd0e766400f9d25e3ad465c4faf and project 6a4d75f50b854a909607941db6debb87. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:52.006689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:52.009532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:52.031857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b015059b-1f1e-4c93-bb43-083d6564b791 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:52.032754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b015059b-1f1e-4c93-bb43-083d6564b791 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:52.041098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b015059b-1f1e-4c93-bb43-083d6564b791 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:52.041590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b015059b-1f1e-4c93-bb43-083d6564b791 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:52.042023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b015059b-1f1e-4c93-bb43-083d6564b791 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:52.045217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b015059b-1f1e-4c93-bb43-083d6564b791 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:52.045692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b015059b-1f1e-4c93-bb43-083d6564b791 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:52.046135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b015059b-1f1e-4c93-bb43-083d6564b791 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:52.146692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-716a3f6c-570c-4c30-a6fd-d304f08055f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.242884 Aug 31 00:20:52.149059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 10/30] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 4248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:20:52.168571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0cd85087-b672-497e-9a62-09c748f28992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:52.171910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0cd85087-b672-497e-9a62-09c748f28992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:52.417875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b015059b-1f1e-4c93-bb43-083d6564b791 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:52.427665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b015059b-1f1e-4c93-bb43-083d6564b791 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1240 microversion: 2.1 time: 0.399351 Aug 31 00:20:52.440135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 21/31] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:52 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1240 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:52.537392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b7113fcc-326b-4e19-9848-d39b79238dce tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f419b940>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:52.636809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0cd85087-b672-497e-9a62-09c748f28992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:52.676773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0cd85087-b672-497e-9a62-09c748f28992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1222 microversion: 2.1 time: 0.514984 Aug 31 00:20:52.688465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 11/32] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:52 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1222 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:52.727998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b7113fcc-326b-4e19-9848-d39b79238dce tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ed499a2a-aeda-417a-9d8f-ba436e52dc68" status: 200 len: 350 microversion: 2.1 time: 0.195352 Aug 31 00:20:52.742556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d56ec3c9-2a68-4c7a-ae27-e36508a5c060 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f425f430>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:52.744829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 22/33] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:52 2022] GET /compute/v2.1/os-volumes/ed499a2a-aeda-417a-9d8f-ba436e52dc68 => generated 350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:20:52.886851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9894a30b-95c4-43c7-b41e-01c8dfd144d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:52.888484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9894a30b-95c4-43c7-b41e-01c8dfd144d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:52.907817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9894a30b-95c4-43c7-b41e-01c8dfd144d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:52.932023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9894a30b-95c4-43c7-b41e-01c8dfd144d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:52.932404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9894a30b-95c4-43c7-b41e-01c8dfd144d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:52.933183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9894a30b-95c4-43c7-b41e-01c8dfd144d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:52.933770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9894a30b-95c4-43c7-b41e-01c8dfd144d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:52.934205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9894a30b-95c4-43c7-b41e-01c8dfd144d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.089727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d56ec3c9-2a68-4c7a-ae27-e36508a5c060 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.351747 Aug 31 00:20:53.099596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 12/34] 10.222.0.67 () {58 vars in 1134 bytes} [Wed Aug 31 00:20:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:53.105087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2702d3be-1d05-4094-943c-aae86b37d729 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f425e9d0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:53.528542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2702d3be-1d05-4094-943c-aae86b37d729 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.427269 Aug 31 00:20:53.540915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 13/35] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 31 00:20:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:53.552685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2047843868", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:53.698917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] validate_networks() for [('b02c08c3-060e-47b9-b9e9-e82b81bdce52', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:54.266899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9894a30b-95c4-43c7-b41e-01c8dfd144d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:54.282913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9894a30b-95c4-43c7-b41e-01c8dfd144d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 1.400752 Aug 31 00:20:54.283859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 23/36] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:52 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:54.301460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4d683478-c1ea-4336-967c-5ffcceec8f49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:54.302539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4d683478-c1ea-4336-967c-5ffcceec8f49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:54.314272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d683478-c1ea-4336-967c-5ffcceec8f49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:54.315065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d683478-c1ea-4336-967c-5ffcceec8f49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:54.315891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d683478-c1ea-4336-967c-5ffcceec8f49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:54.317006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d683478-c1ea-4336-967c-5ffcceec8f49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:54.317715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d683478-c1ea-4336-967c-5ffcceec8f49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:54.318295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d683478-c1ea-4336-967c-5ffcceec8f49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:54.466520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4d683478-c1ea-4336-967c-5ffcceec8f49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:54.479843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4d683478-c1ea-4336-967c-5ffcceec8f49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1288 microversion: 2.1 time: 0.194556 Aug 31 00:20:54.483338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 24/37] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:54 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1288 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:54.490568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1984456959", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea586570-88f9-4102-abb0-4f2d89e46acd"}], "security_groups": [{"name": "tempest-securitygroup--792764594"}], "key_name": "tempest-keypair-1413754213", "user_data": "}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:54.700553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] validate_networks() for [('ea586570-88f9-4102-abb0-4f2d89e46acd', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:54.797451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:54.798424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:54.799067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:54.799622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:54.800175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:54.810584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:54.811328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:54.811914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:54.812856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:54.813448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:54.814052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:54.837182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Getting quotas for project 6a4d75f50b854a909607941db6debb87. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:54.842011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Getting quotas for user 3ff39cd0e766400f9d25e3ad465c4faf and project 6a4d75f50b854a909607941db6debb87. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:54.855985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:54.858651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:54.973168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4093a5bc-5d79-4afb-8af2-bfb8c0efec2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.430825 Aug 31 00:20:54.976346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 14/38] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:20:54.995577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-563390b8-3db0-4e2e-a067-bd3b66b37ea5 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f425e700>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:55.211104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-563390b8-3db0-4e2e-a067-bd3b66b37ea5 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.232593 Aug 31 00:20:55.211685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 15/39] 10.222.0.67 () {58 vars in 1134 bytes} [Wed Aug 31 00:20:54 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:55.223425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d5d96861-edf2-4493-b438-60fda67b5882 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:55.224112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d5d96861-edf2-4493-b438-60fda67b5882 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:55.370713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d5d96861-edf2-4493-b438-60fda67b5882 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:55.387188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d5d96861-edf2-4493-b438-60fda67b5882 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1222 microversion: 2.1 time: 0.170689 Aug 31 00:20:55.390513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 16/40] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:55 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:55.402644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-294dc510-883b-417c-9214-bb757aa7e21a tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f427e5e0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:55.493981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:55.495580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:55.496582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:55.497853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:55.498939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:55.519075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:55.523798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:55.526419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.527386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:55.528201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:55.530008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.547942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-294dc510-883b-417c-9214-bb757aa7e21a tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.154702 Aug 31 00:20:55.563427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 17/41] 10.222.0.67 () {58 vars in 1167 bytes} [Wed Aug 31 00:20:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:55.574757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a772d4f8-c38c-4da5-be10-9f1ed021b625 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:55.575623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a772d4f8-c38c-4da5-be10-9f1ed021b625 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:55.582344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a772d4f8-c38c-4da5-be10-9f1ed021b625 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:55.583075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a772d4f8-c38c-4da5-be10-9f1ed021b625 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:55.583985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a772d4f8-c38c-4da5-be10-9f1ed021b625 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.584699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a772d4f8-c38c-4da5-be10-9f1ed021b625 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:55.585193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a772d4f8-c38c-4da5-be10-9f1ed021b625 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:55.585925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a772d4f8-c38c-4da5-be10-9f1ed021b625 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.598954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Getting quotas for project 5694aa9e83804fe19311f97ed6af1152. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:55.613181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Getting quotas for user 7d7582f9cdd646f39404f7adc99ad9ac and project 5694aa9e83804fe19311f97ed6af1152. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:55.646111 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:55.652109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:55.768265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1b447d16-0553-4ad4-ac24-8d58fe626ef1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.283492 Aug 31 00:20:55.769486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 25/42] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 31 00:20:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 00:20:55.774951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-14fccd20-55fe-4704-995b-0ac4aa9ad82c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:55.775599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-14fccd20-55fe-4704-995b-0ac4aa9ad82c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:55.782706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14fccd20-55fe-4704-995b-0ac4aa9ad82c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:55.783384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14fccd20-55fe-4704-995b-0ac4aa9ad82c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:55.786196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14fccd20-55fe-4704-995b-0ac4aa9ad82c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.786923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14fccd20-55fe-4704-995b-0ac4aa9ad82c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:55.789469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14fccd20-55fe-4704-995b-0ac4aa9ad82c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:55.789823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14fccd20-55fe-4704-995b-0ac4aa9ad82c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.877358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a772d4f8-c38c-4da5-be10-9f1ed021b625 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:55.890922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a772d4f8-c38c-4da5-be10-9f1ed021b625 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.325817 Aug 31 00:20:55.892020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 18/43] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:55 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:55.907156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b017a49d-4ca8-4942-8af7-bf162c92b28e tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f427e4c0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:55.918685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-14fccd20-55fe-4704-995b-0ac4aa9ad82c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:55.933838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-14fccd20-55fe-4704-995b-0ac4aa9ad82c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1288 microversion: 2.1 time: 0.163134 Aug 31 00:20:55.935088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 26/44] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:55 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1288 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:55.940540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2c6283d8-21fb-46be-a38d-e6683ce8c847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:55.941475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2c6283d8-21fb-46be-a38d-e6683ce8c847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:56.077604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c6283d8-21fb-46be-a38d-e6683ce8c847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:56.091394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c6283d8-21fb-46be-a38d-e6683ce8c847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:56.094786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c6283d8-21fb-46be-a38d-e6683ce8c847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:56.096478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2c6283d8-21fb-46be-a38d-e6683ce8c847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1282 microversion: 2.20 time: 0.159992 Aug 31 00:20:56.097425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 27/45] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:20:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:20:56.113939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b017a49d-4ca8-4942-8af7-bf162c92b28e tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.219679 Aug 31 00:20:56.115822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 19/46] 10.222.0.67 () {58 vars in 1170 bytes} [Wed Aug 31 00:20:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:56.132462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b534bfed-e886-4d1a-acf4-f367b488188a tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f49efaf0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:56.270873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b534bfed-e886-4d1a-acf4-f367b488188a tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.143604 Aug 31 00:20:56.280066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 28/47] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 31 00:20:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:56.291415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1a505712-f3e0-469d-a749-4793c3e11d19 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f425e430>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:56.414149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-810cd758-6d90-4fc8-b721-82ec98010799 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:56.414971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-810cd758-6d90-4fc8-b721-82ec98010799 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:56.424496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-810cd758-6d90-4fc8-b721-82ec98010799 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.430771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-810cd758-6d90-4fc8-b721-82ec98010799 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.431170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1a505712-f3e0-469d-a749-4793c3e11d19 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.146907 Aug 31 00:20:56.431336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-810cd758-6d90-4fc8-b721-82ec98010799 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.431749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 20/48] 10.222.0.67 () {58 vars in 1188 bytes} [Wed Aug 31 00:20:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:56.432707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-810cd758-6d90-4fc8-b721-82ec98010799 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.435123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-810cd758-6d90-4fc8-b721-82ec98010799 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.435789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-810cd758-6d90-4fc8-b721-82ec98010799 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.445208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9f938e40-45a6-4d04-84a8-ff153c7dd8c9 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] Calling method '.version_select at 0x7fa7f421c280>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:56.519308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-810cd758-6d90-4fc8-b721-82ec98010799 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:56.529843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-810cd758-6d90-4fc8-b721-82ec98010799 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1226 microversion: 2.1 time: 0.119409 Aug 31 00:20:56.530910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 29/49] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:56 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:56.626878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9f938e40-45a6-4d04-84a8-ff153c7dd8c9 tempest-VolumesTestJSON-739122158 tempest-VolumesTestJSON-739122158-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.185840 Aug 31 00:20:56.627875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 21/50] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 31 00:20:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:56.914327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-49191569-3d36-4d91-a861-972c81e83885 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:56.914932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-49191569-3d36-4d91-a861-972c81e83885 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:56.924019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49191569-3d36-4d91-a861-972c81e83885 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.924491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49191569-3d36-4d91-a861-972c81e83885 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.924915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49191569-3d36-4d91-a861-972c81e83885 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.925594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49191569-3d36-4d91-a861-972c81e83885 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.926035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49191569-3d36-4d91-a861-972c81e83885 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.926446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49191569-3d36-4d91-a861-972c81e83885 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.969225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2c9a2c07-9f9d-421b-82fb-d321c632dde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:56.970353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2c9a2c07-9f9d-421b-82fb-d321c632dde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:56.978729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c9a2c07-9f9d-421b-82fb-d321c632dde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.980933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c9a2c07-9f9d-421b-82fb-d321c632dde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.982537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c9a2c07-9f9d-421b-82fb-d321c632dde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.984395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c9a2c07-9f9d-421b-82fb-d321c632dde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.986672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c9a2c07-9f9d-421b-82fb-d321c632dde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.987351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c9a2c07-9f9d-421b-82fb-d321c632dde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.151315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2c9a2c07-9f9d-421b-82fb-d321c632dde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.159223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2c9a2c07-9f9d-421b-82fb-d321c632dde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1288 microversion: 2.1 time: 0.194268 Aug 31 00:20:57.159802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 22/51] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:56 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1288 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:57.188045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:57.189039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:57.197854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.202663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.203399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.204661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.205307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.205912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.407530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-49191569-3d36-4d91-a861-972c81e83885 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.418913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.419094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-49191569-3d36-4d91-a861-972c81e83885 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.508720 Aug 31 00:20:57.425287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 30/52] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:56 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:57.434613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.452268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.459599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6d54510a-7196-45e5-861d-3929b09cbed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1286 microversion: 2.20 time: 0.273170 Aug 31 00:20:57.475063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 23/53] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:20:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1286 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:20:57.555224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-63aaf4e6-7d93-433b-9065-a40e954b2d92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:57.558133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-63aaf4e6-7d93-433b-9065-a40e954b2d92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:57.574626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63aaf4e6-7d93-433b-9065-a40e954b2d92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.575451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63aaf4e6-7d93-433b-9065-a40e954b2d92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.578501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63aaf4e6-7d93-433b-9065-a40e954b2d92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.581605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63aaf4e6-7d93-433b-9065-a40e954b2d92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.584220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63aaf4e6-7d93-433b-9065-a40e954b2d92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.586506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63aaf4e6-7d93-433b-9065-a40e954b2d92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.826617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-63aaf4e6-7d93-433b-9065-a40e954b2d92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.834831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-63aaf4e6-7d93-433b-9065-a40e954b2d92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1226 microversion: 2.1 time: 0.287626 Aug 31 00:20:57.837736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 31/54] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:57 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1226 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:58.190155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aabfe4cf-e103-49b7-8fae-e1d1d016d595 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:58.191480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aabfe4cf-e103-49b7-8fae-e1d1d016d595 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:58.198222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aabfe4cf-e103-49b7-8fae-e1d1d016d595 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.198991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aabfe4cf-e103-49b7-8fae-e1d1d016d595 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.199676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aabfe4cf-e103-49b7-8fae-e1d1d016d595 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.200558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aabfe4cf-e103-49b7-8fae-e1d1d016d595 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.201218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aabfe4cf-e103-49b7-8fae-e1d1d016d595 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.201834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aabfe4cf-e103-49b7-8fae-e1d1d016d595 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.344662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aabfe4cf-e103-49b7-8fae-e1d1d016d595 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:58.371712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aabfe4cf-e103-49b7-8fae-e1d1d016d595 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1296 microversion: 2.1 time: 0.168748 Aug 31 00:20:58.376393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 24/55] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:58 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1296 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:58.448738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0a0685ec-4d71-42ab-a976-871b85a5f68c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:58.450331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0a0685ec-4d71-42ab-a976-871b85a5f68c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:58.470507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a0685ec-4d71-42ab-a976-871b85a5f68c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.477370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a0685ec-4d71-42ab-a976-871b85a5f68c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.484570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a0685ec-4d71-42ab-a976-871b85a5f68c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.485651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a0685ec-4d71-42ab-a976-871b85a5f68c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.489766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:58.490581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:58.499483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.500982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a0685ec-4d71-42ab-a976-871b85a5f68c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.512366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a0685ec-4d71-42ab-a976-871b85a5f68c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.520456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.523172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.533705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.534394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.537806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.852636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:58.871932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:58.873552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:58.874756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a3d6d347-4fdc-4594-9975-09b3f45a99f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1286 microversion: 2.20 time: 0.391388 Aug 31 00:20:58.875860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 25/56] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:20:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1286 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:20:58.893566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3a8e8ddd-f4ff-413e-931e-d3a9c653e7d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:58.894263 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3a8e8ddd-f4ff-413e-931e-d3a9c653e7d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:58.903799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a8e8ddd-f4ff-413e-931e-d3a9c653e7d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.907323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a8e8ddd-f4ff-413e-931e-d3a9c653e7d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.908010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a8e8ddd-f4ff-413e-931e-d3a9c653e7d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.908947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a8e8ddd-f4ff-413e-931e-d3a9c653e7d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.909737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a8e8ddd-f4ff-413e-931e-d3a9c653e7d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.910450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a8e8ddd-f4ff-413e-931e-d3a9c653e7d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.109556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0a0685ec-4d71-42ab-a976-871b85a5f68c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:59.119831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0a0685ec-4d71-42ab-a976-871b85a5f68c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.674914 Aug 31 00:20:59.120554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 32/57] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:58 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:59.129186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3a8e8ddd-f4ff-413e-931e-d3a9c653e7d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:59.139062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3a8e8ddd-f4ff-413e-931e-d3a9c653e7d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1226 microversion: 2.1 time: 0.261966 Aug 31 00:20:59.139633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 26/58] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:58 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1226 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:59.254493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-ad1a63b8-3bf0-4dbc-a844-a7c1b78dea26 req-365aa523-c4d0-4719-990e-20a2a7bba014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2cfd30-5052-44b3-8237-9a4be97fc51e", "tag": "e37680ba-ffb5-455c-94ed-561aea176f93"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:59.267814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ad1a63b8-3bf0-4dbc-a844-a7c1b78dea26 req-365aa523-c4d0-4719-990e-20a2a7bba014 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.268287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ad1a63b8-3bf0-4dbc-a844-a7c1b78dea26 req-365aa523-c4d0-4719-990e-20a2a7bba014 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.268711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ad1a63b8-3bf0-4dbc-a844-a7c1b78dea26 req-365aa523-c4d0-4719-990e-20a2a7bba014 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.288021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-ad1a63b8-3bf0-4dbc-a844-a7c1b78dea26 req-365aa523-c4d0-4719-990e-20a2a7bba014 service nova] Creating event network-changed:e37680ba-ffb5-455c-94ed-561aea176f93 for instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e on hv-cinder-85506 Aug 31 00:20:59.288710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ad1a63b8-3bf0-4dbc-a844-a7c1b78dea26 req-365aa523-c4d0-4719-990e-20a2a7bba014 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 00:20:59.289310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ad1a63b8-3bf0-4dbc-a844-a7c1b78dea26 req-365aa523-c4d0-4719-990e-20a2a7bba014 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 00:20:59.290368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cba8d6a-e3a7-4cb0-80b5-80a29683d222 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.290842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cba8d6a-e3a7-4cb0-80b5-80a29683d222 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.291290 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cba8d6a-e3a7-4cb0-80b5-80a29683d222 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.291999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cba8d6a-e3a7-4cb0-80b5-80a29683d222 None None] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.292623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cba8d6a-e3a7-4cb0-80b5-80a29683d222 None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.293204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cba8d6a-e3a7-4cb0-80b5-80a29683d222 None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.302351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.compute.rpcapi [None req-5cba8d6a-e3a7-4cb0-80b5-80a29683d222 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 00:20:59.303536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cba8d6a-e3a7-4cb0-80b5-80a29683d222 None None] Releasing lock "compute-rpcapi-router" {{(pid=126976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 00:20:59.322638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5cba8d6a-e3a7-4cb0-80b5-80a29683d222 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199684 Aug 31 00:20:59.326302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 33/59] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:59.400115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-27416ccc-ab81-46eb-85a2-407c7df8a290 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:59.401355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-27416ccc-ab81-46eb-85a2-407c7df8a290 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:59.421002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27416ccc-ab81-46eb-85a2-407c7df8a290 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.421591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27416ccc-ab81-46eb-85a2-407c7df8a290 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.422104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27416ccc-ab81-46eb-85a2-407c7df8a290 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.422839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27416ccc-ab81-46eb-85a2-407c7df8a290 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.423288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27416ccc-ab81-46eb-85a2-407c7df8a290 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.423754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27416ccc-ab81-46eb-85a2-407c7df8a290 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.531522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-27416ccc-ab81-46eb-85a2-407c7df8a290 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:59.543994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-27416ccc-ab81-46eb-85a2-407c7df8a290 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1296 microversion: 2.1 time: 0.151472 Aug 31 00:20:59.546857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 27/60] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:59 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1296 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:59.902637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:59.906648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:59.911683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.912201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.912633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.913901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.914532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.915154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.028993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.039538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.041131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.042233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cb374ce3-4910-4885-98a0-60e2ec81aee8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1286 microversion: 2.20 time: 0.146453 Aug 31 00:21:00.043271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 34/61] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:20:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:00.141811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f2d1ba55-c7ba-4251-ba21-a1fd64093f16 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:00.142472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f2d1ba55-c7ba-4251-ba21-a1fd64093f16 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:00.148964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2d1ba55-c7ba-4251-ba21-a1fd64093f16 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.149608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2d1ba55-c7ba-4251-ba21-a1fd64093f16 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.150080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2d1ba55-c7ba-4251-ba21-a1fd64093f16 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.150765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2d1ba55-c7ba-4251-ba21-a1fd64093f16 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.151236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2d1ba55-c7ba-4251-ba21-a1fd64093f16 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.151649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2d1ba55-c7ba-4251-ba21-a1fd64093f16 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.159644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ec605baf-63e4-4e6b-b91a-bda46120b71c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:00.160882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ec605baf-63e4-4e6b-b91a-bda46120b71c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:00.167245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec605baf-63e4-4e6b-b91a-bda46120b71c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.167931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec605baf-63e4-4e6b-b91a-bda46120b71c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.168571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec605baf-63e4-4e6b-b91a-bda46120b71c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.169404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec605baf-63e4-4e6b-b91a-bda46120b71c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.169819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec605baf-63e4-4e6b-b91a-bda46120b71c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.170449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec605baf-63e4-4e6b-b91a-bda46120b71c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.297400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ec605baf-63e4-4e6b-b91a-bda46120b71c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.315199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ec605baf-63e4-4e6b-b91a-bda46120b71c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1226 microversion: 2.1 time: 0.158754 Aug 31 00:21:00.316892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 35/62] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:00 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1226 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:00.390502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f2d1ba55-c7ba-4251-ba21-a1fd64093f16 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.398245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f2d1ba55-c7ba-4251-ba21-a1fd64093f16 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.260220 Aug 31 00:21:00.398938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 28/63] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:00 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:00.570597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9333d187-a83f-4456-8371-e6997a8dadda tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:00.571680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9333d187-a83f-4456-8371-e6997a8dadda tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:00.580003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9333d187-a83f-4456-8371-e6997a8dadda tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.580747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9333d187-a83f-4456-8371-e6997a8dadda tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.581333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9333d187-a83f-4456-8371-e6997a8dadda tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.582242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9333d187-a83f-4456-8371-e6997a8dadda tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.582893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9333d187-a83f-4456-8371-e6997a8dadda tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.583522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9333d187-a83f-4456-8371-e6997a8dadda tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.693915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9333d187-a83f-4456-8371-e6997a8dadda tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.709112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9333d187-a83f-4456-8371-e6997a8dadda tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1296 microversion: 2.1 time: 0.143140 Aug 31 00:21:00.710560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 36/64] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1296 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:01.065919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:01.067175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:01.079296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.080542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.081328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.082335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.083006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.083521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.160163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.179200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.181369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.183202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5a878e5f-350f-4a9c-87f2-154698f0d99a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1286 microversion: 2.20 time: 0.121188 Aug 31 00:21:01.200182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 29/65] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:01.337774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-62d6c8d1-3093-4b1c-af2d-b7f6c2415ca8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:01.338378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-62d6c8d1-3093-4b1c-af2d-b7f6c2415ca8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:01.344639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62d6c8d1-3093-4b1c-af2d-b7f6c2415ca8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.345116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62d6c8d1-3093-4b1c-af2d-b7f6c2415ca8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.345544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62d6c8d1-3093-4b1c-af2d-b7f6c2415ca8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.346221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62d6c8d1-3093-4b1c-af2d-b7f6c2415ca8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.346687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62d6c8d1-3093-4b1c-af2d-b7f6c2415ca8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.347113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62d6c8d1-3093-4b1c-af2d-b7f6c2415ca8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.422952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a094aa69-9f7c-4a0a-8034-f8b247e84a9b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:01.424095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a094aa69-9f7c-4a0a-8034-f8b247e84a9b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:01.428462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-62d6c8d1-3093-4b1c-af2d-b7f6c2415ca8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.436209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a094aa69-9f7c-4a0a-8034-f8b247e84a9b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.436962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a094aa69-9f7c-4a0a-8034-f8b247e84a9b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.437389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a094aa69-9f7c-4a0a-8034-f8b247e84a9b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.438094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a094aa69-9f7c-4a0a-8034-f8b247e84a9b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.438539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a094aa69-9f7c-4a0a-8034-f8b247e84a9b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.438950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a094aa69-9f7c-4a0a-8034-f8b247e84a9b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.439663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-62d6c8d1-3093-4b1c-af2d-b7f6c2415ca8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1226 microversion: 2.1 time: 0.105797 Aug 31 00:21:01.440696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 37/66] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:01 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:01.641625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a094aa69-9f7c-4a0a-8034-f8b247e84a9b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.658942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a094aa69-9f7c-4a0a-8034-f8b247e84a9b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.242386 Aug 31 00:21:01.659805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 30/67] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:01 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:01.733071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9dca0af9-9a21-416d-a8cd-64ee46c794dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:01.733691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9dca0af9-9a21-416d-a8cd-64ee46c794dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:01.744203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca0af9-9a21-416d-a8cd-64ee46c794dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.744699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca0af9-9a21-416d-a8cd-64ee46c794dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.745137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca0af9-9a21-416d-a8cd-64ee46c794dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.745841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca0af9-9a21-416d-a8cd-64ee46c794dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.746293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca0af9-9a21-416d-a8cd-64ee46c794dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.746715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca0af9-9a21-416d-a8cd-64ee46c794dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.770322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:01.877763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9dca0af9-9a21-416d-a8cd-64ee46c794dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.901990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9dca0af9-9a21-416d-a8cd-64ee46c794dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1296 microversion: 2.1 time: 0.168713 Aug 31 00:21:01.902227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 38/68] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:01 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1296 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:02.208157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:02.209580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:02.219697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:02.237225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.238375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.240499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.243692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.247197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.248484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.451967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:02.464324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3856919e-7c09-4b5e-8e78-6287ab0d47c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:02.465208 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3856919e-7c09-4b5e-8e78-6287ab0d47c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:02.472869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:02.475302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3856919e-7c09-4b5e-8e78-6287ab0d47c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.476576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3856919e-7c09-4b5e-8e78-6287ab0d47c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.477027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:02.477444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3856919e-7c09-4b5e-8e78-6287ab0d47c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.478875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3856919e-7c09-4b5e-8e78-6287ab0d47c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.479698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3856919e-7c09-4b5e-8e78-6287ab0d47c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.480539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3856919e-7c09-4b5e-8e78-6287ab0d47c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.483858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d6110c04-07fc-4339-aafe-c7a7f80b48aa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1286 microversion: 2.20 time: 0.276022 Aug 31 00:21:02.486989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 31/69] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1286 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:02.631653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3856919e-7c09-4b5e-8e78-6287ab0d47c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:02.651004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3856919e-7c09-4b5e-8e78-6287ab0d47c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1226 microversion: 2.1 time: 0.193017 Aug 31 00:21:02.652559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 39/70] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:02 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1226 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:02.682866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9d9b00a1-5be7-4888-8df0-63aeded054d2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:02.684063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9d9b00a1-5be7-4888-8df0-63aeded054d2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:02.697072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d9b00a1-5be7-4888-8df0-63aeded054d2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.697842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d9b00a1-5be7-4888-8df0-63aeded054d2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.699774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d9b00a1-5be7-4888-8df0-63aeded054d2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.700653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d9b00a1-5be7-4888-8df0-63aeded054d2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.702171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d9b00a1-5be7-4888-8df0-63aeded054d2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.704862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d9b00a1-5be7-4888-8df0-63aeded054d2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.934897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0518b222-2e4c-40be-adb0-159602c8e531 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:02.936213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0518b222-2e4c-40be-adb0-159602c8e531 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:02.949072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0518b222-2e4c-40be-adb0-159602c8e531 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.951580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0518b222-2e4c-40be-adb0-159602c8e531 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.952330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0518b222-2e4c-40be-adb0-159602c8e531 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.953795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0518b222-2e4c-40be-adb0-159602c8e531 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.954629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0518b222-2e4c-40be-adb0-159602c8e531 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.955499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0518b222-2e4c-40be-adb0-159602c8e531 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.318579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0518b222-2e4c-40be-adb0-159602c8e531 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:03.334040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0518b222-2e4c-40be-adb0-159602c8e531 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1296 microversion: 2.1 time: 0.406118 Aug 31 00:21:03.334963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 40/71] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:02 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1296 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:03.469144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9d9b00a1-5be7-4888-8df0-63aeded054d2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:03.493736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9d9b00a1-5be7-4888-8df0-63aeded054d2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.816939 Aug 31 00:21:03.498877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 32/72] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:02 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:03.528266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:03.530151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:03.543895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.543895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.543895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.545626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.546328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.555268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.683525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-75714d93-252a-4868-902d-c0a613daba23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:03.684595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-75714d93-252a-4868-902d-c0a613daba23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:03.696484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75714d93-252a-4868-902d-c0a613daba23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.702396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75714d93-252a-4868-902d-c0a613daba23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.708534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75714d93-252a-4868-902d-c0a613daba23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.711538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75714d93-252a-4868-902d-c0a613daba23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.713137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75714d93-252a-4868-902d-c0a613daba23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.718593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75714d93-252a-4868-902d-c0a613daba23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.763213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:03.778130 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:03.785215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:03.790176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7d711c71-82ef-4760-9e24-654b73e8c62f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1278 microversion: 2.20 time: 0.269256 Aug 31 00:21:03.811484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 41/73] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1278 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:04.017909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-75714d93-252a-4868-902d-c0a613daba23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.019834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-75714d93-252a-4868-902d-c0a613daba23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1274 microversion: 2.1 time: 0.339755 Aug 31 00:21:04.034606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 33/74] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:03 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1274 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:04.361928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-75e72dcb-f923-4c48-b4bc-11d3190dcae3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:04.362848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-75e72dcb-f923-4c48-b4bc-11d3190dcae3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:04.376155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e72dcb-f923-4c48-b4bc-11d3190dcae3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.379292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e72dcb-f923-4c48-b4bc-11d3190dcae3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.383028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e72dcb-f923-4c48-b4bc-11d3190dcae3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.386188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e72dcb-f923-4c48-b4bc-11d3190dcae3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.391934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e72dcb-f923-4c48-b4bc-11d3190dcae3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.396464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e72dcb-f923-4c48-b4bc-11d3190dcae3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.543440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-018d3cbb-25f7-4bd0-bc39-6cc1b89825a2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:04.557432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-018d3cbb-25f7-4bd0-bc39-6cc1b89825a2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:04.560941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-75e72dcb-f923-4c48-b4bc-11d3190dcae3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.574678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-75e72dcb-f923-4c48-b4bc-11d3190dcae3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1294 microversion: 2.1 time: 0.217019 Aug 31 00:21:04.576151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-018d3cbb-25f7-4bd0-bc39-6cc1b89825a2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.579156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 42/75] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:04 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:04.581271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-018d3cbb-25f7-4bd0-bc39-6cc1b89825a2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.582569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-018d3cbb-25f7-4bd0-bc39-6cc1b89825a2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.585175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-018d3cbb-25f7-4bd0-bc39-6cc1b89825a2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.589167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-018d3cbb-25f7-4bd0-bc39-6cc1b89825a2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.589167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-018d3cbb-25f7-4bd0-bc39-6cc1b89825a2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.816216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:04.817233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:04.826283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=6 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:04.828673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:04.839743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.841915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.844094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.845615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.846898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.847568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.862179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-018d3cbb-25f7-4bd0-bc39-6cc1b89825a2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.897396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-018d3cbb-25f7-4bd0-bc39-6cc1b89825a2 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.378987 Aug 31 00:21:04.898981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 34/76] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:04 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:05.011311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:05.024091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:05.029810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:05.032442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b8dbb5c0-f495-460f-a754-e9ff65bb937f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1334 microversion: 2.20 time: 0.220201 Aug 31 00:21:05.033262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 43/77] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1334 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:05.042806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f757785e-5ab4-4263-8f2c-a20a272b10c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:05.043512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f757785e-5ab4-4263-8f2c-a20a272b10c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:05.058169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f757785e-5ab4-4263-8f2c-a20a272b10c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.058169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f757785e-5ab4-4263-8f2c-a20a272b10c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.058330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f757785e-5ab4-4263-8f2c-a20a272b10c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.062935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f757785e-5ab4-4263-8f2c-a20a272b10c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.063763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f757785e-5ab4-4263-8f2c-a20a272b10c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.066315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f757785e-5ab4-4263-8f2c-a20a272b10c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.098427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:05.185444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f757785e-5ab4-4263-8f2c-a20a272b10c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:05.196001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f757785e-5ab4-4263-8f2c-a20a272b10c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1274 microversion: 2.1 time: 0.157645 Aug 31 00:21:05.214820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 35/78] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:05 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:05.598500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-60c802d6-0aeb-4e59-a61f-2159ab8e999e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:05.599857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-60c802d6-0aeb-4e59-a61f-2159ab8e999e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:05.612215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60c802d6-0aeb-4e59-a61f-2159ab8e999e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.613270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60c802d6-0aeb-4e59-a61f-2159ab8e999e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.614867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60c802d6-0aeb-4e59-a61f-2159ab8e999e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.618692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60c802d6-0aeb-4e59-a61f-2159ab8e999e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.619687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60c802d6-0aeb-4e59-a61f-2159ab8e999e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.621806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60c802d6-0aeb-4e59-a61f-2159ab8e999e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.854458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-60c802d6-0aeb-4e59-a61f-2159ab8e999e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:05.862158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-60c802d6-0aeb-4e59-a61f-2159ab8e999e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.268754 Aug 31 00:21:05.866829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 44/79] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:05 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:05.933866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-af597059-6c87-40f9-a382-f0afed43372f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:05.935772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-af597059-6c87-40f9-a382-f0afed43372f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:05.946353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=30 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:05.956680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af597059-6c87-40f9-a382-f0afed43372f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.965010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af597059-6c87-40f9-a382-f0afed43372f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.966659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af597059-6c87-40f9-a382-f0afed43372f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.969911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af597059-6c87-40f9-a382-f0afed43372f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.971152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af597059-6c87-40f9-a382-f0afed43372f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.978000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af597059-6c87-40f9-a382-f0afed43372f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.058609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:06.059635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:06.073634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.078879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.081538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.083919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.086373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.087230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.089145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=20 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:06.239298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.257607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.259031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.260213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6d7b79a2-6bdc-4878-979b-3935ae32cc24 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1334 microversion: 2.20 time: 0.205874 Aug 31 00:21:06.262757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 45/80] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1334 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:06.279376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-736b7da7-7ef2-4304-9153-16dc82b68d74 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:06.280016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-736b7da7-7ef2-4304-9153-16dc82b68d74 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:06.287611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-736b7da7-7ef2-4304-9153-16dc82b68d74 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.289108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-736b7da7-7ef2-4304-9153-16dc82b68d74 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.289619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-736b7da7-7ef2-4304-9153-16dc82b68d74 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.290414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-736b7da7-7ef2-4304-9153-16dc82b68d74 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.291006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-736b7da7-7ef2-4304-9153-16dc82b68d74 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.291524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-736b7da7-7ef2-4304-9153-16dc82b68d74 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.364089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-af597059-6c87-40f9-a382-f0afed43372f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.377803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-af597059-6c87-40f9-a382-f0afed43372f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.451323 Aug 31 00:21:06.380198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 36/81] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:05 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:06.389221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-736b7da7-7ef2-4304-9153-16dc82b68d74 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.406955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-736b7da7-7ef2-4304-9153-16dc82b68d74 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1274 microversion: 2.1 time: 0.142873 Aug 31 00:21:06.419217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 46/82] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:06 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:06.894216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-64e78dae-6a8f-4925-b57c-459c77e8970f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:06.895104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-64e78dae-6a8f-4925-b57c-459c77e8970f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:06.905582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64e78dae-6a8f-4925-b57c-459c77e8970f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.907612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64e78dae-6a8f-4925-b57c-459c77e8970f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.908925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64e78dae-6a8f-4925-b57c-459c77e8970f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.909643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64e78dae-6a8f-4925-b57c-459c77e8970f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.910101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64e78dae-6a8f-4925-b57c-459c77e8970f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.910524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64e78dae-6a8f-4925-b57c-459c77e8970f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.124338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-64e78dae-6a8f-4925-b57c-459c77e8970f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.138964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-64e78dae-6a8f-4925-b57c-459c77e8970f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.248891 Aug 31 00:21:07.153556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 37/83] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:06 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:07.289839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:07.290451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:07.297730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.298426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.299021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.300101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.300818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.301648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.379942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.391928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.393565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.394864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2bdbbc3d-87c6-4bc7-99b7-c996933b0b36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1334 microversion: 2.20 time: 0.109581 Aug 31 00:21:07.395983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 47/84] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1334 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:07.410866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ae52f22c-ff52-42a8-8049-1ee16db3f385 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:07.411570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ae52f22c-ff52-42a8-8049-1ee16db3f385 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:07.422202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae52f22c-ff52-42a8-8049-1ee16db3f385 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.423131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae52f22c-ff52-42a8-8049-1ee16db3f385 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.424655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae52f22c-ff52-42a8-8049-1ee16db3f385 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.426567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae52f22c-ff52-42a8-8049-1ee16db3f385 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.427520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae52f22c-ff52-42a8-8049-1ee16db3f385 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.427963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae52f22c-ff52-42a8-8049-1ee16db3f385 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.434847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f62e0fd5-cff2-47d5-a1a5-03a7e3a2f888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:07.435073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f62e0fd5-cff2-47d5-a1a5-03a7e3a2f888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:07.450273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62e0fd5-cff2-47d5-a1a5-03a7e3a2f888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.450772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62e0fd5-cff2-47d5-a1a5-03a7e3a2f888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.451350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62e0fd5-cff2-47d5-a1a5-03a7e3a2f888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.452007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62e0fd5-cff2-47d5-a1a5-03a7e3a2f888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.453495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62e0fd5-cff2-47d5-a1a5-03a7e3a2f888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.453902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62e0fd5-cff2-47d5-a1a5-03a7e3a2f888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.558516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f62e0fd5-cff2-47d5-a1a5-03a7e3a2f888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.571962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f62e0fd5-cff2-47d5-a1a5-03a7e3a2f888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1282 microversion: 2.1 time: 0.142488 Aug 31 00:21:07.573162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 48/85] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:07 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:07.664523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ae52f22c-ff52-42a8-8049-1ee16db3f385 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.674216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ae52f22c-ff52-42a8-8049-1ee16db3f385 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.275386 Aug 31 00:21:07.675556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 38/86] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:07 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:08.166155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2d1781f3-7558-4250-afa5-c0be3c5634a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:08.171360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2d1781f3-7558-4250-afa5-c0be3c5634a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:08.184355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1781f3-7558-4250-afa5-c0be3c5634a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.184867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1781f3-7558-4250-afa5-c0be3c5634a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.185508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1781f3-7558-4250-afa5-c0be3c5634a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.186572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1781f3-7558-4250-afa5-c0be3c5634a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.187217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1781f3-7558-4250-afa5-c0be3c5634a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.187637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1781f3-7558-4250-afa5-c0be3c5634a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.430886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:08.435156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:08.462402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.464406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.468518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.475043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.478100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.479319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.509444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d1781f3-7558-4250-afa5-c0be3c5634a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:08.518228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2d1781f3-7558-4250-afa5-c0be3c5634a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.356439 Aug 31 00:21:08.518802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 49/87] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:08 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:08.602479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e519967c-59af-490c-8a80-18c9eefd2ccf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:08.603518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e519967c-59af-490c-8a80-18c9eefd2ccf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:08.623449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e519967c-59af-490c-8a80-18c9eefd2ccf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.625010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e519967c-59af-490c-8a80-18c9eefd2ccf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.629072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e519967c-59af-490c-8a80-18c9eefd2ccf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.630914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e519967c-59af-490c-8a80-18c9eefd2ccf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.635220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e519967c-59af-490c-8a80-18c9eefd2ccf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.639066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e519967c-59af-490c-8a80-18c9eefd2ccf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.683086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:08.697600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:08.702282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:08.709235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-825ffff1-8447-446c-aeec-4ef62b17c764 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1334 microversion: 2.20 time: 0.292584 Aug 31 00:21:08.710230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 39/88] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1334 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:08.728662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed73396b-fac9-4ba8-8a1b-b0464321c8d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:08.729640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ed73396b-fac9-4ba8-8a1b-b0464321c8d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:08.740364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed73396b-fac9-4ba8-8a1b-b0464321c8d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.744208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed73396b-fac9-4ba8-8a1b-b0464321c8d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.744818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed73396b-fac9-4ba8-8a1b-b0464321c8d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.746590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed73396b-fac9-4ba8-8a1b-b0464321c8d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.754913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed73396b-fac9-4ba8-8a1b-b0464321c8d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.755391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed73396b-fac9-4ba8-8a1b-b0464321c8d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.035532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e519967c-59af-490c-8a80-18c9eefd2ccf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.049470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e519967c-59af-490c-8a80-18c9eefd2ccf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1282 microversion: 2.1 time: 0.451163 Aug 31 00:21:09.050237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 50/89] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:08 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1282 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:09.237844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ed73396b-fac9-4ba8-8a1b-b0464321c8d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.246819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ed73396b-fac9-4ba8-8a1b-b0464321c8d6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.534415 Aug 31 00:21:09.259810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 40/90] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:08 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:09.543621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8baba7b1-e051-4559-9b8a-856bf7ee0fb7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.544903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8baba7b1-e051-4559-9b8a-856bf7ee0fb7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:09.548133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:09.554625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8baba7b1-e051-4559-9b8a-856bf7ee0fb7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.555442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8baba7b1-e051-4559-9b8a-856bf7ee0fb7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.556097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8baba7b1-e051-4559-9b8a-856bf7ee0fb7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.557009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8baba7b1-e051-4559-9b8a-856bf7ee0fb7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.557813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8baba7b1-e051-4559-9b8a-856bf7ee0fb7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.558431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8baba7b1-e051-4559-9b8a-856bf7ee0fb7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.736115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.737370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:09.748313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.749608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.751128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.752469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.759666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.759666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.040247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:10.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:10.056287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:10.057418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3f20e544-4690-43a9-8047-076b798e4655 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1340 microversion: 2.20 time: 0.325544 Aug 31 00:21:10.060037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 41/91] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1340 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:10.080193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2af5faa7-b750-41ad-845c-0ae14d60ae23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:10.081037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2af5faa7-b750-41ad-845c-0ae14d60ae23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:10.090669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af5faa7-b750-41ad-845c-0ae14d60ae23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.091332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af5faa7-b750-41ad-845c-0ae14d60ae23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.092134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af5faa7-b750-41ad-845c-0ae14d60ae23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.093068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af5faa7-b750-41ad-845c-0ae14d60ae23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.093736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af5faa7-b750-41ad-845c-0ae14d60ae23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.094617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af5faa7-b750-41ad-845c-0ae14d60ae23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.340926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8baba7b1-e051-4559-9b8a-856bf7ee0fb7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:10.348665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8baba7b1-e051-4559-9b8a-856bf7ee0fb7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.811767 Aug 31 00:21:10.362266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 51/92] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:09 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:10.365639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-19a6c7a5-9d07-43e5-af13-23bcfff97666 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:10.367023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-19a6c7a5-9d07-43e5-af13-23bcfff97666 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:10.381927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a6c7a5-9d07-43e5-af13-23bcfff97666 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.383205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a6c7a5-9d07-43e5-af13-23bcfff97666 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.383974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a6c7a5-9d07-43e5-af13-23bcfff97666 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.386984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a6c7a5-9d07-43e5-af13-23bcfff97666 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.387572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a6c7a5-9d07-43e5-af13-23bcfff97666 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.388068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a6c7a5-9d07-43e5-af13-23bcfff97666 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.396966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2af5faa7-b750-41ad-845c-0ae14d60ae23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:10.407601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2af5faa7-b750-41ad-845c-0ae14d60ae23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1280 microversion: 2.1 time: 0.331174 Aug 31 00:21:10.412036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 42/93] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:10 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1280 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:10.991004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-19a6c7a5-9d07-43e5-af13-23bcfff97666 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.005714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-19a6c7a5-9d07-43e5-af13-23bcfff97666 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.648996 Aug 31 00:21:11.009070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 52/94] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:10 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:11.085918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:11.086572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:11.092680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.093178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.093607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.105500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.106078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.106617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.276120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.295717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.298956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.301705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-13895928-3cd1-4e74-9f77-c386e0056399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1340 microversion: 2.20 time: 0.219498 Aug 31 00:21:11.302948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 43/95] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1340 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:11.370682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-00d274fe-480f-4f94-8bd4-b1c5e93af119 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:11.371549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-00d274fe-480f-4f94-8bd4-b1c5e93af119 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:11.385114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00d274fe-480f-4f94-8bd4-b1c5e93af119 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.387827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00d274fe-480f-4f94-8bd4-b1c5e93af119 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.388419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00d274fe-480f-4f94-8bd4-b1c5e93af119 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.390945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00d274fe-480f-4f94-8bd4-b1c5e93af119 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.391702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00d274fe-480f-4f94-8bd4-b1c5e93af119 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.393055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00d274fe-480f-4f94-8bd4-b1c5e93af119 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.434939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-68390257-0399-4407-923e-b3c928967dd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:11.438906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-68390257-0399-4407-923e-b3c928967dd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:11.450449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68390257-0399-4407-923e-b3c928967dd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.450939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68390257-0399-4407-923e-b3c928967dd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.452303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68390257-0399-4407-923e-b3c928967dd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.453010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68390257-0399-4407-923e-b3c928967dd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.453465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68390257-0399-4407-923e-b3c928967dd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.453890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68390257-0399-4407-923e-b3c928967dd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.090888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-00d274fe-480f-4f94-8bd4-b1c5e93af119 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.105271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-00d274fe-480f-4f94-8bd4-b1c5e93af119 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.739389 Aug 31 00:21:12.106342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-68390257-0399-4407-923e-b3c928967dd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.107838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 53/96] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:11 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:12.118783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-68390257-0399-4407-923e-b3c928967dd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.683723 Aug 31 00:21:12.123224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 44/97] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:11 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:12.135025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-3aa5b3ce-048c-41fa-9713-3f5f0772a2a4 req-6a36b007-fa0e-4d55-b666-6ea7884be467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7854a5f-0fae-40f3-a7d2-a2bdb829e851", "tag": "49190300-5cb3-462c-ba24-576656255826"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:12.140793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1b7e1bb2-fa75-427f-a028-dd9614607db3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:12.141406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1b7e1bb2-fa75-427f-a028-dd9614607db3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:12.148829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3aa5b3ce-048c-41fa-9713-3f5f0772a2a4 req-6a36b007-fa0e-4d55-b666-6ea7884be467 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.149710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3aa5b3ce-048c-41fa-9713-3f5f0772a2a4 req-6a36b007-fa0e-4d55-b666-6ea7884be467 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.150183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3aa5b3ce-048c-41fa-9713-3f5f0772a2a4 req-6a36b007-fa0e-4d55-b666-6ea7884be467 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.164212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b7e1bb2-fa75-427f-a028-dd9614607db3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.164980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b7e1bb2-fa75-427f-a028-dd9614607db3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.165496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b7e1bb2-fa75-427f-a028-dd9614607db3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.166285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b7e1bb2-fa75-427f-a028-dd9614607db3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.166722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-3aa5b3ce-048c-41fa-9713-3f5f0772a2a4 req-6a36b007-fa0e-4d55-b666-6ea7884be467 service nova] Creating event network-changed:49190300-5cb3-462c-ba24-576656255826 for instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 on hv-cinder-85506 Aug 31 00:21:12.166839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b7e1bb2-fa75-427f-a028-dd9614607db3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.167172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b7e1bb2-fa75-427f-a028-dd9614607db3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.173357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-3aa5b3ce-048c-41fa-9713-3f5f0772a2a4 req-6a36b007-fa0e-4d55-b666-6ea7884be467 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062508 Aug 31 00:21:12.174704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 54/98] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:12.329103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:12.330496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:12.342938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.343514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.343947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.344753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.345212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.345646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.389305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:12.502251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.519306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.520766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.521914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-044f3185-7e47-4841-bb9d-e905bd935cb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1340 microversion: 2.20 time: 0.200331 Aug 31 00:21:12.522485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 55/99] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:12.724901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1b7e1bb2-fa75-427f-a028-dd9614607db3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.736016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1b7e1bb2-fa75-427f-a028-dd9614607db3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.611379 Aug 31 00:21:12.743011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 45/100] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:12 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:13.086508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-27eab252-d74e-4f84-b4cb-a096534dab45 req-82a54edc-c9e6-491a-a9a2-f55b44c6838c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9b4929-5c16-4d39-a447-5ae948ff989e", "tag": "9363258d-4cf4-4748-ab99-6897c4cd2de3"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:13.101632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-27eab252-d74e-4f84-b4cb-a096534dab45 req-82a54edc-c9e6-491a-a9a2-f55b44c6838c service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.102297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-27eab252-d74e-4f84-b4cb-a096534dab45 req-82a54edc-c9e6-491a-a9a2-f55b44c6838c service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.102689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-27eab252-d74e-4f84-b4cb-a096534dab45 req-82a54edc-c9e6-491a-a9a2-f55b44c6838c service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.126994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-27eab252-d74e-4f84-b4cb-a096534dab45 req-82a54edc-c9e6-491a-a9a2-f55b44c6838c service nova] Creating event network-changed:9363258d-4cf4-4748-ab99-6897c4cd2de3 for instance ff9b4929-5c16-4d39-a447-5ae948ff989e on hv-cinder-85506 Aug 31 00:21:13.129088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b77dfbd4-c5ed-4067-9b56-098812a1a2ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:13.129565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b77dfbd4-c5ed-4067-9b56-098812a1a2ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:13.132893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-27eab252-d74e-4f84-b4cb-a096534dab45 req-82a54edc-c9e6-491a-a9a2-f55b44c6838c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164933 Aug 31 00:21:13.134007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 56/101] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:13.138685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b77dfbd4-c5ed-4067-9b56-098812a1a2ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.139502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b77dfbd4-c5ed-4067-9b56-098812a1a2ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.140198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b77dfbd4-c5ed-4067-9b56-098812a1a2ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.141126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b77dfbd4-c5ed-4067-9b56-098812a1a2ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.141767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b77dfbd4-c5ed-4067-9b56-098812a1a2ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.142208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b77dfbd4-c5ed-4067-9b56-098812a1a2ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.154298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-35640658-0c62-48db-b202-3d7db8533a95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:13.155019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-35640658-0c62-48db-b202-3d7db8533a95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:13.167080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35640658-0c62-48db-b202-3d7db8533a95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.167080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35640658-0c62-48db-b202-3d7db8533a95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.167453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35640658-0c62-48db-b202-3d7db8533a95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.168335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35640658-0c62-48db-b202-3d7db8533a95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.168939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35640658-0c62-48db-b202-3d7db8533a95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.169684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35640658-0c62-48db-b202-3d7db8533a95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.533976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-35640658-0c62-48db-b202-3d7db8533a95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.540072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b77dfbd4-c5ed-4067-9b56-098812a1a2ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.546926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-35640658-0c62-48db-b202-3d7db8533a95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.402658 Aug 31 00:21:13.548734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b77dfbd4-c5ed-4067-9b56-098812a1a2ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.423713 Aug 31 00:21:13.564179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 57/102] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:13 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:13.566702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 46/103] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:13 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:13.570841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:13.571734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:13.581120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.582594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.583523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.586154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.587976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.588567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.761820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-80b94e53-7f92-4de3-89c4-0d1689d15547 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:13.762556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-80b94e53-7f92-4de3-89c4-0d1689d15547 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:13.773605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80b94e53-7f92-4de3-89c4-0d1689d15547 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.775229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80b94e53-7f92-4de3-89c4-0d1689d15547 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.775920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80b94e53-7f92-4de3-89c4-0d1689d15547 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.776844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80b94e53-7f92-4de3-89c4-0d1689d15547 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.777739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80b94e53-7f92-4de3-89c4-0d1689d15547 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.778376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80b94e53-7f92-4de3-89c4-0d1689d15547 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.899500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.908671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.910499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.911758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2f0a19ae-bb2c-4c82-9974-014388b1e199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.346094 Aug 31 00:21:13.912552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 58/104] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:14.013302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-80b94e53-7f92-4de3-89c4-0d1689d15547 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:14.022436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-80b94e53-7f92-4de3-89c4-0d1689d15547 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.268108 Aug 31 00:21:14.034063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 47/105] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:13 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:14.577468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-88357a39-5f1d-4c17-aa0c-e8051d473a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:14.578226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-88357a39-5f1d-4c17-aa0c-e8051d473a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:14.578662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0ec9411b-3ed7-4f3b-840b-0ce0f2506dcd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:14.579871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0ec9411b-3ed7-4f3b-840b-0ce0f2506dcd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:14.593752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88357a39-5f1d-4c17-aa0c-e8051d473a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.598101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ec9411b-3ed7-4f3b-840b-0ce0f2506dcd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.603405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ec9411b-3ed7-4f3b-840b-0ce0f2506dcd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.604337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88357a39-5f1d-4c17-aa0c-e8051d473a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.604967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ec9411b-3ed7-4f3b-840b-0ce0f2506dcd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.605618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88357a39-5f1d-4c17-aa0c-e8051d473a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.606569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ec9411b-3ed7-4f3b-840b-0ce0f2506dcd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.607519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88357a39-5f1d-4c17-aa0c-e8051d473a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.608293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ec9411b-3ed7-4f3b-840b-0ce0f2506dcd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.608967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88357a39-5f1d-4c17-aa0c-e8051d473a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.609387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88357a39-5f1d-4c17-aa0c-e8051d473a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.614095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ec9411b-3ed7-4f3b-840b-0ce0f2506dcd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:15.339216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-88357a39-5f1d-4c17-aa0c-e8051d473a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:15.351296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-88357a39-5f1d-4c17-aa0c-e8051d473a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.784798 Aug 31 00:21:15.353197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 59/106] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:14 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:15.356922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0ec9411b-3ed7-4f3b-840b-0ce0f2506dcd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:15.363969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:15.364915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:15.372311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0ec9411b-3ed7-4f3b-840b-0ce0f2506dcd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.802346 Aug 31 00:21:15.374605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 48/107] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:14 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:15.381464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0720583c-abf8-4ccf-9132-25306c0a3985 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:15.394150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0720583c-abf8-4ccf-9132-25306c0a3985 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:15.402921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:15.405131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:15.405604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:15.408214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:15.408685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:15.409108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:15.420096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0720583c-abf8-4ccf-9132-25306c0a3985 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:15.424261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0720583c-abf8-4ccf-9132-25306c0a3985 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:15.425283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0720583c-abf8-4ccf-9132-25306c0a3985 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:15.426203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0720583c-abf8-4ccf-9132-25306c0a3985 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:15.426823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0720583c-abf8-4ccf-9132-25306c0a3985 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:15.427436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0720583c-abf8-4ccf-9132-25306c0a3985 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.043637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:16.067819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:16.068144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0720583c-abf8-4ccf-9132-25306c0a3985 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:16.069563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:16.071709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-61c802b7-bff4-4b6c-9bc9-596ada20089d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.717339 Aug 31 00:21:16.082236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 60/108] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:16.082436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0720583c-abf8-4ccf-9132-25306c0a3985 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.701297 Aug 31 00:21:16.082436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 49/109] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:15 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:16.156381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-97b7d53e-0892-4f96-96e7-5460b07e04ec req-7722abe1-bcd9-4e1f-a68a-2fb901020d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e4497e-f74f-4b4e-aac6-88c39ead5f38", "tag": "8dddb3be-7ff7-4bfa-aebb-406f077a2133"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:16.167305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-97b7d53e-0892-4f96-96e7-5460b07e04ec req-7722abe1-bcd9-4e1f-a68a-2fb901020d22 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.167785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-97b7d53e-0892-4f96-96e7-5460b07e04ec req-7722abe1-bcd9-4e1f-a68a-2fb901020d22 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.168213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-97b7d53e-0892-4f96-96e7-5460b07e04ec req-7722abe1-bcd9-4e1f-a68a-2fb901020d22 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.181719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-97b7d53e-0892-4f96-96e7-5460b07e04ec req-7722abe1-bcd9-4e1f-a68a-2fb901020d22 service nova] Creating event network-changed:8dddb3be-7ff7-4bfa-aebb-406f077a2133 for instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 on hv-cinder-85506 Aug 31 00:21:16.187537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-97b7d53e-0892-4f96-96e7-5460b07e04ec req-7722abe1-bcd9-4e1f-a68a-2fb901020d22 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036466 Aug 31 00:21:16.188673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 61/110] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:16.358667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-457489d7-8369-4af3-8f2a-37cdfd8f8ae0 req-3d5801bc-b28d-4f96-9a1f-42e33e8cec47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82098e98-ab74-415b-9d57-1e55a9524ce1", "tag": "46c132f8-c4f9-45c0-83ee-0c904d4196b0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:16.372672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-457489d7-8369-4af3-8f2a-37cdfd8f8ae0 req-3d5801bc-b28d-4f96-9a1f-42e33e8cec47 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.373435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-457489d7-8369-4af3-8f2a-37cdfd8f8ae0 req-3d5801bc-b28d-4f96-9a1f-42e33e8cec47 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.374077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-457489d7-8369-4af3-8f2a-37cdfd8f8ae0 req-3d5801bc-b28d-4f96-9a1f-42e33e8cec47 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.386257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0b6d13ba-70fb-4aca-a4da-95e46bf48179 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:16.387981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0b6d13ba-70fb-4aca-a4da-95e46bf48179 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:16.399052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-457489d7-8369-4af3-8f2a-37cdfd8f8ae0 req-3d5801bc-b28d-4f96-9a1f-42e33e8cec47 service nova] Creating event network-changed:46c132f8-c4f9-45c0-83ee-0c904d4196b0 for instance 82098e98-ab74-415b-9d57-1e55a9524ce1 on hv-cinder-85506 Aug 31 00:21:16.400045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-457489d7-8369-4af3-8f2a-37cdfd8f8ae0 req-3d5801bc-b28d-4f96-9a1f-42e33e8cec47 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126975) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 00:21:16.400700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-457489d7-8369-4af3-8f2a-37cdfd8f8ae0 req-3d5801bc-b28d-4f96-9a1f-42e33e8cec47 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126975) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 00:21:16.402013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33ffec17-ff32-49b3-b073-b9a9d76d198f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.402698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33ffec17-ff32-49b3-b073-b9a9d76d198f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.403445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33ffec17-ff32-49b3-b073-b9a9d76d198f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.405382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33ffec17-ff32-49b3-b073-b9a9d76d198f None None] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.406108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33ffec17-ff32-49b3-b073-b9a9d76d198f None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.406713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33ffec17-ff32-49b3-b073-b9a9d76d198f None None] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.409368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b6d13ba-70fb-4aca-a4da-95e46bf48179 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.410162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b6d13ba-70fb-4aca-a4da-95e46bf48179 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.410594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b6d13ba-70fb-4aca-a4da-95e46bf48179 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.415330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b6d13ba-70fb-4aca-a4da-95e46bf48179 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.416132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b6d13ba-70fb-4aca-a4da-95e46bf48179 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.417237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b6d13ba-70fb-4aca-a4da-95e46bf48179 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.418501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.compute.rpcapi [None req-33ffec17-ff32-49b3-b073-b9a9d76d198f None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 00:21:16.419643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33ffec17-ff32-49b3-b073-b9a9d76d198f None None] Releasing lock "compute-rpcapi-router" {{(pid=126975) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 00:21:16.454054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-33ffec17-ff32-49b3-b073-b9a9d76d198f None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096471 Aug 31 00:21:16.455351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 50/111] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:16.468145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf1c45dc-9ab0-408d-ab1a-6bafb12f7533 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:16.469147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf1c45dc-9ab0-408d-ab1a-6bafb12f7533 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:16.478477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c45dc-9ab0-408d-ab1a-6bafb12f7533 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.479484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c45dc-9ab0-408d-ab1a-6bafb12f7533 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.480123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c45dc-9ab0-408d-ab1a-6bafb12f7533 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.481028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c45dc-9ab0-408d-ab1a-6bafb12f7533 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:16.481730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c45dc-9ab0-408d-ab1a-6bafb12f7533 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:16.482429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c45dc-9ab0-408d-ab1a-6bafb12f7533 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:16.734996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0b6d13ba-70fb-4aca-a4da-95e46bf48179 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:16.744586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0b6d13ba-70fb-4aca-a4da-95e46bf48179 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.373869 Aug 31 00:21:16.747660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bf1c45dc-9ab0-408d-ab1a-6bafb12f7533 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:16.759684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 62/112] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:16 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:16.773277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf1c45dc-9ab0-408d-ab1a-6bafb12f7533 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.315639 Aug 31 00:21:16.787718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 51/113] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:16 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:17.095228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:17.096625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:17.103485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ec869690-6531-4a05-97c0-0e64b48b0836 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:17.104202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ec869690-6531-4a05-97c0-0e64b48b0836 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:17.104522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.105115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.105613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.106478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.106920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.107534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.110421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec869690-6531-4a05-97c0-0e64b48b0836 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.110904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec869690-6531-4a05-97c0-0e64b48b0836 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.113039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec869690-6531-4a05-97c0-0e64b48b0836 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.114092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec869690-6531-4a05-97c0-0e64b48b0836 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.114720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec869690-6531-4a05-97c0-0e64b48b0836 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.115412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec869690-6531-4a05-97c0-0e64b48b0836 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.137942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:17.350328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:17.359749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:17.361249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ec869690-6531-4a05-97c0-0e64b48b0836 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:17.361379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:17.362412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0f210059-4ee5-410b-9b90-abe6a51555b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.271116 Aug 31 00:21:17.363310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 63/114] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:17.371320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ec869690-6531-4a05-97c0-0e64b48b0836 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.273247 Aug 31 00:21:17.371999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 52/115] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:17 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:17.766234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1564c595-710d-43cf-a82e-7ad897d7551f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:17.766836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1564c595-710d-43cf-a82e-7ad897d7551f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:17.773889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1564c595-710d-43cf-a82e-7ad897d7551f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.774432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1564c595-710d-43cf-a82e-7ad897d7551f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.774796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1564c595-710d-43cf-a82e-7ad897d7551f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.775499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1564c595-710d-43cf-a82e-7ad897d7551f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.775932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1564c595-710d-43cf-a82e-7ad897d7551f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.776339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1564c595-710d-43cf-a82e-7ad897d7551f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.793846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6b68d42b-49b4-48e4-b056-fd87012d3b59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:17.798238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6b68d42b-49b4-48e4-b056-fd87012d3b59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:17.808262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b68d42b-49b4-48e4-b056-fd87012d3b59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.808755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b68d42b-49b4-48e4-b056-fd87012d3b59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.809184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b68d42b-49b4-48e4-b056-fd87012d3b59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.809877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b68d42b-49b4-48e4-b056-fd87012d3b59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:17.817686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b68d42b-49b4-48e4-b056-fd87012d3b59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:17.821094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b68d42b-49b4-48e4-b056-fd87012d3b59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:17.981534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1564c595-710d-43cf-a82e-7ad897d7551f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.003812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1564c595-710d-43cf-a82e-7ad897d7551f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.241379 Aug 31 00:21:18.005549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 64/116] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:17 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:18.019361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6b68d42b-49b4-48e4-b056-fd87012d3b59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.028272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6b68d42b-49b4-48e4-b056-fd87012d3b59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.238310 Aug 31 00:21:18.028859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 53/117] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:17 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:18.388249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:18.388249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:18.393341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-99846d7b-8bb4-4e74-857b-3709fdeec2ee tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:18.393936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-99846d7b-8bb4-4e74-857b-3709fdeec2ee tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:18.400857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99846d7b-8bb4-4e74-857b-3709fdeec2ee tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.401354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99846d7b-8bb4-4e74-857b-3709fdeec2ee tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.401912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99846d7b-8bb4-4e74-857b-3709fdeec2ee tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.402723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.403092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99846d7b-8bb4-4e74-857b-3709fdeec2ee tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.403248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.403563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99846d7b-8bb4-4e74-857b-3709fdeec2ee tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.404003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.404372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99846d7b-8bb4-4e74-857b-3709fdeec2ee tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.404682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.405119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.405694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.612675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-99846d7b-8bb4-4e74-857b-3709fdeec2ee tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.618021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.624336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-99846d7b-8bb4-4e74-857b-3709fdeec2ee tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.234841 Aug 31 00:21:18.624916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 54/118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:18 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:18.627087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.628802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.630164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3b882eff-affa-482d-8231-937eaf7c81f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.248049 Aug 31 00:21:18.630793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 65/119] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:19.028099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1d6641cc-48ed-4473-a87a-bec6e3dcbdd4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:19.028712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1d6641cc-48ed-4473-a87a-bec6e3dcbdd4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:19.036405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d6641cc-48ed-4473-a87a-bec6e3dcbdd4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.036899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d6641cc-48ed-4473-a87a-bec6e3dcbdd4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.037337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d6641cc-48ed-4473-a87a-bec6e3dcbdd4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.038043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d6641cc-48ed-4473-a87a-bec6e3dcbdd4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.038532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d6641cc-48ed-4473-a87a-bec6e3dcbdd4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.039029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d6641cc-48ed-4473-a87a-bec6e3dcbdd4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.051252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-961bc1df-5611-4d6a-8d9d-d9cfebff6b66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:19.051862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-961bc1df-5611-4d6a-8d9d-d9cfebff6b66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:19.067717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961bc1df-5611-4d6a-8d9d-d9cfebff6b66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.068209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961bc1df-5611-4d6a-8d9d-d9cfebff6b66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.068660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961bc1df-5611-4d6a-8d9d-d9cfebff6b66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.069353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961bc1df-5611-4d6a-8d9d-d9cfebff6b66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.070538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961bc1df-5611-4d6a-8d9d-d9cfebff6b66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.071144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961bc1df-5611-4d6a-8d9d-d9cfebff6b66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.603420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-961bc1df-5611-4d6a-8d9d-d9cfebff6b66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.620348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-961bc1df-5611-4d6a-8d9d-d9cfebff6b66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.573596 Aug 31 00:21:19.621258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 66/120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:19 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:19.645950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ac359b05-984b-4423-ba47-fef7c84558aa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:19.646897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ac359b05-984b-4423-ba47-fef7c84558aa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:19.653538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac359b05-984b-4423-ba47-fef7c84558aa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.653856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1d6641cc-48ed-4473-a87a-bec6e3dcbdd4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.654846 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac359b05-984b-4423-ba47-fef7c84558aa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.655564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac359b05-984b-4423-ba47-fef7c84558aa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.656503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac359b05-984b-4423-ba47-fef7c84558aa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.657138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac359b05-984b-4423-ba47-fef7c84558aa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.657731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac359b05-984b-4423-ba47-fef7c84558aa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.668922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1d6641cc-48ed-4473-a87a-bec6e3dcbdd4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.645588 Aug 31 00:21:19.670738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 55/121] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:19 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:19.703427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:19.704292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:19.711902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.712522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.712951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.713641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.714111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.714520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.122372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ac359b05-984b-4423-ba47-fef7c84558aa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.130613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ac359b05-984b-4423-ba47-fef7c84558aa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.488468 Aug 31 00:21:20.137137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.144802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 67/122] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:19 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:20.160527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.163056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.165699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-91a5b86d-4e62-4a2e-8a66-aa804a60ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.491768 Aug 31 00:21:20.166457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 56/123] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:20.239608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-0cd318be-a30e-49c0-9c98-767e477e67e9 req-2eeedb3a-9a3b-4b73-aa2f-41ee7f229911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2cfd30-5052-44b3-8237-9a4be97fc51e", "name": "network-vif-plugged", "status": "completed", "tag": "e37680ba-ffb5-455c-94ed-561aea176f93"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:20.250977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0cd318be-a30e-49c0-9c98-767e477e67e9 req-2eeedb3a-9a3b-4b73-aa2f-41ee7f229911 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.251500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0cd318be-a30e-49c0-9c98-767e477e67e9 req-2eeedb3a-9a3b-4b73-aa2f-41ee7f229911 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.252609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0cd318be-a30e-49c0-9c98-767e477e67e9 req-2eeedb3a-9a3b-4b73-aa2f-41ee7f229911 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.268131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-0cd318be-a30e-49c0-9c98-767e477e67e9 req-2eeedb3a-9a3b-4b73-aa2f-41ee7f229911 service nova] Creating event network-vif-plugged:e37680ba-ffb5-455c-94ed-561aea176f93 for instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e on hv-cinder-85506 Aug 31 00:21:20.277196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-0cd318be-a30e-49c0-9c98-767e477e67e9 req-2eeedb3a-9a3b-4b73-aa2f-41ee7f229911 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130782 Aug 31 00:21:20.279190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 68/124] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:20.641934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a4381189-e2e0-4d90-bbdc-65d3316219fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:20.642532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a4381189-e2e0-4d90-bbdc-65d3316219fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:20.648701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4381189-e2e0-4d90-bbdc-65d3316219fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.649196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4381189-e2e0-4d90-bbdc-65d3316219fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.649627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4381189-e2e0-4d90-bbdc-65d3316219fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.650319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4381189-e2e0-4d90-bbdc-65d3316219fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.651363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4381189-e2e0-4d90-bbdc-65d3316219fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.651976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4381189-e2e0-4d90-bbdc-65d3316219fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.699694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-48967d74-f76d-447a-b3be-7f176efa51a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:20.701112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-48967d74-f76d-447a-b3be-7f176efa51a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:20.711215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48967d74-f76d-447a-b3be-7f176efa51a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.711215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48967d74-f76d-447a-b3be-7f176efa51a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.711215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48967d74-f76d-447a-b3be-7f176efa51a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.711499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48967d74-f76d-447a-b3be-7f176efa51a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.712007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48967d74-f76d-447a-b3be-7f176efa51a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.712424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48967d74-f76d-447a-b3be-7f176efa51a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.859414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4381189-e2e0-4d90-bbdc-65d3316219fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.877240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a4381189-e2e0-4d90-bbdc-65d3316219fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.230485 Aug 31 00:21:20.892520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 57/125] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:20 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:20.922363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-48967d74-f76d-447a-b3be-7f176efa51a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.936702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-48967d74-f76d-447a-b3be-7f176efa51a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.243147 Aug 31 00:21:20.938346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 69/126] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:20 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:21.153329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-daf711d1-088e-4aed-872c-1bf01407f430 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:21.153938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-daf711d1-088e-4aed-872c-1bf01407f430 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:21.160449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-daf711d1-088e-4aed-872c-1bf01407f430 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.161176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-daf711d1-088e-4aed-872c-1bf01407f430 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.161766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-daf711d1-088e-4aed-872c-1bf01407f430 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.162452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-daf711d1-088e-4aed-872c-1bf01407f430 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.162899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-daf711d1-088e-4aed-872c-1bf01407f430 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.163347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-daf711d1-088e-4aed-872c-1bf01407f430 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.196364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:21.197695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:21.205917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.206994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.207919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.209072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.209851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.210286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.413219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-daf711d1-088e-4aed-872c-1bf01407f430 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:21.422057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-daf711d1-088e-4aed-872c-1bf01407f430 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.273140 Aug 31 00:21:21.422638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 58/127] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:21 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:21.447336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:21.461490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:21.463354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:21.464564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-57db4a65-977b-4ed8-b612-ecd4c5522ac0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.273602 Aug 31 00:21:21.465496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 70/128] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:21.903009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-58d937f6-6074-4dd5-8f4a-4a1b16eb7c49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:21.903643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-58d937f6-6074-4dd5-8f4a-4a1b16eb7c49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:21.910185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d937f6-6074-4dd5-8f4a-4a1b16eb7c49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.913233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d937f6-6074-4dd5-8f4a-4a1b16eb7c49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.914108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d937f6-6074-4dd5-8f4a-4a1b16eb7c49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.916729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d937f6-6074-4dd5-8f4a-4a1b16eb7c49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.917312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d937f6-6074-4dd5-8f4a-4a1b16eb7c49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.918881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d937f6-6074-4dd5-8f4a-4a1b16eb7c49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.958987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-caf2964f-f79e-4b69-9595-f104e14dd39f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:21.959674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-caf2964f-f79e-4b69-9595-f104e14dd39f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:21.979585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caf2964f-f79e-4b69-9595-f104e14dd39f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.980072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caf2964f-f79e-4b69-9595-f104e14dd39f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.980504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caf2964f-f79e-4b69-9595-f104e14dd39f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.981204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caf2964f-f79e-4b69-9595-f104e14dd39f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.981654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caf2964f-f79e-4b69-9595-f104e14dd39f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.982073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caf2964f-f79e-4b69-9595-f104e14dd39f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.182472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-58d937f6-6074-4dd5-8f4a-4a1b16eb7c49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.189359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-caf2964f-f79e-4b69-9595-f104e14dd39f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.200819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-58d937f6-6074-4dd5-8f4a-4a1b16eb7c49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.299608 Aug 31 00:21:22.200819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 59/129] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:21 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:22.208402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-caf2964f-f79e-4b69-9595-f104e14dd39f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.253248 Aug 31 00:21:22.209064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 71/130] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:21 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:22.443161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d3466574-3ca0-45ab-ac75-0cd4a8065757 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:22.444688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d3466574-3ca0-45ab-ac75-0cd4a8065757 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:22.452210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3466574-3ca0-45ab-ac75-0cd4a8065757 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.455602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3466574-3ca0-45ab-ac75-0cd4a8065757 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.456766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3466574-3ca0-45ab-ac75-0cd4a8065757 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.457786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3466574-3ca0-45ab-ac75-0cd4a8065757 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.458730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3466574-3ca0-45ab-ac75-0cd4a8065757 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.459389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3466574-3ca0-45ab-ac75-0cd4a8065757 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.489305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:22.490825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:22.501767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.502883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.503555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.505011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.506117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.507984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.713661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d3466574-3ca0-45ab-ac75-0cd4a8065757 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.722091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d3466574-3ca0-45ab-ac75-0cd4a8065757 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.282832 Aug 31 00:21:22.723212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 60/131] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:22 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:22.746447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.754985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.756455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.758385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6cd3c68b-de2c-4be7-b914-b6662d4117d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.275339 Aug 31 00:21:22.759271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 72/132] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:23.223446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1b2f893c-8717-45f2-bf61-00815efa2c6e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:23.224054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1b2f893c-8717-45f2-bf61-00815efa2c6e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:23.231075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2f893c-8717-45f2-bf61-00815efa2c6e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.231501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2f893c-8717-45f2-bf61-00815efa2c6e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.231929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2f893c-8717-45f2-bf61-00815efa2c6e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.232197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-efaa55d7-4a81-42d6-bf58-829ac9dbff72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:23.232642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2f893c-8717-45f2-bf61-00815efa2c6e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.232881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-efaa55d7-4a81-42d6-bf58-829ac9dbff72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:23.233050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2f893c-8717-45f2-bf61-00815efa2c6e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.233473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2f893c-8717-45f2-bf61-00815efa2c6e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.240994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efaa55d7-4a81-42d6-bf58-829ac9dbff72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.241827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efaa55d7-4a81-42d6-bf58-829ac9dbff72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.242336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efaa55d7-4a81-42d6-bf58-829ac9dbff72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.243106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efaa55d7-4a81-42d6-bf58-829ac9dbff72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.243621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efaa55d7-4a81-42d6-bf58-829ac9dbff72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.244106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efaa55d7-4a81-42d6-bf58-829ac9dbff72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.439498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1b2f893c-8717-45f2-bf61-00815efa2c6e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.442513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-efaa55d7-4a81-42d6-bf58-829ac9dbff72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.449304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1b2f893c-8717-45f2-bf61-00815efa2c6e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.230836 Aug 31 00:21:23.450318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 61/133] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:23 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:23.451148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-efaa55d7-4a81-42d6-bf58-829ac9dbff72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.223452 Aug 31 00:21:23.451875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 73/134] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:23 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:23.755423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3c977c11-ae15-426b-a0f6-df053f4d13da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:23.756198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3c977c11-ae15-426b-a0f6-df053f4d13da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:23.763633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c977c11-ae15-426b-a0f6-df053f4d13da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.764217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c977c11-ae15-426b-a0f6-df053f4d13da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.764713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c977c11-ae15-426b-a0f6-df053f4d13da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.765463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c977c11-ae15-426b-a0f6-df053f4d13da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.765938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c977c11-ae15-426b-a0f6-df053f4d13da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.766353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c977c11-ae15-426b-a0f6-df053f4d13da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.782076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:23.783182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:23.789746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.790493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.790660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.791448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.791910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.792327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.796898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:23.973200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3c977c11-ae15-426b-a0f6-df053f4d13da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.976629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3c977c11-ae15-426b-a0f6-df053f4d13da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.224581 Aug 31 00:21:23.981034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 62/135] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:23 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:23.986132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.998393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:24.001832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:24.001832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b2061bf4-32a7-4c02-a39a-c356b15579c9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.223101 Aug 31 00:21:24.001832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 74/136] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:24.470746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dcc54a00-3462-472d-bcff-4a8f82aad8e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:24.471393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dcc54a00-3462-472d-bcff-4a8f82aad8e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:24.473051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6a26faec-382b-485a-810b-8bc089f27bb7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:24.473655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6a26faec-382b-485a-810b-8bc089f27bb7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:24.478254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc54a00-3462-472d-bcff-4a8f82aad8e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:24.478732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc54a00-3462-472d-bcff-4a8f82aad8e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:24.479192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc54a00-3462-472d-bcff-4a8f82aad8e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:24.479879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc54a00-3462-472d-bcff-4a8f82aad8e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:24.480325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc54a00-3462-472d-bcff-4a8f82aad8e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:24.480738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc54a00-3462-472d-bcff-4a8f82aad8e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:24.481049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a26faec-382b-485a-810b-8bc089f27bb7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:24.481748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a26faec-382b-485a-810b-8bc089f27bb7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:24.482263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a26faec-382b-485a-810b-8bc089f27bb7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:24.483095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a26faec-382b-485a-810b-8bc089f27bb7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:24.483724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a26faec-382b-485a-810b-8bc089f27bb7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:24.484168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a26faec-382b-485a-810b-8bc089f27bb7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:24.734841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6a26faec-382b-485a-810b-8bc089f27bb7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:24.739484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dcc54a00-3462-472d-bcff-4a8f82aad8e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:24.752586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6a26faec-382b-485a-810b-8bc089f27bb7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.282984 Aug 31 00:21:24.753597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dcc54a00-3462-472d-bcff-4a8f82aad8e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.286430 Aug 31 00:21:24.753801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 75/137] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:24 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:24.754585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 63/138] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:24 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:25.001133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e4aaeac-6e25-49e2-bc70-b98b1eb2a2b6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:25.001729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7e4aaeac-6e25-49e2-bc70-b98b1eb2a2b6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:25.008470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4aaeac-6e25-49e2-bc70-b98b1eb2a2b6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.008957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4aaeac-6e25-49e2-bc70-b98b1eb2a2b6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.009383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4aaeac-6e25-49e2-bc70-b98b1eb2a2b6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.010099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4aaeac-6e25-49e2-bc70-b98b1eb2a2b6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.010543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4aaeac-6e25-49e2-bc70-b98b1eb2a2b6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.010958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4aaeac-6e25-49e2-bc70-b98b1eb2a2b6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.033372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:25.034413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:25.041282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.041760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.042358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.043146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.043771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.044339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.211587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7e4aaeac-6e25-49e2-bc70-b98b1eb2a2b6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:25.220337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7e4aaeac-6e25-49e2-bc70-b98b1eb2a2b6 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.223004 Aug 31 00:21:25.221740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 76/139] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:24 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:25.239201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:25.256144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:25.260674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:25.262539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-77380e01-38c1-4bf2-89f7-99f8bab32034 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.236269 Aug 31 00:21:25.264185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 64/140] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:25.774409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c469bf3d-2b3d-4d3e-b5b5-d9f2e8898992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:25.775184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c469bf3d-2b3d-4d3e-b5b5-d9f2e8898992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:25.776261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f17f7c37-ff54-4d59-9e5e-3d1854b156f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:25.776896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f17f7c37-ff54-4d59-9e5e-3d1854b156f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:25.781299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c469bf3d-2b3d-4d3e-b5b5-d9f2e8898992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.782146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c469bf3d-2b3d-4d3e-b5b5-d9f2e8898992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.782576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c469bf3d-2b3d-4d3e-b5b5-d9f2e8898992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.783282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c469bf3d-2b3d-4d3e-b5b5-d9f2e8898992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.783725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c469bf3d-2b3d-4d3e-b5b5-d9f2e8898992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.784177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c469bf3d-2b3d-4d3e-b5b5-d9f2e8898992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.784529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f17f7c37-ff54-4d59-9e5e-3d1854b156f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.785013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f17f7c37-ff54-4d59-9e5e-3d1854b156f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.785443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f17f7c37-ff54-4d59-9e5e-3d1854b156f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.786128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f17f7c37-ff54-4d59-9e5e-3d1854b156f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.786722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f17f7c37-ff54-4d59-9e5e-3d1854b156f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.786985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f17f7c37-ff54-4d59-9e5e-3d1854b156f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.021131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f17f7c37-ff54-4d59-9e5e-3d1854b156f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.023962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c469bf3d-2b3d-4d3e-b5b5-d9f2e8898992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.034981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c469bf3d-2b3d-4d3e-b5b5-d9f2e8898992 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.265003 Aug 31 00:21:26.035461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f17f7c37-ff54-4d59-9e5e-3d1854b156f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.262499 Aug 31 00:21:26.035939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 77/141] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:25 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:26.048310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 65/142] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:25 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:26.242518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a111edef-9368-4fef-9a17-3dfbace90a66 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:26.243238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a111edef-9368-4fef-9a17-3dfbace90a66 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:26.249205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a111edef-9368-4fef-9a17-3dfbace90a66 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.249744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a111edef-9368-4fef-9a17-3dfbace90a66 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.250229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a111edef-9368-4fef-9a17-3dfbace90a66 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.250962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a111edef-9368-4fef-9a17-3dfbace90a66 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.251501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a111edef-9368-4fef-9a17-3dfbace90a66 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.251916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a111edef-9368-4fef-9a17-3dfbace90a66 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.285887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:26.286571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:26.293833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.294312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.295251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.296351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.296807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.297258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.417308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:26.494225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a111edef-9368-4fef-9a17-3dfbace90a66 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.506427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a111edef-9368-4fef-9a17-3dfbace90a66 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.268073 Aug 31 00:21:26.508238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 78/143] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:26 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:26.524015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.532297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.533725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.535094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cda88a57-04fd-431e-a0dd-0e26b2d1bd4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.253251 Aug 31 00:21:26.535851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 66/144] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:27.060908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-438e4d18-4d30-4fbc-8d19-882bbfdf8a6b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:27.061446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f3593ab1-cef6-4b20-ba47-d98c524bdf3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:27.061827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f3593ab1-cef6-4b20-ba47-d98c524bdf3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:27.061920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-438e4d18-4d30-4fbc-8d19-882bbfdf8a6b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:27.067893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438e4d18-4d30-4fbc-8d19-882bbfdf8a6b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.068087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3593ab1-cef6-4b20-ba47-d98c524bdf3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.068512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438e4d18-4d30-4fbc-8d19-882bbfdf8a6b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.068624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3593ab1-cef6-4b20-ba47-d98c524bdf3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.069013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3593ab1-cef6-4b20-ba47-d98c524bdf3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.069148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438e4d18-4d30-4fbc-8d19-882bbfdf8a6b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.070024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3593ab1-cef6-4b20-ba47-d98c524bdf3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.070255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438e4d18-4d30-4fbc-8d19-882bbfdf8a6b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.070975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438e4d18-4d30-4fbc-8d19-882bbfdf8a6b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.071187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3593ab1-cef6-4b20-ba47-d98c524bdf3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.071285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438e4d18-4d30-4fbc-8d19-882bbfdf8a6b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.071384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3593ab1-cef6-4b20-ba47-d98c524bdf3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.329982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f3593ab1-cef6-4b20-ba47-d98c524bdf3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:27.339794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f3593ab1-cef6-4b20-ba47-d98c524bdf3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.282407 Aug 31 00:21:27.340451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-438e4d18-4d30-4fbc-8d19-882bbfdf8a6b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:27.340835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 67/145] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:27 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:27.355153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-438e4d18-4d30-4fbc-8d19-882bbfdf8a6b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.297838 Aug 31 00:21:27.355671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 79/146] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:27 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:27.528761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-491de286-846d-4d5b-87d0-2db5315ad3a4 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:27.529564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-491de286-846d-4d5b-87d0-2db5315ad3a4 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:27.535867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-491de286-846d-4d5b-87d0-2db5315ad3a4 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.536456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-491de286-846d-4d5b-87d0-2db5315ad3a4 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.536946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-491de286-846d-4d5b-87d0-2db5315ad3a4 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.537637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-491de286-846d-4d5b-87d0-2db5315ad3a4 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.538081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-491de286-846d-4d5b-87d0-2db5315ad3a4 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.538850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-491de286-846d-4d5b-87d0-2db5315ad3a4 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.559017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:27.559970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:27.566978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.567919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.569156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.571237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.571998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.572747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.760232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-491de286-846d-4d5b-87d0-2db5315ad3a4 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:27.766924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:27.771673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-491de286-846d-4d5b-87d0-2db5315ad3a4 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.246842 Aug 31 00:21:27.773532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 68/147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:27 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:27.775344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:27.777009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:27.778106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7078a7a6-6d8a-4be3-aaa9-7e9ca0f6b50b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.224320 Aug 31 00:21:27.778643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 80/148] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:28.361204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-37e7c474-b933-4b1b-9323-8553b3186297 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:28.361795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-37e7c474-b933-4b1b-9323-8553b3186297 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:28.368797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37e7c474-b933-4b1b-9323-8553b3186297 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.369348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37e7c474-b933-4b1b-9323-8553b3186297 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.369789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37e7c474-b933-4b1b-9323-8553b3186297 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.372199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37e7c474-b933-4b1b-9323-8553b3186297 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.372806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37e7c474-b933-4b1b-9323-8553b3186297 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.373552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37e7c474-b933-4b1b-9323-8553b3186297 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.376929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-74448014-0e6c-45fd-ace5-81394c623f6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:28.377538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-74448014-0e6c-45fd-ace5-81394c623f6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:28.377772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:28.385127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74448014-0e6c-45fd-ace5-81394c623f6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.386017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74448014-0e6c-45fd-ace5-81394c623f6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.386891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74448014-0e6c-45fd-ace5-81394c623f6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.387785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74448014-0e6c-45fd-ace5-81394c623f6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.389130 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74448014-0e6c-45fd-ace5-81394c623f6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.389890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74448014-0e6c-45fd-ace5-81394c623f6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.589610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-74448014-0e6c-45fd-ace5-81394c623f6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:28.593434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37e7c474-b933-4b1b-9323-8553b3186297 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:28.602725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-37e7c474-b933-4b1b-9323-8553b3186297 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.245207 Aug 31 00:21:28.616404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 69/149] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:28 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:28.616605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-74448014-0e6c-45fd-ace5-81394c623f6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.232429 Aug 31 00:21:28.616605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 81/150] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:28 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:28.794118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ef33b867-c10a-4e08-b2a3-386f23c1535c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:28.794879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ef33b867-c10a-4e08-b2a3-386f23c1535c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:28.801413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef33b867-c10a-4e08-b2a3-386f23c1535c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.801712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:28.802042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef33b867-c10a-4e08-b2a3-386f23c1535c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.802512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:28.802838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef33b867-c10a-4e08-b2a3-386f23c1535c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.803789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef33b867-c10a-4e08-b2a3-386f23c1535c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.804974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef33b867-c10a-4e08-b2a3-386f23c1535c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.805693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef33b867-c10a-4e08-b2a3-386f23c1535c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.809677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.810104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.810537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.812683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.813152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.813579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.022229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ef33b867-c10a-4e08-b2a3-386f23c1535c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.031276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ef33b867-c10a-4e08-b2a3-386f23c1535c tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.241385 Aug 31 00:21:29.032071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 70/151] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:28 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:29.044974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.053009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.054918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.056197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0ed75755-47ad-4413-92f0-c536ebcb69d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.258290 Aug 31 00:21:29.056809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 82/152] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:29.625082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-03249824-67ea-438a-999e-bec9632ef963 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:29.625641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-03249824-67ea-438a-999e-bec9632ef963 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:29.626816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fef8dc1e-c5c4-4265-bcbf-dd112f92b4ec tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:29.627469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fef8dc1e-c5c4-4265-bcbf-dd112f92b4ec tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:29.631503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03249824-67ea-438a-999e-bec9632ef963 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.631989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03249824-67ea-438a-999e-bec9632ef963 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.632420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03249824-67ea-438a-999e-bec9632ef963 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.633517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03249824-67ea-438a-999e-bec9632ef963 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.633631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fef8dc1e-c5c4-4265-bcbf-dd112f92b4ec tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.633711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03249824-67ea-438a-999e-bec9632ef963 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.634042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fef8dc1e-c5c4-4265-bcbf-dd112f92b4ec tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.634141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03249824-67ea-438a-999e-bec9632ef963 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.634468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fef8dc1e-c5c4-4265-bcbf-dd112f92b4ec tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.635183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fef8dc1e-c5c4-4265-bcbf-dd112f92b4ec tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.635631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fef8dc1e-c5c4-4265-bcbf-dd112f92b4ec tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.636048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fef8dc1e-c5c4-4265-bcbf-dd112f92b4ec tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.835095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-03249824-67ea-438a-999e-bec9632ef963 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.838500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fef8dc1e-c5c4-4265-bcbf-dd112f92b4ec tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.844936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-03249824-67ea-438a-999e-bec9632ef963 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.224105 Aug 31 00:21:29.845645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 71/153] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:29 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:29.846895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fef8dc1e-c5c4-4265-bcbf-dd112f92b4ec tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.224131 Aug 31 00:21:29.847487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 83/154] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:29 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:30.052745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3f46a443-4461-490d-848e-ca31105288d8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:30.053352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3f46a443-4461-490d-848e-ca31105288d8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:30.059324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f46a443-4461-490d-848e-ca31105288d8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.059926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f46a443-4461-490d-848e-ca31105288d8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.060360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f46a443-4461-490d-848e-ca31105288d8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.061042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f46a443-4461-490d-848e-ca31105288d8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.061571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f46a443-4461-490d-848e-ca31105288d8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.061904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f46a443-4461-490d-848e-ca31105288d8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.079110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:30.079712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:30.087080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.087799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.088435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.089706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.090240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.090736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.299813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:30.304122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3f46a443-4461-490d-848e-ca31105288d8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:30.308998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:30.310503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:30.311701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9a2d0e0e-1ac2-4d72-be03-4d43a620e5a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.236506 Aug 31 00:21:30.314020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3f46a443-4461-490d-848e-ca31105288d8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.265174 Aug 31 00:21:30.314798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 72/155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:30 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:30.328799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 84/156] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:30.334846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1306149837", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "networks": [{"uuid": "854828e6-33d4-4798-897d-8d0eac09d5f6"}]}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:30.392807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] validate_networks() for [('854828e6-33d4-4798-897d-8d0eac09d5f6', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:21:30.871248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4fca1129-8506-4cad-968e-cb203474f838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:30.871894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4fca1129-8506-4cad-968e-cb203474f838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:30.897805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fca1129-8506-4cad-968e-cb203474f838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.898544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fca1129-8506-4cad-968e-cb203474f838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.899255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fca1129-8506-4cad-968e-cb203474f838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.899999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fca1129-8506-4cad-968e-cb203474f838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.900451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fca1129-8506-4cad-968e-cb203474f838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.901245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fca1129-8506-4cad-968e-cb203474f838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.000172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:21:31.001126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:21:31.001775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:21:31.002994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:21:31.003576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:21:31.014967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.015631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.016206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.017096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.017705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.018448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.040967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Getting quotas for project d94c6a3ef756488eac765456d78ff335. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:21:31.045761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Getting quotas for user 95e5a1b739a54c3aa4dcb53e5bbe0452 and project d94c6a3ef756488eac765456d78ff335. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:21:31.068417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:21:31.072141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:21:31.121995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2fff35c7-bc85-46e6-bb82-e23f9741c3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791231 Aug 31 00:21:31.122880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 73/157] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:21:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:21:31.133450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c0c282c3-594b-4809-a809-d885a0fd66fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:31.134370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c0c282c3-594b-4809-a809-d885a0fd66fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:31.140791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:31.142721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0c282c3-594b-4809-a809-d885a0fd66fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.143390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0c282c3-594b-4809-a809-d885a0fd66fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.143962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0c282c3-594b-4809-a809-d885a0fd66fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.144991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0c282c3-594b-4809-a809-d885a0fd66fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.145608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0c282c3-594b-4809-a809-d885a0fd66fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.146085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0c282c3-594b-4809-a809-d885a0fd66fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.338308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4fca1129-8506-4cad-968e-cb203474f838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.348734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4fca1129-8506-4cad-968e-cb203474f838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.483984 Aug 31 00:21:31.352285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 85/158] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:30 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:31.370754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dc03f708-1e42-4e63-b4a9-5d820e87df0b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:31.371470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dc03f708-1e42-4e63-b4a9-5d820e87df0b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:31.423013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c0c282c3-594b-4809-a809-d885a0fd66fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.453690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c0c282c3-594b-4809-a809-d885a0fd66fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.324055 Aug 31 00:21:31.454517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 74/159] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:31 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:31.466576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:31.467235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:31.482016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.482753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.483367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.488537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.489036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.489468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.514206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dc03f708-1e42-4e63-b4a9-5d820e87df0b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.537713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dc03f708-1e42-4e63-b4a9-5d820e87df0b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1214 microversion: 2.1 time: 0.184085 Aug 31 00:21:31.552146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 86/160] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:31 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:31.558793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2a7ddd30-025c-4b08-b309-c03fc061b4c8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:31.559769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2a7ddd30-025c-4b08-b309-c03fc061b4c8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:31.567957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a7ddd30-025c-4b08-b309-c03fc061b4c8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.568980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a7ddd30-025c-4b08-b309-c03fc061b4c8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.570021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a7ddd30-025c-4b08-b309-c03fc061b4c8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.571156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a7ddd30-025c-4b08-b309-c03fc061b4c8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.571820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a7ddd30-025c-4b08-b309-c03fc061b4c8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.572504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a7ddd30-025c-4b08-b309-c03fc061b4c8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.848249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.858310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.865555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2a7ddd30-025c-4b08-b309-c03fc061b4c8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.871139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.875796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2a7ddd30-025c-4b08-b309-c03fc061b4c8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.322169 Aug 31 00:21:31.878781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a2dada1f-4b9f-4573-b29d-a89d31fe6da9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.422573 Aug 31 00:21:31.883468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 87/161] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:31 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:31.902155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 75/162] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:31.902281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-2812b2f1-b16d-42e2-ad9b-9c4036106271 req-1d195e31-653b-4431-8417-871f7503f803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7854a5f-0fae-40f3-a7d2-a2bdb829e851", "name": "network-vif-plugged", "status": "completed", "tag": "49190300-5cb3-462c-ba24-576656255826"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:31.902281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-2812b2f1-b16d-42e2-ad9b-9c4036106271 req-1d195e31-653b-4431-8417-871f7503f803 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.902455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-2812b2f1-b16d-42e2-ad9b-9c4036106271 req-1d195e31-653b-4431-8417-871f7503f803 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.902849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-2812b2f1-b16d-42e2-ad9b-9c4036106271 req-1d195e31-653b-4431-8417-871f7503f803 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.914856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-2812b2f1-b16d-42e2-ad9b-9c4036106271 req-1d195e31-653b-4431-8417-871f7503f803 service nova] Creating event network-vif-plugged:49190300-5cb3-462c-ba24-576656255826 for instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 on hv-cinder-85506 Aug 31 00:21:31.920962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-2812b2f1-b16d-42e2-ad9b-9c4036106271 req-1d195e31-653b-4431-8417-871f7503f803 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035844 Aug 31 00:21:31.922240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 88/163] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:32.373324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-42e575c1-f669-4b75-8133-4608c044e12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:32.373918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-42e575c1-f669-4b75-8133-4608c044e12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:32.379998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42e575c1-f669-4b75-8133-4608c044e12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.380559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42e575c1-f669-4b75-8133-4608c044e12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.380908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42e575c1-f669-4b75-8133-4608c044e12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.381588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42e575c1-f669-4b75-8133-4608c044e12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.382037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42e575c1-f669-4b75-8133-4608c044e12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.382579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42e575c1-f669-4b75-8133-4608c044e12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.483784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d93dd2bf-bac1-46db-8de6-729aa4373a60 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:32.484502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d93dd2bf-bac1-46db-8de6-729aa4373a60 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:32.502151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d93dd2bf-bac1-46db-8de6-729aa4373a60 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.503871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d93dd2bf-bac1-46db-8de6-729aa4373a60 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.505093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d93dd2bf-bac1-46db-8de6-729aa4373a60 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.505093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d93dd2bf-bac1-46db-8de6-729aa4373a60 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.506195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d93dd2bf-bac1-46db-8de6-729aa4373a60 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.506685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d93dd2bf-bac1-46db-8de6-729aa4373a60 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.553581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42e575c1-f669-4b75-8133-4608c044e12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:32.563493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-42e575c1-f669-4b75-8133-4608c044e12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.193944 Aug 31 00:21:32.564889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 76/164] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:32 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:32.582995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0e65e1f2-4b01-4d46-a8e1-186ac1639904 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:32.584213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0e65e1f2-4b01-4d46-a8e1-186ac1639904 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:32.600835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e65e1f2-4b01-4d46-a8e1-186ac1639904 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.602439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e65e1f2-4b01-4d46-a8e1-186ac1639904 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.603679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e65e1f2-4b01-4d46-a8e1-186ac1639904 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.604929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e65e1f2-4b01-4d46-a8e1-186ac1639904 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.606182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e65e1f2-4b01-4d46-a8e1-186ac1639904 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.606927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e65e1f2-4b01-4d46-a8e1-186ac1639904 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.678948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0e65e1f2-4b01-4d46-a8e1-186ac1639904 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:32.688439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0e65e1f2-4b01-4d46-a8e1-186ac1639904 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1218 microversion: 2.1 time: 0.122050 Aug 31 00:21:32.689616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 77/165] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:32 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:32.706402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d93dd2bf-bac1-46db-8de6-729aa4373a60 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:32.715500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d93dd2bf-bac1-46db-8de6-729aa4373a60 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.236688 Aug 31 00:21:32.716078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 89/166] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:32 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:32.905507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf2b2fa8-22de-4cdd-90c5-c4fa22795b7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:32.906115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf2b2fa8-22de-4cdd-90c5-c4fa22795b7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:32.912356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b2fa8-22de-4cdd-90c5-c4fa22795b7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.912840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b2fa8-22de-4cdd-90c5-c4fa22795b7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.913302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b2fa8-22de-4cdd-90c5-c4fa22795b7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.914102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b2fa8-22de-4cdd-90c5-c4fa22795b7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.914557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b2fa8-22de-4cdd-90c5-c4fa22795b7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.914970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b2fa8-22de-4cdd-90c5-c4fa22795b7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.917142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:32.921633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:32.939741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.939741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.939741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.940237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.940594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.941055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.150086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bf2b2fa8-22de-4cdd-90c5-c4fa22795b7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:33.155009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:33.157982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf2b2fa8-22de-4cdd-90c5-c4fa22795b7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.256265 Aug 31 00:21:33.158553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 78/167] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:32 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:33.186682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:33.194491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:33.196747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-99e1319b-deaa-4c55-a1cb-0572b5dcdae6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.284689 Aug 31 00:21:33.197426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 90/168] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:33.584837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-81ccee3f-434b-4acf-95c6-a0b59d7f4f8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:33.585416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-81ccee3f-434b-4acf-95c6-a0b59d7f4f8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:33.591363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81ccee3f-434b-4acf-95c6-a0b59d7f4f8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.591835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81ccee3f-434b-4acf-95c6-a0b59d7f4f8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.592255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81ccee3f-434b-4acf-95c6-a0b59d7f4f8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.592922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81ccee3f-434b-4acf-95c6-a0b59d7f4f8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.593367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81ccee3f-434b-4acf-95c6-a0b59d7f4f8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.593777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81ccee3f-434b-4acf-95c6-a0b59d7f4f8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.709852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f62d81c8-e0da-4c7e-89a5-1ea183ba5434 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:33.712180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f62d81c8-e0da-4c7e-89a5-1ea183ba5434 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:33.718604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62d81c8-e0da-4c7e-89a5-1ea183ba5434 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.719123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62d81c8-e0da-4c7e-89a5-1ea183ba5434 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.719737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62d81c8-e0da-4c7e-89a5-1ea183ba5434 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.720715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62d81c8-e0da-4c7e-89a5-1ea183ba5434 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.721161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62d81c8-e0da-4c7e-89a5-1ea183ba5434 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.721811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f62d81c8-e0da-4c7e-89a5-1ea183ba5434 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.734825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-81ccee3f-434b-4acf-95c6-a0b59d7f4f8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:33.751244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-81ccee3f-434b-4acf-95c6-a0b59d7f4f8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.170102 Aug 31 00:21:33.752005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 79/169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:33 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:33.756492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1211eac0-94e7-436b-980a-9f394f5b5e88 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:33.757234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1211eac0-94e7-436b-980a-9f394f5b5e88 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:33.769979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1211eac0-94e7-436b-980a-9f394f5b5e88 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.770651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1211eac0-94e7-436b-980a-9f394f5b5e88 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.771200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1211eac0-94e7-436b-980a-9f394f5b5e88 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.772139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1211eac0-94e7-436b-980a-9f394f5b5e88 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.772729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1211eac0-94e7-436b-980a-9f394f5b5e88 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.773888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1211eac0-94e7-436b-980a-9f394f5b5e88 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.809355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f62d81c8-e0da-4c7e-89a5-1ea183ba5434 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:33.817701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f62d81c8-e0da-4c7e-89a5-1ea183ba5434 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1218 microversion: 2.1 time: 0.111577 Aug 31 00:21:33.818273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 91/170] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:33 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:33.916749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1211eac0-94e7-436b-980a-9f394f5b5e88 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:33.924513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1211eac0-94e7-436b-980a-9f394f5b5e88 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.171431 Aug 31 00:21:33.925081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 80/171] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:33 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:33.936841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-ad918331-6906-4e6c-b09f-e05f4acf797f req-db8ebe8f-f4f9-46de-a57e-2b91293b8c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9b4929-5c16-4d39-a447-5ae948ff989e", "name": "network-vif-plugged", "status": "completed", "tag": "9363258d-4cf4-4748-ab99-6897c4cd2de3"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:33.942848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:33.947487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ad918331-6906-4e6c-b09f-e05f4acf797f req-db8ebe8f-f4f9-46de-a57e-2b91293b8c23 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.947959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ad918331-6906-4e6c-b09f-e05f4acf797f req-db8ebe8f-f4f9-46de-a57e-2b91293b8c23 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.948381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ad918331-6906-4e6c-b09f-e05f4acf797f req-db8ebe8f-f4f9-46de-a57e-2b91293b8c23 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.959264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-ad918331-6906-4e6c-b09f-e05f4acf797f req-db8ebe8f-f4f9-46de-a57e-2b91293b8c23 service nova] Creating event network-vif-plugged:9363258d-4cf4-4748-ab99-6897c4cd2de3 for instance ff9b4929-5c16-4d39-a447-5ae948ff989e on hv-cinder-85506 Aug 31 00:21:33.964655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-ad918331-6906-4e6c-b09f-e05f4acf797f req-db8ebe8f-f4f9-46de-a57e-2b91293b8c23 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031446 Aug 31 00:21:33.965251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 92/172] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:34.182047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-52fa5175-6bf9-4925-83ff-9131e799d9ac tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.182756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-52fa5175-6bf9-4925-83ff-9131e799d9ac tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.189175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52fa5175-6bf9-4925-83ff-9131e799d9ac tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.190015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52fa5175-6bf9-4925-83ff-9131e799d9ac tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.190692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52fa5175-6bf9-4925-83ff-9131e799d9ac tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52fa5175-6bf9-4925-83ff-9131e799d9ac tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.192209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52fa5175-6bf9-4925-83ff-9131e799d9ac tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.192720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52fa5175-6bf9-4925-83ff-9131e799d9ac tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.221168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.222690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.238681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.239804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.241673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.244093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.246020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.248087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.262017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:34.528784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-52fa5175-6bf9-4925-83ff-9131e799d9ac tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.537341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-52fa5175-6bf9-4925-83ff-9131e799d9ac tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.359315 Aug 31 00:21:34.538066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 81/173] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:34 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:34.541044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.549087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.550516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.551636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f0b22781-0aa0-44f3-ae8a-b37f76487a86 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.335492 Aug 31 00:21:34.552184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 93/174] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:34.771765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5f87c296-5be5-48ea-87c5-a5f8ec3fdadc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.772709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5f87c296-5be5-48ea-87c5-a5f8ec3fdadc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.778855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f87c296-5be5-48ea-87c5-a5f8ec3fdadc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.779199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f87c296-5be5-48ea-87c5-a5f8ec3fdadc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.779635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f87c296-5be5-48ea-87c5-a5f8ec3fdadc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.780331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f87c296-5be5-48ea-87c5-a5f8ec3fdadc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.780918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f87c296-5be5-48ea-87c5-a5f8ec3fdadc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.781247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f87c296-5be5-48ea-87c5-a5f8ec3fdadc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.839331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f5ce641f-c8a8-4d3d-b6f4-e8493fe4c486 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.840103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f5ce641f-c8a8-4d3d-b6f4-e8493fe4c486 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.845995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ce641f-c8a8-4d3d-b6f4-e8493fe4c486 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.846453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ce641f-c8a8-4d3d-b6f4-e8493fe4c486 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.846894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ce641f-c8a8-4d3d-b6f4-e8493fe4c486 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.847586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ce641f-c8a8-4d3d-b6f4-e8493fe4c486 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.848031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ce641f-c8a8-4d3d-b6f4-e8493fe4c486 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.848446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ce641f-c8a8-4d3d-b6f4-e8493fe4c486 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.919575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f5ce641f-c8a8-4d3d-b6f4-e8493fe4c486 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.926976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f5ce641f-c8a8-4d3d-b6f4-e8493fe4c486 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.091605 Aug 31 00:21:34.927580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 94/175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:34 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:34.941831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f87c296-5be5-48ea-87c5-a5f8ec3fdadc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.945501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-279832f1-26fd-480d-8a90-26a77bf68e6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.946099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-279832f1-26fd-480d-8a90-26a77bf68e6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.950148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5f87c296-5be5-48ea-87c5-a5f8ec3fdadc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.182188 Aug 31 00:21:34.950706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 82/176] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:34 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:34.952088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-279832f1-26fd-480d-8a90-26a77bf68e6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.952591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-279832f1-26fd-480d-8a90-26a77bf68e6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.953026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-279832f1-26fd-480d-8a90-26a77bf68e6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.953740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-279832f1-26fd-480d-8a90-26a77bf68e6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.954187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-279832f1-26fd-480d-8a90-26a77bf68e6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.954603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-279832f1-26fd-480d-8a90-26a77bf68e6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.091393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-279832f1-26fd-480d-8a90-26a77bf68e6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.099107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-279832f1-26fd-480d-8a90-26a77bf68e6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.157419 Aug 31 00:21:35.099669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 95/177] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:35.559191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4993dc5-726e-4482-be8c-15281764e868 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:35.559798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4993dc5-726e-4482-be8c-15281764e868 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:35.565706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4993dc5-726e-4482-be8c-15281764e868 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.566186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4993dc5-726e-4482-be8c-15281764e868 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.566615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4993dc5-726e-4482-be8c-15281764e868 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.567423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4993dc5-726e-4482-be8c-15281764e868 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.567872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4993dc5-726e-4482-be8c-15281764e868 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.568291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4993dc5-726e-4482-be8c-15281764e868 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.575806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:35.576408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:35.582420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.582898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.583366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.584083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.584560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.584953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.759221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f4993dc5-726e-4482-be8c-15281764e868 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.766234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.767504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4993dc5-726e-4482-be8c-15281764e868 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.212293 Aug 31 00:21:35.768121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 83/178] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:35 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:35.774840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.776306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.777401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f04db913-ebfb-4f0f-8a81-1382b50a84e6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.205402 Aug 31 00:21:35.777935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 96/179] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:35.950428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a9899459-eb9b-485d-888e-81e51edf4738 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:35.951030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a9899459-eb9b-485d-888e-81e51edf4738 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:35.956968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9899459-eb9b-485d-888e-81e51edf4738 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.957438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9899459-eb9b-485d-888e-81e51edf4738 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.957862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9899459-eb9b-485d-888e-81e51edf4738 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.958532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9899459-eb9b-485d-888e-81e51edf4738 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.958976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9899459-eb9b-485d-888e-81e51edf4738 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.959420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9899459-eb9b-485d-888e-81e51edf4738 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.970670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e82fe8b2-5105-4459-b1a7-dc695ed8de28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:35.971425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e82fe8b2-5105-4459-b1a7-dc695ed8de28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:35.977659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82fe8b2-5105-4459-b1a7-dc695ed8de28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.978207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82fe8b2-5105-4459-b1a7-dc695ed8de28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.978631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82fe8b2-5105-4459-b1a7-dc695ed8de28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.979343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82fe8b2-5105-4459-b1a7-dc695ed8de28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.979782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82fe8b2-5105-4459-b1a7-dc695ed8de28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.980190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82fe8b2-5105-4459-b1a7-dc695ed8de28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.027760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a9899459-eb9b-485d-888e-81e51edf4738 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:36.035294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a9899459-eb9b-485d-888e-81e51edf4738 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.088878 Aug 31 00:21:36.035861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 84/180] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:35 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:36.121859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c6e011c0-7dea-486e-8b89-d4d10a6a0bcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:36.122462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c6e011c0-7dea-486e-8b89-d4d10a6a0bcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:36.122883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e82fe8b2-5105-4459-b1a7-dc695ed8de28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:36.128530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6e011c0-7dea-486e-8b89-d4d10a6a0bcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.129017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6e011c0-7dea-486e-8b89-d4d10a6a0bcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.129445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6e011c0-7dea-486e-8b89-d4d10a6a0bcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.130125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6e011c0-7dea-486e-8b89-d4d10a6a0bcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.130503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e82fe8b2-5105-4459-b1a7-dc695ed8de28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.163593 Aug 31 00:21:36.130597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6e011c0-7dea-486e-8b89-d4d10a6a0bcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.130972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6e011c0-7dea-486e-8b89-d4d10a6a0bcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.131113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 97/181] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:35 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:36.257593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c6e011c0-7dea-486e-8b89-d4d10a6a0bcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:36.265598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c6e011c0-7dea-486e-8b89-d4d10a6a0bcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.148502 Aug 31 00:21:36.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 85/182] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:36 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:36.789927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4a6c2761-c9be-4c43-998c-036109ad645b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:36.790438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4a6c2761-c9be-4c43-998c-036109ad645b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:36.796668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6c2761-c9be-4c43-998c-036109ad645b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.797144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6c2761-c9be-4c43-998c-036109ad645b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.797567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6c2761-c9be-4c43-998c-036109ad645b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.798237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6c2761-c9be-4c43-998c-036109ad645b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.798682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6c2761-c9be-4c43-998c-036109ad645b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.799115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6c2761-c9be-4c43-998c-036109ad645b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.800019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:36.800622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:36.807623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.808108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.808563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.809250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.809706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.810125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.828691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:36.999948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4a6c2761-c9be-4c43-998c-036109ad645b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:37.004859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:37.008776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4a6c2761-c9be-4c43-998c-036109ad645b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.222642 Aug 31 00:21:37.009698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 98/183] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:36 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:37.020451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:37.022015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:37.022993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-14c2d7bc-1bde-43c9-9c01-af0a7b9482a1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.227238 Aug 31 00:21:37.024172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 86/184] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:37.055702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cb6a68d9-969d-4dc4-bed7-efaa3bda0f2c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:37.056256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cb6a68d9-969d-4dc4-bed7-efaa3bda0f2c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:37.063519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb6a68d9-969d-4dc4-bed7-efaa3bda0f2c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.063994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb6a68d9-969d-4dc4-bed7-efaa3bda0f2c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.064426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb6a68d9-969d-4dc4-bed7-efaa3bda0f2c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.065101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb6a68d9-969d-4dc4-bed7-efaa3bda0f2c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.065544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb6a68d9-969d-4dc4-bed7-efaa3bda0f2c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.065952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb6a68d9-969d-4dc4-bed7-efaa3bda0f2c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.135701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cb6a68d9-969d-4dc4-bed7-efaa3bda0f2c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:37.143633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cb6a68d9-969d-4dc4-bed7-efaa3bda0f2c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.092022 Aug 31 00:21:37.144191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 99/185] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:37 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:37.151489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-88a4d0c9-8873-4182-ac8e-cba79d5b7f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:37.152189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-88a4d0c9-8873-4182-ac8e-cba79d5b7f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:37.158141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a4d0c9-8873-4182-ac8e-cba79d5b7f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.158616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a4d0c9-8873-4182-ac8e-cba79d5b7f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.159070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a4d0c9-8873-4182-ac8e-cba79d5b7f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.159748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a4d0c9-8873-4182-ac8e-cba79d5b7f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.160218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a4d0c9-8873-4182-ac8e-cba79d5b7f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.160654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a4d0c9-8873-4182-ac8e-cba79d5b7f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.285887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-efd79824-ccd3-4cf8-92af-aa9aa99438c6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:37.286485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-efd79824-ccd3-4cf8-92af-aa9aa99438c6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:37.286607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-88a4d0c9-8873-4182-ac8e-cba79d5b7f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:37.292711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efd79824-ccd3-4cf8-92af-aa9aa99438c6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.293188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efd79824-ccd3-4cf8-92af-aa9aa99438c6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.293636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efd79824-ccd3-4cf8-92af-aa9aa99438c6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.294149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-88a4d0c9-8873-4182-ac8e-cba79d5b7f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.147077 Aug 31 00:21:37.294312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efd79824-ccd3-4cf8-92af-aa9aa99438c6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.294703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 87/186] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:37 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:37.294832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efd79824-ccd3-4cf8-92af-aa9aa99438c6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.295170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efd79824-ccd3-4cf8-92af-aa9aa99438c6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.423796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-efd79824-ccd3-4cf8-92af-aa9aa99438c6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:37.432420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-efd79824-ccd3-4cf8-92af-aa9aa99438c6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.150546 Aug 31 00:21:37.432987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 100/187] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:37 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:38.030164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1a2cf253-313c-412d-b2ce-bec8c0df42fa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:38.030765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1a2cf253-313c-412d-b2ce-bec8c0df42fa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:38.036721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a2cf253-313c-412d-b2ce-bec8c0df42fa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.037198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a2cf253-313c-412d-b2ce-bec8c0df42fa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.037693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a2cf253-313c-412d-b2ce-bec8c0df42fa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.038357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a2cf253-313c-412d-b2ce-bec8c0df42fa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.039470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a2cf253-313c-412d-b2ce-bec8c0df42fa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.039878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a2cf253-313c-412d-b2ce-bec8c0df42fa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.045787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:38.046390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:38.052194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.052670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.053314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.053992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.054522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.055427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.242748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1a2cf253-313c-412d-b2ce-bec8c0df42fa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.246574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.250998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1a2cf253-313c-412d-b2ce-bec8c0df42fa tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.224570 Aug 31 00:21:38.251532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 88/188] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:38 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:38.254589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.255909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ba0f6ae9-f413-4af7-94fc-9ee4c3dbf1f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:38.256017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.256500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ba0f6ae9-f413-4af7-94fc-9ee4c3dbf1f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:38.257098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a548ce04-5a58-429c-8bea-fc5547f04294 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.215175 Aug 31 00:21:38.257724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 101/189] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:38.262656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba0f6ae9-f413-4af7-94fc-9ee4c3dbf1f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.263157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba0f6ae9-f413-4af7-94fc-9ee4c3dbf1f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.263585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba0f6ae9-f413-4af7-94fc-9ee4c3dbf1f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.264262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba0f6ae9-f413-4af7-94fc-9ee4c3dbf1f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.264706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba0f6ae9-f413-4af7-94fc-9ee4c3dbf1f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.265122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba0f6ae9-f413-4af7-94fc-9ee4c3dbf1f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.314947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9c6e874a-d7be-48ae-938f-522834ed9491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:38.315565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9c6e874a-d7be-48ae-938f-522834ed9491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:38.321970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c6e874a-d7be-48ae-938f-522834ed9491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.322444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c6e874a-d7be-48ae-938f-522834ed9491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.322867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c6e874a-d7be-48ae-938f-522834ed9491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.323656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c6e874a-d7be-48ae-938f-522834ed9491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.324097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c6e874a-d7be-48ae-938f-522834ed9491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.324510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c6e874a-d7be-48ae-938f-522834ed9491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.329813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ba0f6ae9-f413-4af7-94fc-9ee4c3dbf1f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.338079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ba0f6ae9-f413-4af7-94fc-9ee4c3dbf1f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.085592 Aug 31 00:21:38.338646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 89/190] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:38 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:38.454399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8c8b091c-b12e-4e46-bfb6-567f2b743da4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:38.454999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8c8b091c-b12e-4e46-bfb6-567f2b743da4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:38.455504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9c6e874a-d7be-48ae-938f-522834ed9491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.462295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c8b091c-b12e-4e46-bfb6-567f2b743da4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.462823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c8b091c-b12e-4e46-bfb6-567f2b743da4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.463282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c8b091c-b12e-4e46-bfb6-567f2b743da4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.463956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c8b091c-b12e-4e46-bfb6-567f2b743da4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.464395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c8b091c-b12e-4e46-bfb6-567f2b743da4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.464490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9c6e874a-d7be-48ae-938f-522834ed9491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.153257 Aug 31 00:21:38.464803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c8b091c-b12e-4e46-bfb6-567f2b743da4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.465313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 102/191] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:38 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:38.594288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8c8b091c-b12e-4e46-bfb6-567f2b743da4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.602039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8c8b091c-b12e-4e46-bfb6-567f2b743da4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.151776 Aug 31 00:21:38.602602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 90/192] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:38 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:39.272674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-02c4ce00-fab4-43d9-8b34-8cbcdf4eaca0 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:39.273269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-02c4ce00-fab4-43d9-8b34-8cbcdf4eaca0 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:39.279337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02c4ce00-fab4-43d9-8b34-8cbcdf4eaca0 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.279817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02c4ce00-fab4-43d9-8b34-8cbcdf4eaca0 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.280240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02c4ce00-fab4-43d9-8b34-8cbcdf4eaca0 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.280338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:39.280869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:39.280962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02c4ce00-fab4-43d9-8b34-8cbcdf4eaca0 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.281343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02c4ce00-fab4-43d9-8b34-8cbcdf4eaca0 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.281756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02c4ce00-fab4-43d9-8b34-8cbcdf4eaca0 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.286981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.287498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.287928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.288600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.289586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.290001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.480358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-02c4ce00-fab4-43d9-8b34-8cbcdf4eaca0 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.488315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-02c4ce00-fab4-43d9-8b34-8cbcdf4eaca0 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.219466 Aug 31 00:21:39.488887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 103/193] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:39 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:39.489476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.494207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f095b06f-5ecd-4753-82f6-002b2212b889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:39.494806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f095b06f-5ecd-4753-82f6-002b2212b889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:39.499487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.500698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f095b06f-5ecd-4753-82f6-002b2212b889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.501176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f095b06f-5ecd-4753-82f6-002b2212b889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.501737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.501855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f095b06f-5ecd-4753-82f6-002b2212b889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.502452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f095b06f-5ecd-4753-82f6-002b2212b889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.502899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f095b06f-5ecd-4753-82f6-002b2212b889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.502997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-875e7306-ece2-4da2-879d-33120569027b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.226552 Aug 31 00:21:39.503338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f095b06f-5ecd-4753-82f6-002b2212b889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.503611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 91/194] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:39.509304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5fc7e577-facd-4e30-b943-14c0a9b12fb8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:39.510175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5fc7e577-facd-4e30-b943-14c0a9b12fb8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:39.516780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fc7e577-facd-4e30-b943-14c0a9b12fb8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.517264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fc7e577-facd-4e30-b943-14c0a9b12fb8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.517697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fc7e577-facd-4e30-b943-14c0a9b12fb8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.518386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fc7e577-facd-4e30-b943-14c0a9b12fb8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.518837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fc7e577-facd-4e30-b943-14c0a9b12fb8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.519278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fc7e577-facd-4e30-b943-14c0a9b12fb8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.571551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f095b06f-5ecd-4753-82f6-002b2212b889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.581326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f095b06f-5ecd-4753-82f6-002b2212b889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.091243 Aug 31 00:21:39.582201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 104/195] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:39 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:39.623375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-741e0848-5b3e-48e6-ab8a-9136c225044c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:39.624071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-741e0848-5b3e-48e6-ab8a-9136c225044c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:39.631666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-741e0848-5b3e-48e6-ab8a-9136c225044c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.633232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-741e0848-5b3e-48e6-ab8a-9136c225044c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.633744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-741e0848-5b3e-48e6-ab8a-9136c225044c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.634513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-741e0848-5b3e-48e6-ab8a-9136c225044c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.635125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-741e0848-5b3e-48e6-ab8a-9136c225044c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.635767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-741e0848-5b3e-48e6-ab8a-9136c225044c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.671877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5fc7e577-facd-4e30-b943-14c0a9b12fb8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.682485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5fc7e577-facd-4e30-b943-14c0a9b12fb8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.177448 Aug 31 00:21:39.683345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 92/196] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:39 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:39.776540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-741e0848-5b3e-48e6-ab8a-9136c225044c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.784019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-741e0848-5b3e-48e6-ab8a-9136c225044c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.164342 Aug 31 00:21:39.784579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 105/197] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:39 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:40.512696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9d066f0d-1d1c-41ae-9f1f-606ae62e468a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.513410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9d066f0d-1d1c-41ae-9f1f-606ae62e468a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.520438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d066f0d-1d1c-41ae-9f1f-606ae62e468a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.521034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d066f0d-1d1c-41ae-9f1f-606ae62e468a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.521849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d066f0d-1d1c-41ae-9f1f-606ae62e468a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.522739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d066f0d-1d1c-41ae-9f1f-606ae62e468a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.523914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d066f0d-1d1c-41ae-9f1f-606ae62e468a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.524778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d066f0d-1d1c-41ae-9f1f-606ae62e468a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.528038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.528645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.534518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.534989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.535651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.536359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.536800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.537207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.742993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:40.752141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:40.753840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:40.755134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d855e77a-d8ac-4460-bfa9-cc6b41e174a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.233016 Aug 31 00:21:40.755847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 106/198] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:40.760683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-332dc281-e6da-4922-9123-bf894bf5a247 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.761941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-332dc281-e6da-4922-9123-bf894bf5a247 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.769924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-332dc281-e6da-4922-9123-bf894bf5a247 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.770585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-332dc281-e6da-4922-9123-bf894bf5a247 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.771216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-332dc281-e6da-4922-9123-bf894bf5a247 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.772122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-332dc281-e6da-4922-9123-bf894bf5a247 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.772888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-332dc281-e6da-4922-9123-bf894bf5a247 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.773417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-332dc281-e6da-4922-9123-bf894bf5a247 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.782775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9d066f0d-1d1c-41ae-9f1f-606ae62e468a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:40.797277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9d066f0d-1d1c-41ae-9f1f-606ae62e468a tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.288793 Aug 31 00:21:40.798341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 93/199] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:40.814350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aab75046-2870-427a-925e-5f8acff32d14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.815008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aab75046-2870-427a-925e-5f8acff32d14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.824461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aab75046-2870-427a-925e-5f8acff32d14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.825106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aab75046-2870-427a-925e-5f8acff32d14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.825765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aab75046-2870-427a-925e-5f8acff32d14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.826638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aab75046-2870-427a-925e-5f8acff32d14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.827223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aab75046-2870-427a-925e-5f8acff32d14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.828374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aab75046-2870-427a-925e-5f8acff32d14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.855542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-332dc281-e6da-4922-9123-bf894bf5a247 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:40.866380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-332dc281-e6da-4922-9123-bf894bf5a247 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.109325 Aug 31 00:21:40.868719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 107/200] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:40.884093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2ff3fb5b-d67c-49a0-9b01-423f21a6e039 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.884705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2ff3fb5b-d67c-49a0-9b01-423f21a6e039 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.892034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ff3fb5b-d67c-49a0-9b01-423f21a6e039 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.892651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ff3fb5b-d67c-49a0-9b01-423f21a6e039 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.893076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ff3fb5b-d67c-49a0-9b01-423f21a6e039 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.893762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ff3fb5b-d67c-49a0-9b01-423f21a6e039 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.894213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ff3fb5b-d67c-49a0-9b01-423f21a6e039 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.894626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ff3fb5b-d67c-49a0-9b01-423f21a6e039 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.027221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:41.059030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aab75046-2870-427a-925e-5f8acff32d14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:41.062002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=6 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:41.077076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aab75046-2870-427a-925e-5f8acff32d14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.277289 Aug 31 00:21:41.078250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 94/201] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:41.088426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-a6a1d19c-39bf-457f-9cf1-b76292591511 req-f7c712e8-2ba4-4717-8fb4-f0e8ca09948e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82098e98-ab74-415b-9d57-1e55a9524ce1", "name": "network-vif-plugged", "status": "completed", "tag": "46c132f8-c4f9-45c0-83ee-0c904d4196b0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:41.102140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2ff3fb5b-d67c-49a0-9b01-423f21a6e039 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:41.106936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a6a1d19c-39bf-457f-9cf1-b76292591511 req-f7c712e8-2ba4-4717-8fb4-f0e8ca09948e service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.107645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a6a1d19c-39bf-457f-9cf1-b76292591511 req-f7c712e8-2ba4-4717-8fb4-f0e8ca09948e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.108624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a6a1d19c-39bf-457f-9cf1-b76292591511 req-f7c712e8-2ba4-4717-8fb4-f0e8ca09948e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.114760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2ff3fb5b-d67c-49a0-9b01-423f21a6e039 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.243870 Aug 31 00:21:41.116052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 108/202] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:41.123671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-a6a1d19c-39bf-457f-9cf1-b76292591511 req-f7c712e8-2ba4-4717-8fb4-f0e8ca09948e service nova] Creating event network-vif-plugged:46c132f8-c4f9-45c0-83ee-0c904d4196b0 for instance 82098e98-ab74-415b-9d57-1e55a9524ce1 on hv-cinder-85506 Aug 31 00:21:41.129024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-a6a1d19c-39bf-457f-9cf1-b76292591511 req-f7c712e8-2ba4-4717-8fb4-f0e8ca09948e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049063 Aug 31 00:21:41.129620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 95/203] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:41.779859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:41.780632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:41.782558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:41.788122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.788603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.790179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.790870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.791342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.791759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.822493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-813bcf33-79ef-4531-860f-88d291af6dc7 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:41.823921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-813bcf33-79ef-4531-860f-88d291af6dc7 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:41.830238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-813bcf33-79ef-4531-860f-88d291af6dc7 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.830711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-813bcf33-79ef-4531-860f-88d291af6dc7 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.831169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-813bcf33-79ef-4531-860f-88d291af6dc7 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.835174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-813bcf33-79ef-4531-860f-88d291af6dc7 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.835637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-813bcf33-79ef-4531-860f-88d291af6dc7 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.836360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-813bcf33-79ef-4531-860f-88d291af6dc7 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.020019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.024236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:42.027393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-813bcf33-79ef-4531-860f-88d291af6dc7 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.034981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.036447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.037551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6519baaf-909a-4988-b0dc-39170a643381 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.262121 Aug 31 00:21:42.038113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 109/204] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:42.050781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-813bcf33-79ef-4531-860f-88d291af6dc7 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.234418 Aug 31 00:21:42.051614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8a486275-bf71-4baf-91da-5ee7caac91f2 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:42.052310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 96/205] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:41 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:42.053138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8a486275-bf71-4baf-91da-5ee7caac91f2 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:42.060566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a486275-bf71-4baf-91da-5ee7caac91f2 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.061031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a486275-bf71-4baf-91da-5ee7caac91f2 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.061466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a486275-bf71-4baf-91da-5ee7caac91f2 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.062275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a486275-bf71-4baf-91da-5ee7caac91f2 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.062862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a486275-bf71-4baf-91da-5ee7caac91f2 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.063252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a486275-bf71-4baf-91da-5ee7caac91f2 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.098209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7beb9e2c-a5c5-48af-9941-302f729d9700 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:42.098954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7beb9e2c-a5c5-48af-9941-302f729d9700 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:42.107942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7beb9e2c-a5c5-48af-9941-302f729d9700 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.108548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7beb9e2c-a5c5-48af-9941-302f729d9700 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.109051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7beb9e2c-a5c5-48af-9941-302f729d9700 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.109818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7beb9e2c-a5c5-48af-9941-302f729d9700 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.110341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7beb9e2c-a5c5-48af-9941-302f729d9700 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.111249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7beb9e2c-a5c5-48af-9941-302f729d9700 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.128285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8a486275-bf71-4baf-91da-5ee7caac91f2 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.138504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8a486275-bf71-4baf-91da-5ee7caac91f2 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.092019 Aug 31 00:21:42.151089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 110/206] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:42 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:42.151089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f4cd81a9-64e5-4654-a388-5fcd035a7d82 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:42.151089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f4cd81a9-64e5-4654-a388-5fcd035a7d82 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:42.151812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4cd81a9-64e5-4654-a388-5fcd035a7d82 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.152294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4cd81a9-64e5-4654-a388-5fcd035a7d82 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.152721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4cd81a9-64e5-4654-a388-5fcd035a7d82 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.153637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4cd81a9-64e5-4654-a388-5fcd035a7d82 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.154086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4cd81a9-64e5-4654-a388-5fcd035a7d82 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.154500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4cd81a9-64e5-4654-a388-5fcd035a7d82 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.333286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7beb9e2c-a5c5-48af-9941-302f729d9700 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.341872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f4cd81a9-64e5-4654-a388-5fcd035a7d82 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.342152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7beb9e2c-a5c5-48af-9941-302f729d9700 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.248187 Aug 31 00:21:42.342916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 97/207] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:42 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:42.371070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f4cd81a9-64e5-4654-a388-5fcd035a7d82 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.230610 Aug 31 00:21:42.373699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 111/208] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:42 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:43.061920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:43.062523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:43.068997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.069475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.070103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.071011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.071761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.072180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.073487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-77e0cfb7-233c-4843-8c91-9b9a4468fa7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:43.074123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-77e0cfb7-233c-4843-8c91-9b9a4468fa7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:43.081234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77e0cfb7-233c-4843-8c91-9b9a4468fa7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.082270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77e0cfb7-233c-4843-8c91-9b9a4468fa7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.082866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77e0cfb7-233c-4843-8c91-9b9a4468fa7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.084232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77e0cfb7-233c-4843-8c91-9b9a4468fa7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.084862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77e0cfb7-233c-4843-8c91-9b9a4468fa7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.085703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77e0cfb7-233c-4843-8c91-9b9a4468fa7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.281520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:43.288318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-77e0cfb7-233c-4843-8c91-9b9a4468fa7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:43.291151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:43.293192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:43.294734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-42235c1e-dadf-4dfc-819d-6a4814e03cf3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.236628 Aug 31 00:21:43.295633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 98/209] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:43.296422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-77e0cfb7-233c-4843-8c91-9b9a4468fa7d tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1314 microversion: 2.1 time: 0.227105 Aug 31 00:21:43.297133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 112/210] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:43 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:43.300137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-489e8f0f-fec3-4d08-8750-6dec9ca76847 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:43.300727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-489e8f0f-fec3-4d08-8750-6dec9ca76847 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:43.307443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-489e8f0f-fec3-4d08-8750-6dec9ca76847 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.308121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-489e8f0f-fec3-4d08-8750-6dec9ca76847 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.308710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-489e8f0f-fec3-4d08-8750-6dec9ca76847 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.309559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-489e8f0f-fec3-4d08-8750-6dec9ca76847 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.310140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-489e8f0f-fec3-4d08-8750-6dec9ca76847 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.310704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-489e8f0f-fec3-4d08-8750-6dec9ca76847 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.363911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b34bf9d4-d0b8-4133-b0d1-c88d6abbc11f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:43.364745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b34bf9d4-d0b8-4133-b0d1-c88d6abbc11f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:43.372014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b34bf9d4-d0b8-4133-b0d1-c88d6abbc11f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.372501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b34bf9d4-d0b8-4133-b0d1-c88d6abbc11f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.372927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b34bf9d4-d0b8-4133-b0d1-c88d6abbc11f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.373795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b34bf9d4-d0b8-4133-b0d1-c88d6abbc11f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.374181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-489e8f0f-fec3-4d08-8750-6dec9ca76847 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:43.374579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b34bf9d4-d0b8-4133-b0d1-c88d6abbc11f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.375188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b34bf9d4-d0b8-4133-b0d1-c88d6abbc11f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.386093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-489e8f0f-fec3-4d08-8750-6dec9ca76847 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.089072 Aug 31 00:21:43.387257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 99/211] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:43 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:43.401560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c8102db8-ab95-4816-bcc7-814795162386 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:43.402311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c8102db8-ab95-4816-bcc7-814795162386 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:43.409138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8102db8-ab95-4816-bcc7-814795162386 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.409837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8102db8-ab95-4816-bcc7-814795162386 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.410427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8102db8-ab95-4816-bcc7-814795162386 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.411241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8102db8-ab95-4816-bcc7-814795162386 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.411887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8102db8-ab95-4816-bcc7-814795162386 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.412294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8102db8-ab95-4816-bcc7-814795162386 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.767435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b34bf9d4-d0b8-4133-b0d1-c88d6abbc11f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:43.780870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b34bf9d4-d0b8-4133-b0d1-c88d6abbc11f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.419609 Aug 31 00:21:43.781652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 113/212] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:43 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:43.825877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c8102db8-ab95-4816-bcc7-814795162386 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:43.835678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c8102db8-ab95-4816-bcc7-814795162386 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.438826 Aug 31 00:21:43.837700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 100/213] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:43 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:44.325195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-05a97c82-6f6f-4546-a92d-bdfea7cfd774 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:44.326710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-05a97c82-6f6f-4546-a92d-bdfea7cfd774 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:44.327888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:44.328529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:44.341969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05a97c82-6f6f-4546-a92d-bdfea7cfd774 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.342860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.345102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05a97c82-6f6f-4546-a92d-bdfea7cfd774 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.345888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05a97c82-6f6f-4546-a92d-bdfea7cfd774 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.347711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05a97c82-6f6f-4546-a92d-bdfea7cfd774 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.348722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05a97c82-6f6f-4546-a92d-bdfea7cfd774 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.349491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05a97c82-6f6f-4546-a92d-bdfea7cfd774 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.363309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.363965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.364707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.368378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.368935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.568274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-05a97c82-6f6f-4546-a92d-bdfea7cfd774 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:44.573808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:44.583663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:44.585110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:44.586510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-90339ad4-c884-4c20-90ff-bd2aba61cbb9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.270107 Aug 31 00:21:44.591831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 114/214] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:44.591996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-05a97c82-6f6f-4546-a92d-bdfea7cfd774 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1500 microversion: 2.1 time: 0.269905 Aug 31 00:21:44.598036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fe8a88ba-9fd5-4c57-8ba3-1f9f13bfd063 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:44.599819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fe8a88ba-9fd5-4c57-8ba3-1f9f13bfd063 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:44.605204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 101/215] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:44 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1500 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:44.611308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe8a88ba-9fd5-4c57-8ba3-1f9f13bfd063 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.611308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe8a88ba-9fd5-4c57-8ba3-1f9f13bfd063 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.611308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe8a88ba-9fd5-4c57-8ba3-1f9f13bfd063 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.611524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe8a88ba-9fd5-4c57-8ba3-1f9f13bfd063 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.611860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe8a88ba-9fd5-4c57-8ba3-1f9f13bfd063 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.612421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe8a88ba-9fd5-4c57-8ba3-1f9f13bfd063 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.690719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fe8a88ba-9fd5-4c57-8ba3-1f9f13bfd063 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:44.699484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fe8a88ba-9fd5-4c57-8ba3-1f9f13bfd063 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.110180 Aug 31 00:21:44.711251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 115/216] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:44 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:44.803369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-91571ea2-652b-41ea-9c34-194266cb52f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:44.804053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-91571ea2-652b-41ea-9c34-194266cb52f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:44.811301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91571ea2-652b-41ea-9c34-194266cb52f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.812037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91571ea2-652b-41ea-9c34-194266cb52f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.812492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91571ea2-652b-41ea-9c34-194266cb52f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.813234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91571ea2-652b-41ea-9c34-194266cb52f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.813616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91571ea2-652b-41ea-9c34-194266cb52f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.814139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91571ea2-652b-41ea-9c34-194266cb52f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.858552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-08845137-29d3-4155-ad8c-8d543a532dd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:44.859330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-08845137-29d3-4155-ad8c-8d543a532dd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:44.868338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08845137-29d3-4155-ad8c-8d543a532dd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.869211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08845137-29d3-4155-ad8c-8d543a532dd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.869952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08845137-29d3-4155-ad8c-8d543a532dd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:44.871312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08845137-29d3-4155-ad8c-8d543a532dd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:44.871910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08845137-29d3-4155-ad8c-8d543a532dd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:44.873051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08845137-29d3-4155-ad8c-8d543a532dd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.040965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91571ea2-652b-41ea-9c34-194266cb52f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:45.052775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-91571ea2-652b-41ea-9c34-194266cb52f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.254134 Aug 31 00:21:45.054226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 102/217] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:44 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:45.103547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-08845137-29d3-4155-ad8c-8d543a532dd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:45.111919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-08845137-29d3-4155-ad8c-8d543a532dd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.257159 Aug 31 00:21:45.112483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 116/218] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:44 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:45.609869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:45.610455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:45.621384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:45.621785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:45.622208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.622896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:45.623363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:45.626873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.638336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-7cac6ad7-7eb8-4fc5-9091-10bc968475c3 req-bff31f33-79a0-41a5-b21d-8b27d6ff0f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e4497e-f74f-4b4e-aac6-88c39ead5f38", "name": "network-vif-plugged", "status": "completed", "tag": "8dddb3be-7ff7-4bfa-aebb-406f077a2133"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:45.656445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7cac6ad7-7eb8-4fc5-9091-10bc968475c3 req-bff31f33-79a0-41a5-b21d-8b27d6ff0f12 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:45.656920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7cac6ad7-7eb8-4fc5-9091-10bc968475c3 req-bff31f33-79a0-41a5-b21d-8b27d6ff0f12 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:45.657339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7cac6ad7-7eb8-4fc5-9091-10bc968475c3 req-bff31f33-79a0-41a5-b21d-8b27d6ff0f12 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.678332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-7cac6ad7-7eb8-4fc5-9091-10bc968475c3 req-bff31f33-79a0-41a5-b21d-8b27d6ff0f12 service nova] Creating event network-vif-plugged:8dddb3be-7ff7-4bfa-aebb-406f077a2133 for instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 on hv-cinder-85506 Aug 31 00:21:45.684638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-7cac6ad7-7eb8-4fc5-9091-10bc968475c3 req-bff31f33-79a0-41a5-b21d-8b27d6ff0f12 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050131 Aug 31 00:21:45.685259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 117/219] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:45.722452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d2111447-2271-4b92-9363-3227d41630f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:45.722996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d2111447-2271-4b92-9363-3227d41630f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:45.733678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2111447-2271-4b92-9363-3227d41630f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:45.734603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2111447-2271-4b92-9363-3227d41630f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:45.734697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2111447-2271-4b92-9363-3227d41630f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.735503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2111447-2271-4b92-9363-3227d41630f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:45.735962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2111447-2271-4b92-9363-3227d41630f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:45.736357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2111447-2271-4b92-9363-3227d41630f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.819930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d2111447-2271-4b92-9363-3227d41630f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:45.823969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:45.827762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:45.828934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d2111447-2271-4b92-9363-3227d41630f3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.111090 Aug 31 00:21:45.830080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 118/220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:45 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:45.832945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:45.834380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:45.835480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5499a7d5-496e-4c9f-8d49-a75dd7b15e56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.229533 Aug 31 00:21:45.836618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 103/221] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:46.078106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-46c3e390-19c2-4711-a058-b860e4ae60c9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:46.078825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-46c3e390-19c2-4711-a058-b860e4ae60c9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:46.085044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-46c3e390-19c2-4711-a058-b860e4ae60c9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.085600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-46c3e390-19c2-4711-a058-b860e4ae60c9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.086079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-46c3e390-19c2-4711-a058-b860e4ae60c9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.087117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-46c3e390-19c2-4711-a058-b860e4ae60c9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.087579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-46c3e390-19c2-4711-a058-b860e4ae60c9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.088005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-46c3e390-19c2-4711-a058-b860e4ae60c9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.134106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4e6a52d6-2255-478d-a1e6-cda037eedcc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:46.134649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4e6a52d6-2255-478d-a1e6-cda037eedcc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:46.141388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e6a52d6-2255-478d-a1e6-cda037eedcc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.141872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e6a52d6-2255-478d-a1e6-cda037eedcc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.142302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e6a52d6-2255-478d-a1e6-cda037eedcc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.142984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e6a52d6-2255-478d-a1e6-cda037eedcc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.143458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e6a52d6-2255-478d-a1e6-cda037eedcc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.143876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e6a52d6-2255-478d-a1e6-cda037eedcc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.282814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-46c3e390-19c2-4711-a058-b860e4ae60c9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:46.293173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-46c3e390-19c2-4711-a058-b860e4ae60c9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.218880 Aug 31 00:21:46.293849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 119/222] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:46 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:46.323565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4e6a52d6-2255-478d-a1e6-cda037eedcc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:46.331195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4e6a52d6-2255-478d-a1e6-cda037eedcc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.201111 Aug 31 00:21:46.331772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 104/223] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:46 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:46.849550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0246683a-18c5-4ce1-a39e-47b1c54fd5fc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:46.850172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0246683a-18c5-4ce1-a39e-47b1c54fd5fc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:46.856105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0246683a-18c5-4ce1-a39e-47b1c54fd5fc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.856604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0246683a-18c5-4ce1-a39e-47b1c54fd5fc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.857022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0246683a-18c5-4ce1-a39e-47b1c54fd5fc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.857685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0246683a-18c5-4ce1-a39e-47b1c54fd5fc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.858120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0246683a-18c5-4ce1-a39e-47b1c54fd5fc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.858529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0246683a-18c5-4ce1-a39e-47b1c54fd5fc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.861412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:46.862009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:46.867998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.868474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.868898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.869585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.870026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.870515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.925045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0246683a-18c5-4ce1-a39e-47b1c54fd5fc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:46.933163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0246683a-18c5-4ce1-a39e-47b1c54fd5fc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.087377 Aug 31 00:21:46.933736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 120/224] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:46 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:47.023220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:47.032003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:47.033512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:47.034495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-82d99584-409c-45ae-a766-718ba142b76d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.176962 Aug 31 00:21:47.035052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 105/225] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:47.314403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-897f7844-86c8-4b0c-9a60-b2e05cd4f1af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:47.314922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-897f7844-86c8-4b0c-9a60-b2e05cd4f1af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:47.320834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-897f7844-86c8-4b0c-9a60-b2e05cd4f1af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.321396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-897f7844-86c8-4b0c-9a60-b2e05cd4f1af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.321996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-897f7844-86c8-4b0c-9a60-b2e05cd4f1af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:47.322684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-897f7844-86c8-4b0c-9a60-b2e05cd4f1af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.323163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-897f7844-86c8-4b0c-9a60-b2e05cd4f1af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.323585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-897f7844-86c8-4b0c-9a60-b2e05cd4f1af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:47.353224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-18294c7e-a2ad-4c43-ab53-1b0eb278b62a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:47.353823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-18294c7e-a2ad-4c43-ab53-1b0eb278b62a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:47.359944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18294c7e-a2ad-4c43-ab53-1b0eb278b62a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.360429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18294c7e-a2ad-4c43-ab53-1b0eb278b62a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.360854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18294c7e-a2ad-4c43-ab53-1b0eb278b62a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:47.361536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18294c7e-a2ad-4c43-ab53-1b0eb278b62a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.361977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18294c7e-a2ad-4c43-ab53-1b0eb278b62a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.362390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18294c7e-a2ad-4c43-ab53-1b0eb278b62a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:47.509388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-897f7844-86c8-4b0c-9a60-b2e05cd4f1af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:47.517827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-897f7844-86c8-4b0c-9a60-b2e05cd4f1af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.207266 Aug 31 00:21:47.518427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 121/226] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:47 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:47.535378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-18294c7e-a2ad-4c43-ab53-1b0eb278b62a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:47.544406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-18294c7e-a2ad-4c43-ab53-1b0eb278b62a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.195776 Aug 31 00:21:47.544983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 106/227] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:47 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:47.954327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-296af7da-fc4e-464a-8c43-bcb617930d7b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:47.954919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-296af7da-fc4e-464a-8c43-bcb617930d7b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:47.961065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-296af7da-fc4e-464a-8c43-bcb617930d7b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.961545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-296af7da-fc4e-464a-8c43-bcb617930d7b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.961973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-296af7da-fc4e-464a-8c43-bcb617930d7b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:47.962649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-296af7da-fc4e-464a-8c43-bcb617930d7b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.963125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-296af7da-fc4e-464a-8c43-bcb617930d7b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.963555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-296af7da-fc4e-464a-8c43-bcb617930d7b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.027991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-296af7da-fc4e-464a-8c43-bcb617930d7b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.035450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-296af7da-fc4e-464a-8c43-bcb617930d7b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.084887 Aug 31 00:21:48.036007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 122/228] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:47 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:48.056756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:48.057365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:48.063260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:48.063742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:48.064170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.064854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:48.065302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:48.065718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.194990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.203784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.205226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.206304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3834a97a-3b47-4630-9c98-1f4ac212e77d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.154087 Aug 31 00:21:48.206857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 107/229] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:48.544520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4ec94cd1-96ba-432b-be7e-a8b121f17a77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:48.545212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4ec94cd1-96ba-432b-be7e-a8b121f17a77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:48.551244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ec94cd1-96ba-432b-be7e-a8b121f17a77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:48.551721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ec94cd1-96ba-432b-be7e-a8b121f17a77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:48.552154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ec94cd1-96ba-432b-be7e-a8b121f17a77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.552833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ec94cd1-96ba-432b-be7e-a8b121f17a77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:48.553286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ec94cd1-96ba-432b-be7e-a8b121f17a77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:48.553704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ec94cd1-96ba-432b-be7e-a8b121f17a77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.566584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-289795bd-92fe-437c-b1f6-8af341e0b26a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:48.567113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-289795bd-92fe-437c-b1f6-8af341e0b26a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:48.573930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-289795bd-92fe-437c-b1f6-8af341e0b26a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:48.574416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-289795bd-92fe-437c-b1f6-8af341e0b26a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:48.574956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-289795bd-92fe-437c-b1f6-8af341e0b26a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.575666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-289795bd-92fe-437c-b1f6-8af341e0b26a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:48.576325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-289795bd-92fe-437c-b1f6-8af341e0b26a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:48.576745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-289795bd-92fe-437c-b1f6-8af341e0b26a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.750498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4ec94cd1-96ba-432b-be7e-a8b121f17a77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.758113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4ec94cd1-96ba-432b-be7e-a8b121f17a77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.217530 Aug 31 00:21:48.758884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 123/230] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:48 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:48.761388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-289795bd-92fe-437c-b1f6-8af341e0b26a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.769355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-289795bd-92fe-437c-b1f6-8af341e0b26a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.208399 Aug 31 00:21:48.769903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 108/231] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:48 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:49.055568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d62d4a3-6483-45d9-890a-f55d4699bbc0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:49.056239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0d62d4a3-6483-45d9-890a-f55d4699bbc0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:49.062112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d62d4a3-6483-45d9-890a-f55d4699bbc0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.062593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d62d4a3-6483-45d9-890a-f55d4699bbc0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.063025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d62d4a3-6483-45d9-890a-f55d4699bbc0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.063724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d62d4a3-6483-45d9-890a-f55d4699bbc0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.064177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d62d4a3-6483-45d9-890a-f55d4699bbc0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.064597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d62d4a3-6483-45d9-890a-f55d4699bbc0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.129246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0d62d4a3-6483-45d9-890a-f55d4699bbc0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:49.138699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0d62d4a3-6483-45d9-890a-f55d4699bbc0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.087190 Aug 31 00:21:49.139306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 124/232] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:49 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:49.228222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:49.228905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:49.235098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.235588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.236021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.236708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.237156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.237571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.381291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:49.391919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:49.393406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:49.395198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2b8cfdbd-d060-43e8-af77-4f6e422debf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.170758 Aug 31 00:21:49.395789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 109/233] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:49.778665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bd8fffec-3422-4957-8973-5fc29b1847d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:49.779186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bd8fffec-3422-4957-8973-5fc29b1847d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:49.786829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd8fffec-3422-4957-8973-5fc29b1847d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.787224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd8fffec-3422-4957-8973-5fc29b1847d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.787654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd8fffec-3422-4957-8973-5fc29b1847d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.788640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd8fffec-3422-4957-8973-5fc29b1847d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.789607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd8fffec-3422-4957-8973-5fc29b1847d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.790084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd8fffec-3422-4957-8973-5fc29b1847d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.797450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d8b792b2-28d8-4c11-8c98-ab108019c3cc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:49.798192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d8b792b2-28d8-4c11-8c98-ab108019c3cc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:49.808612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b792b2-28d8-4c11-8c98-ab108019c3cc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.810742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b792b2-28d8-4c11-8c98-ab108019c3cc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.811486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b792b2-28d8-4c11-8c98-ab108019c3cc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.813416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b792b2-28d8-4c11-8c98-ab108019c3cc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.813866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b792b2-28d8-4c11-8c98-ab108019c3cc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.814324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b792b2-28d8-4c11-8c98-ab108019c3cc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.021525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bd8fffec-3422-4957-8973-5fc29b1847d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:50.029606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bd8fffec-3422-4957-8973-5fc29b1847d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1322 microversion: 2.1 time: 0.254768 Aug 31 00:21:50.030106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 125/234] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:49 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:50.037513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d8b792b2-28d8-4c11-8c98-ab108019c3cc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:50.046115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d8b792b2-28d8-4c11-8c98-ab108019c3cc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1362 microversion: 2.1 time: 0.259958 Aug 31 00:21:50.046678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 110/235] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:49 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:50.162633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cbdc5c14-3777-4645-bce6-0f3bcafcfb8b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:50.163368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cbdc5c14-3777-4645-bce6-0f3bcafcfb8b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:50.171168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cbdc5c14-3777-4645-bce6-0f3bcafcfb8b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.171664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cbdc5c14-3777-4645-bce6-0f3bcafcfb8b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.172095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cbdc5c14-3777-4645-bce6-0f3bcafcfb8b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.172783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cbdc5c14-3777-4645-bce6-0f3bcafcfb8b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.173231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cbdc5c14-3777-4645-bce6-0f3bcafcfb8b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.173650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cbdc5c14-3777-4645-bce6-0f3bcafcfb8b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.225919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6c845ccb-9974-4dd4-bb4e-c4267a6e0ad1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad129c7b-eb12-4391-beab-db4337fc72cf"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:50.228954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6c845ccb-9974-4dd4-bb4e-c4267a6e0ad1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:50.234872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c845ccb-9974-4dd4-bb4e-c4267a6e0ad1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.235828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c845ccb-9974-4dd4-bb4e-c4267a6e0ad1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.235828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c845ccb-9974-4dd4-bb4e-c4267a6e0ad1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.236459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c845ccb-9974-4dd4-bb4e-c4267a6e0ad1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.236896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c845ccb-9974-4dd4-bb4e-c4267a6e0ad1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.237304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c845ccb-9974-4dd4-bb4e-c4267a6e0ad1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.237761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cbdc5c14-3777-4645-bce6-0f3bcafcfb8b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:50.245548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cbdc5c14-3777-4645-bce6-0f3bcafcfb8b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.089260 Aug 31 00:21:50.246115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 126/236] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:50 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:50.419189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:50.419800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:50.426704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.427225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.427659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.428339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.428787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.429205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.433656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:50.558868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:50.566916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:50.568383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:50.569479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-197ea6e6-de48-4f32-aec4-07e710c2650e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.155464 Aug 31 00:21:50.570031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 127/237] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:51.049929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2da900f4-7554-4680-82be-66660890b66d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:51.050534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2da900f4-7554-4680-82be-66660890b66d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:51.057295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da900f4-7554-4680-82be-66660890b66d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.057777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da900f4-7554-4680-82be-66660890b66d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.058213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da900f4-7554-4680-82be-66660890b66d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.058896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da900f4-7554-4680-82be-66660890b66d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.059375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da900f4-7554-4680-82be-66660890b66d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.059793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da900f4-7554-4680-82be-66660890b66d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.190594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2da900f4-7554-4680-82be-66660890b66d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:51.199020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2da900f4-7554-4680-82be-66660890b66d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1515 microversion: 2.1 time: 0.152964 Aug 31 00:21:51.199627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 128/238] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:51 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:51.204054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-761e2749-95e1-4fd0-9b9f-7fb007b08ff1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:51.204650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-761e2749-95e1-4fd0-9b9f-7fb007b08ff1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:51.210226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-761e2749-95e1-4fd0-9b9f-7fb007b08ff1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.210769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-761e2749-95e1-4fd0-9b9f-7fb007b08ff1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.211457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-761e2749-95e1-4fd0-9b9f-7fb007b08ff1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.212140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-761e2749-95e1-4fd0-9b9f-7fb007b08ff1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.212619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-761e2749-95e1-4fd0-9b9f-7fb007b08ff1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.213040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-761e2749-95e1-4fd0-9b9f-7fb007b08ff1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.343315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-761e2749-95e1-4fd0-9b9f-7fb007b08ff1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:51.351007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-761e2749-95e1-4fd0-9b9f-7fb007b08ff1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1549 microversion: 2.1 time: 0.150423 Aug 31 00:21:51.352148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 129/239] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:51 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:51.372670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5b7f32cc-f1ee-421d-8a00-e9f2b0223ab2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:51.374995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5b7f32cc-f1ee-421d-8a00-e9f2b0223ab2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:51.381088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7f32cc-f1ee-421d-8a00-e9f2b0223ab2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.381567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7f32cc-f1ee-421d-8a00-e9f2b0223ab2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.381993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7f32cc-f1ee-421d-8a00-e9f2b0223ab2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.382700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7f32cc-f1ee-421d-8a00-e9f2b0223ab2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.383369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7f32cc-f1ee-421d-8a00-e9f2b0223ab2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.384021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7f32cc-f1ee-421d-8a00-e9f2b0223ab2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.446371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-5b7f32cc-f1ee-421d-8a00-e9f2b0223ab2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'flavor' on Instance uuid ff9b4929-5c16-4d39-a447-5ae948ff989e {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:21:51.563880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5b7f32cc-f1ee-421d-8a00-e9f2b0223ab2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e/action" status: 200 len: 32 microversion: 2.1 time: 0.210529 Aug 31 00:21:51.564482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 130/240] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 00:21:51 2022] POST /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:21:51.569355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c508114c-1c1c-4c26-b90d-7126185c344e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:51.570038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c508114c-1c1c-4c26-b90d-7126185c344e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:51.576100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c508114c-1c1c-4c26-b90d-7126185c344e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.576570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c508114c-1c1c-4c26-b90d-7126185c344e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.577011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c508114c-1c1c-4c26-b90d-7126185c344e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.577661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c508114c-1c1c-4c26-b90d-7126185c344e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.578109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c508114c-1c1c-4c26-b90d-7126185c344e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.578518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c508114c-1c1c-4c26-b90d-7126185c344e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.639288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c508114c-1c1c-4c26-b90d-7126185c344e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:51.646795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c508114c-1c1c-4c26-b90d-7126185c344e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.081243 Aug 31 00:21:51.647395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 131/241] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:51 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:51.652323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-52ec3b44-7e4f-4e7b-b24d-32e8658c5ca0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:51.652806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-52ec3b44-7e4f-4e7b-b24d-32e8658c5ca0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:51.658189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52ec3b44-7e4f-4e7b-b24d-32e8658c5ca0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.658667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52ec3b44-7e4f-4e7b-b24d-32e8658c5ca0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.659122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52ec3b44-7e4f-4e7b-b24d-32e8658c5ca0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.659797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52ec3b44-7e4f-4e7b-b24d-32e8658c5ca0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.660244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52ec3b44-7e4f-4e7b-b24d-32e8658c5ca0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.660662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52ec3b44-7e4f-4e7b-b24d-32e8658c5ca0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.739667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-52ec3b44-7e4f-4e7b-b24d-32e8658c5ca0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091215 Aug 31 00:21:51.740262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 132/242] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 31 00:21:51 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:51.745143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3ae91ca3-5c61-45d3-ab27-c55b8b2982b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:51.745739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3ae91ca3-5c61-45d3-ab27-c55b8b2982b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:51.751741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ae91ca3-5c61-45d3-ab27-c55b8b2982b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.752221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ae91ca3-5c61-45d3-ab27-c55b8b2982b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.752649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ae91ca3-5c61-45d3-ab27-c55b8b2982b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.753361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ae91ca3-5c61-45d3-ab27-c55b8b2982b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.753809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ae91ca3-5c61-45d3-ab27-c55b8b2982b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.754227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ae91ca3-5c61-45d3-ab27-c55b8b2982b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.057155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3ae91ca3-5c61-45d3-ab27-c55b8b2982b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:52.057155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3ae91ca3-5c61-45d3-ab27-c55b8b2982b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.312389 Aug 31 00:21:52.057155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 133/243] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:51 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:52.060476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:52.061041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:52.066778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.067397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.067823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.068494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.068933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.069343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.397639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:52.406698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:52.408238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:52.409342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0bee7a2b-5d3c-4773-8d69-413e001b66e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.354296 Aug 31 00:21:52.409894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 134/244] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:52.669339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bd47554d-4846-4e80-a3c1-bd769052118c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:52.669968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bd47554d-4846-4e80-a3c1-bd769052118c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:52.676210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd47554d-4846-4e80-a3c1-bd769052118c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.676775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd47554d-4846-4e80-a3c1-bd769052118c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.677301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd47554d-4846-4e80-a3c1-bd769052118c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.678415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd47554d-4846-4e80-a3c1-bd769052118c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.678936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd47554d-4846-4e80-a3c1-bd769052118c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.679452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd47554d-4846-4e80-a3c1-bd769052118c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.769063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bd47554d-4846-4e80-a3c1-bd769052118c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:52.778038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bd47554d-4846-4e80-a3c1-bd769052118c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.113687 Aug 31 00:21:52.778618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 135/245] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:52 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:53.076305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-870d9269-8ba0-4b79-95c2-d415595bcc22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:53.077172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-870d9269-8ba0-4b79-95c2-d415595bcc22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:53.083452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-870d9269-8ba0-4b79-95c2-d415595bcc22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.083927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-870d9269-8ba0-4b79-95c2-d415595bcc22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.084353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-870d9269-8ba0-4b79-95c2-d415595bcc22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.085033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-870d9269-8ba0-4b79-95c2-d415595bcc22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.085470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-870d9269-8ba0-4b79-95c2-d415595bcc22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.085880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-870d9269-8ba0-4b79-95c2-d415595bcc22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.294675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-870d9269-8ba0-4b79-95c2-d415595bcc22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:53.303510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-870d9269-8ba0-4b79-95c2-d415595bcc22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.230911 Aug 31 00:21:53.304093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 136/246] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:53 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:53.309193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-cd27f3d4-be06-4da2-8a02-3593237c89d2 req-c230c4fa-1445-4496-bbe3-8e7eb57a66fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7854a5f-0fae-40f3-a7d2-a2bdb829e851", "tag": "49190300-5cb3-462c-ba24-576656255826"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:53.318595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-cd27f3d4-be06-4da2-8a02-3593237c89d2 req-c230c4fa-1445-4496-bbe3-8e7eb57a66fb service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.319085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-cd27f3d4-be06-4da2-8a02-3593237c89d2 req-c230c4fa-1445-4496-bbe3-8e7eb57a66fb service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.319506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-cd27f3d4-be06-4da2-8a02-3593237c89d2 req-c230c4fa-1445-4496-bbe3-8e7eb57a66fb service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.331635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-cd27f3d4-be06-4da2-8a02-3593237c89d2 req-c230c4fa-1445-4496-bbe3-8e7eb57a66fb service nova] Creating event network-changed:49190300-5cb3-462c-ba24-576656255826 for instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 on hv-cinder-85506 Aug 31 00:21:53.337171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-cd27f3d4-be06-4da2-8a02-3593237c89d2 req-c230c4fa-1445-4496-bbe3-8e7eb57a66fb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031720 Aug 31 00:21:53.337762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 137/247] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:53.433749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:53.434374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:53.441252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.441730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.442153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.442823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.443304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.443713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.584390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:53.592865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:53.594314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:53.595637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d65be26e-04f0-4926-a5c2-ed39245079c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.167096 Aug 31 00:21:53.599495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 138/248] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:53 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:53.799624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-758e1dc1-480b-442a-a61d-ea7291dd7a13 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:53.800224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-758e1dc1-480b-442a-a61d-ea7291dd7a13 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:53.807084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-758e1dc1-480b-442a-a61d-ea7291dd7a13 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.807557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-758e1dc1-480b-442a-a61d-ea7291dd7a13 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.807989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-758e1dc1-480b-442a-a61d-ea7291dd7a13 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.808678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-758e1dc1-480b-442a-a61d-ea7291dd7a13 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.809125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-758e1dc1-480b-442a-a61d-ea7291dd7a13 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.809545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-758e1dc1-480b-442a-a61d-ea7291dd7a13 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.869329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-758e1dc1-480b-442a-a61d-ea7291dd7a13 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:53.877082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-758e1dc1-480b-442a-a61d-ea7291dd7a13 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.081226 Aug 31 00:21:53.877662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 139/249] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:53 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:54.326232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d9a35536-67b9-4a9a-9939-665df28681c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:54.326836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d9a35536-67b9-4a9a-9939-665df28681c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:54.333436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a35536-67b9-4a9a-9939-665df28681c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.334201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a35536-67b9-4a9a-9939-665df28681c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.334642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a35536-67b9-4a9a-9939-665df28681c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.335544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a35536-67b9-4a9a-9939-665df28681c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.336131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a35536-67b9-4a9a-9939-665df28681c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.337196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a35536-67b9-4a9a-9939-665df28681c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.491698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d9a35536-67b9-4a9a-9939-665df28681c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:54.500022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d9a35536-67b9-4a9a-9939-665df28681c8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.178113 Aug 31 00:21:54.500590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 140/250] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:54 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:54.619755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:54.620421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:54.626377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.626857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.627319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.628002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.628449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.628867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.760509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:54.768732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:54.770163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:54.771277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0d12dc99-3f61-42cd-b0d1-7078d815b905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.156148 Aug 31 00:21:54.771834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 141/251] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:54.901139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a8555b62-bc75-400f-8332-63e364c4efe5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:54.901658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a8555b62-bc75-400f-8332-63e364c4efe5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:54.904681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:54.908720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8555b62-bc75-400f-8332-63e364c4efe5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.909232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8555b62-bc75-400f-8332-63e364c4efe5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.909661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8555b62-bc75-400f-8332-63e364c4efe5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.910336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8555b62-bc75-400f-8332-63e364c4efe5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.910781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8555b62-bc75-400f-8332-63e364c4efe5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.911228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8555b62-bc75-400f-8332-63e364c4efe5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.977876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a8555b62-bc75-400f-8332-63e364c4efe5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:54.981217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:54.986000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a8555b62-bc75-400f-8332-63e364c4efe5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1266 microversion: 2.1 time: 0.089428 Aug 31 00:21:54.986564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 142/252] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:54 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:55.522481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-95f15893-e8fa-41d2-889e-f4403814e69e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:55.523249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-95f15893-e8fa-41d2-889e-f4403814e69e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:55.531381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95f15893-e8fa-41d2-889e-f4403814e69e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:55.531978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95f15893-e8fa-41d2-889e-f4403814e69e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:55.532387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95f15893-e8fa-41d2-889e-f4403814e69e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:55.533083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95f15893-e8fa-41d2-889e-f4403814e69e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:55.533531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95f15893-e8fa-41d2-889e-f4403814e69e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:55.533980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95f15893-e8fa-41d2-889e-f4403814e69e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:55.763862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-95f15893-e8fa-41d2-889e-f4403814e69e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:55.771650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-95f15893-e8fa-41d2-889e-f4403814e69e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.253609 Aug 31 00:21:55.772212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 143/253] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:55 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:55.795881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:55.796486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:55.802284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:55.802757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:55.803574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:55.804423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:55.804905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:55.805870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.119639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.130068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.131431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.132760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e9ef0ecc-6faf-44af-9a26-42c63c039923 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.341858 Aug 31 00:21:56.133326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 144/254] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:56.138164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-618752e2-094d-425c-a5ca-00cd17c740dc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:56.138751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-618752e2-094d-425c-a5ca-00cd17c740dc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:56.144992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-618752e2-094d-425c-a5ca-00cd17c740dc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.145457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-618752e2-094d-425c-a5ca-00cd17c740dc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.145904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-618752e2-094d-425c-a5ca-00cd17c740dc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.146570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-618752e2-094d-425c-a5ca-00cd17c740dc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.147011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-618752e2-094d-425c-a5ca-00cd17c740dc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.147521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-618752e2-094d-425c-a5ca-00cd17c740dc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.228647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-618752e2-094d-425c-a5ca-00cd17c740dc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.240360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-618752e2-094d-425c-a5ca-00cd17c740dc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1274 microversion: 2.1 time: 0.105701 Aug 31 00:21:56.241040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 145/255] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:56 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:56.792715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e02a0695-ea06-48b9-a75f-01d0d09c1c2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:56.793420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e02a0695-ea06-48b9-a75f-01d0d09c1c2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:56.801251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e02a0695-ea06-48b9-a75f-01d0d09c1c2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.801813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e02a0695-ea06-48b9-a75f-01d0d09c1c2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.803406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e02a0695-ea06-48b9-a75f-01d0d09c1c2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.804188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e02a0695-ea06-48b9-a75f-01d0d09c1c2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.804700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e02a0695-ea06-48b9-a75f-01d0d09c1c2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.805360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e02a0695-ea06-48b9-a75f-01d0d09c1c2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.976091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e02a0695-ea06-48b9-a75f-01d0d09c1c2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.984133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e02a0695-ea06-48b9-a75f-01d0d09c1c2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.195655 Aug 31 00:21:56.984714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 146/256] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:56 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:57.159838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:57.160606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:57.166631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:57.167143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:57.167910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:57.169453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:57.169920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:57.170389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:57.397255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:57.409371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:57.411785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:57.412909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-61c8b558-c715-48ac-878e-b97012fb4699 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.258370 Aug 31 00:21:57.415822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 147/257] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:57.420486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ae4ce435-821d-4d08-97f8-63a289347c70 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:57.421459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ae4ce435-821d-4d08-97f8-63a289347c70 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:57.427734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4ce435-821d-4d08-97f8-63a289347c70 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:57.429053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4ce435-821d-4d08-97f8-63a289347c70 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:57.430928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4ce435-821d-4d08-97f8-63a289347c70 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:57.431864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4ce435-821d-4d08-97f8-63a289347c70 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:57.431864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4ce435-821d-4d08-97f8-63a289347c70 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:57.432077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4ce435-821d-4d08-97f8-63a289347c70 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:57.514926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ae4ce435-821d-4d08-97f8-63a289347c70 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:57.523048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ae4ce435-821d-4d08-97f8-63a289347c70 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1274 microversion: 2.1 time: 0.106030 Aug 31 00:21:57.523674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 148/258] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:57 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:58.007627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-06067605-1d8c-4b4f-9dc6-18a9f0c5660e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:58.009209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-06067605-1d8c-4b4f-9dc6-18a9f0c5660e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:58.019410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06067605-1d8c-4b4f-9dc6-18a9f0c5660e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.020117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06067605-1d8c-4b4f-9dc6-18a9f0c5660e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.020742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06067605-1d8c-4b4f-9dc6-18a9f0c5660e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.022158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06067605-1d8c-4b4f-9dc6-18a9f0c5660e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.022495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06067605-1d8c-4b4f-9dc6-18a9f0c5660e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.023678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06067605-1d8c-4b4f-9dc6-18a9f0c5660e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.261815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6c845ccb-9974-4dd4-bb4e-c4267a6e0ad1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "POST /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.039087 Aug 31 00:21:58.262880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 111/259] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 00:21:50 2022] POST /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e/os-volume_attachments => generated 194 bytes in 8042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:58.366294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-06067605-1d8c-4b4f-9dc6-18a9f0c5660e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:58.379778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-06067605-1d8c-4b4f-9dc6-18a9f0c5660e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.377983 Aug 31 00:21:58.381634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 149/260] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:58 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:58.451050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:58.451818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:58.476588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.477995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.479614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.480347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.480811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.481270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.548172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-264fbf26-a781-487f-b6dc-bc5407c8dbbd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:58.548888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-264fbf26-a781-487f-b6dc-bc5407c8dbbd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:58.556625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264fbf26-a781-487f-b6dc-bc5407c8dbbd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.557415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264fbf26-a781-487f-b6dc-bc5407c8dbbd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.558369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264fbf26-a781-487f-b6dc-bc5407c8dbbd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.559616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264fbf26-a781-487f-b6dc-bc5407c8dbbd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.560709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264fbf26-a781-487f-b6dc-bc5407c8dbbd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.561340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264fbf26-a781-487f-b6dc-bc5407c8dbbd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.946533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-264fbf26-a781-487f-b6dc-bc5407c8dbbd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:58.956124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-264fbf26-a781-487f-b6dc-bc5407c8dbbd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1272 microversion: 2.1 time: 0.414906 Aug 31 00:21:58.956699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 150/261] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:58 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1272 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:59.084558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:59.093456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:59.095349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:59.096988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0b2fb2a2-fce5-460c-9611-7d71c61fff49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.654742 Aug 31 00:21:59.098266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 112/262] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:59.402634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f1c1f5e2-1336-4ee1-90c9-a8e5647b10d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:59.403280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f1c1f5e2-1336-4ee1-90c9-a8e5647b10d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:59.409237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5e2-1336-4ee1-90c9-a8e5647b10d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:59.409958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5e2-1336-4ee1-90c9-a8e5647b10d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:59.410384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5e2-1336-4ee1-90c9-a8e5647b10d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:59.411355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5e2-1336-4ee1-90c9-a8e5647b10d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:59.411951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5e2-1336-4ee1-90c9-a8e5647b10d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:59.412748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5e2-1336-4ee1-90c9-a8e5647b10d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:59.749125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f1c1f5e2-1336-4ee1-90c9-a8e5647b10d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:59.764236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f1c1f5e2-1336-4ee1-90c9-a8e5647b10d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.364281 Aug 31 00:21:59.764236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 151/263] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:59 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:59.977027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed7df95a-6a88-4d6f-99bc-016a35c34370 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:59.977842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ed7df95a-6a88-4d6f-99bc-016a35c34370 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:59.986623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed7df95a-6a88-4d6f-99bc-016a35c34370 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:59.987540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed7df95a-6a88-4d6f-99bc-016a35c34370 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:59.988225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed7df95a-6a88-4d6f-99bc-016a35c34370 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:59.989263 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed7df95a-6a88-4d6f-99bc-016a35c34370 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:59.990534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed7df95a-6a88-4d6f-99bc-016a35c34370 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:59.991321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed7df95a-6a88-4d6f-99bc-016a35c34370 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:00.121677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:00.122355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:00.128347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:00.128895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:00.129391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:00.130256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:00.130935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:00.131456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:00.310806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ed7df95a-6a88-4d6f-99bc-016a35c34370 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:00.318915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ed7df95a-6a88-4d6f-99bc-016a35c34370 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.345636 Aug 31 00:22:00.332046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 113/264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:59 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:00.410179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:00.422099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:00.424389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:00.425502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1060847e-7e76-4915-8bf6-527441a09c16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.309097 Aug 31 00:22:00.426815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 152/265] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:00.785640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-db9943aa-85cc-48e7-97a1-92157b4c6686 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:00.786249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-db9943aa-85cc-48e7-97a1-92157b4c6686 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:00.793688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db9943aa-85cc-48e7-97a1-92157b4c6686 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:00.794178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db9943aa-85cc-48e7-97a1-92157b4c6686 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:00.794653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db9943aa-85cc-48e7-97a1-92157b4c6686 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:00.795441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db9943aa-85cc-48e7-97a1-92157b4c6686 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:00.795890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db9943aa-85cc-48e7-97a1-92157b4c6686 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:00.796367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db9943aa-85cc-48e7-97a1-92157b4c6686 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:00.830297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-d6dbe464-3db5-4a2e-81f1-7b9b48ed1c61 req-aec5546f-1953-4642-9d4f-80cfcbc625fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17116ede-206d-478f-880b-b8054ccac135", "tag": "f53b4304-5d8a-4043-b7d1-51a13d08011f"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:00.841619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d6dbe464-3db5-4a2e-81f1-7b9b48ed1c61 req-aec5546f-1953-4642-9d4f-80cfcbc625fe service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:00.842084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d6dbe464-3db5-4a2e-81f1-7b9b48ed1c61 req-aec5546f-1953-4642-9d4f-80cfcbc625fe service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:00.842501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d6dbe464-3db5-4a2e-81f1-7b9b48ed1c61 req-aec5546f-1953-4642-9d4f-80cfcbc625fe service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:00.855162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-d6dbe464-3db5-4a2e-81f1-7b9b48ed1c61 req-aec5546f-1953-4642-9d4f-80cfcbc625fe service nova] Creating event network-changed:f53b4304-5d8a-4043-b7d1-51a13d08011f for instance 17116ede-206d-478f-880b-b8054ccac135 on hv-cinder-85506 Aug 31 00:22:00.859994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-d6dbe464-3db5-4a2e-81f1-7b9b48ed1c61 req-aec5546f-1953-4642-9d4f-80cfcbc625fe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033528 Aug 31 00:22:00.860581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 153/266] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:22:00.949368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-db9943aa-85cc-48e7-97a1-92157b4c6686 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:00.957105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-db9943aa-85cc-48e7-97a1-92157b4c6686 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.175332 Aug 31 00:22:00.957662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 114/267] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:00 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:01.340302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ebef9c90-b5d4-499d-ab06-2962d9b2c748 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:01.341063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ebef9c90-b5d4-499d-ab06-2962d9b2c748 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:01.347799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebef9c90-b5d4-499d-ab06-2962d9b2c748 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.348274 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebef9c90-b5d4-499d-ab06-2962d9b2c748 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.348920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebef9c90-b5d4-499d-ab06-2962d9b2c748 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.349604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebef9c90-b5d4-499d-ab06-2962d9b2c748 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.350045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebef9c90-b5d4-499d-ab06-2962d9b2c748 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.350454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebef9c90-b5d4-499d-ab06-2962d9b2c748 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.449492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:01.450234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:01.454243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=81 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:01.462841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.464255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.464996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.467835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.468367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.468735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.556100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ebef9c90-b5d4-499d-ab06-2962d9b2c748 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:01.563690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ebef9c90-b5d4-499d-ab06-2962d9b2c748 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.228394 Aug 31 00:22:01.564249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 154/268] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:01 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:01.618415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:01.629258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:01.629258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:01.629868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-34bbf2e5-acac-42c1-b030-0a7fc2134e37 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.185307 Aug 31 00:22:01.630436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 115/269] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:01.979676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6c5b5433-9e8e-48c5-b72e-e4b274d96bfd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:01.980436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6c5b5433-9e8e-48c5-b72e-e4b274d96bfd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:01.986754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c5b5433-9e8e-48c5-b72e-e4b274d96bfd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.987282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c5b5433-9e8e-48c5-b72e-e4b274d96bfd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.987715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c5b5433-9e8e-48c5-b72e-e4b274d96bfd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.988397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c5b5433-9e8e-48c5-b72e-e4b274d96bfd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.988844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c5b5433-9e8e-48c5-b72e-e4b274d96bfd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.989262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c5b5433-9e8e-48c5-b72e-e4b274d96bfd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.116765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6c5b5433-9e8e-48c5-b72e-e4b274d96bfd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:02.125082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6c5b5433-9e8e-48c5-b72e-e4b274d96bfd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.150093 Aug 31 00:22:02.125575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 155/270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:01 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:02.585130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cc7a70c4-8347-48bd-9c47-b7bb6e5c60d0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:02.585754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cc7a70c4-8347-48bd-9c47-b7bb6e5c60d0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:02.592710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc7a70c4-8347-48bd-9c47-b7bb6e5c60d0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:02.593189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc7a70c4-8347-48bd-9c47-b7bb6e5c60d0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:02.593623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc7a70c4-8347-48bd-9c47-b7bb6e5c60d0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.594302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc7a70c4-8347-48bd-9c47-b7bb6e5c60d0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:02.594751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc7a70c4-8347-48bd-9c47-b7bb6e5c60d0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:02.595198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc7a70c4-8347-48bd-9c47-b7bb6e5c60d0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.656070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:02.656667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:02.664875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:02.665346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:02.665849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.666545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:02.667429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:02.668381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.791163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cc7a70c4-8347-48bd-9c47-b7bb6e5c60d0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:02.798878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cc7a70c4-8347-48bd-9c47-b7bb6e5c60d0 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.217684 Aug 31 00:22:02.799476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 116/271] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:02 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:02.841576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:02.849598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:02.851055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:02.852171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-43a0b235-37d4-4efd-a532-034e2ce8e642 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.201863 Aug 31 00:22:02.852718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 156/272] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:03.145913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-77102fa5-4901-40e8-b2e9-3ad788c691df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:03.146513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-77102fa5-4901-40e8-b2e9-3ad788c691df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:03.152933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77102fa5-4901-40e8-b2e9-3ad788c691df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.153407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77102fa5-4901-40e8-b2e9-3ad788c691df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.153835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77102fa5-4901-40e8-b2e9-3ad788c691df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.154504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77102fa5-4901-40e8-b2e9-3ad788c691df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.154949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77102fa5-4901-40e8-b2e9-3ad788c691df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.155406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77102fa5-4901-40e8-b2e9-3ad788c691df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.290509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-77102fa5-4901-40e8-b2e9-3ad788c691df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:03.298335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-77102fa5-4901-40e8-b2e9-3ad788c691df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.156199 Aug 31 00:22:03.298897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 117/273] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:03 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:03.819425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2d1ca0b0-aef9-4e3b-8ff8-9ff4519c33c3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:03.820030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2d1ca0b0-aef9-4e3b-8ff8-9ff4519c33c3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:03.826934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1ca0b0-aef9-4e3b-8ff8-9ff4519c33c3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.827513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1ca0b0-aef9-4e3b-8ff8-9ff4519c33c3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.827940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1ca0b0-aef9-4e3b-8ff8-9ff4519c33c3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.828615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1ca0b0-aef9-4e3b-8ff8-9ff4519c33c3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.829059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1ca0b0-aef9-4e3b-8ff8-9ff4519c33c3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.829470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1ca0b0-aef9-4e3b-8ff8-9ff4519c33c3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.875357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:03.876237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:03.883025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.883025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.884845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.885935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.885935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.886273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:04.003165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d1ca0b0-aef9-4e3b-8ff8-9ff4519c33c3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:04.011773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2d1ca0b0-aef9-4e3b-8ff8-9ff4519c33c3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.196068 Aug 31 00:22:04.012702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 157/274] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:03 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:04.047187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:04.056982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:04.058422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:04.059572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0a0580f-0838-4b1f-af75-415e37897fc9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1407 microversion: 2.20 time: 0.188896 Aug 31 00:22:04.060134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 118/275] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:04.319533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93773ee1-1842-4404-8dad-bb6b83973d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:04.320138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-93773ee1-1842-4404-8dad-bb6b83973d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:04.326447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93773ee1-1842-4404-8dad-bb6b83973d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:04.327352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93773ee1-1842-4404-8dad-bb6b83973d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:04.328047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93773ee1-1842-4404-8dad-bb6b83973d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:04.328739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93773ee1-1842-4404-8dad-bb6b83973d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:04.329213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93773ee1-1842-4404-8dad-bb6b83973d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:04.329614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93773ee1-1842-4404-8dad-bb6b83973d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:04.476346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-93773ee1-1842-4404-8dad-bb6b83973d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:04.485060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-93773ee1-1842-4404-8dad-bb6b83973d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.169346 Aug 31 00:22:04.485627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 158/276] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:04 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:05.032644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4d031d51-5a58-4d8a-9390-c2df70d5dbcc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:05.033332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4d031d51-5a58-4d8a-9390-c2df70d5dbcc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:05.039876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d031d51-5a58-4d8a-9390-c2df70d5dbcc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.040377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d031d51-5a58-4d8a-9390-c2df70d5dbcc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.040782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d031d51-5a58-4d8a-9390-c2df70d5dbcc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.041463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d031d51-5a58-4d8a-9390-c2df70d5dbcc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.041895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d031d51-5a58-4d8a-9390-c2df70d5dbcc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.042311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d031d51-5a58-4d8a-9390-c2df70d5dbcc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.046420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:05.084366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:05.089030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:05.099427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.099918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.100338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.101061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.101519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.111349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.251185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4d031d51-5a58-4d8a-9390-c2df70d5dbcc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:05.259747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4d031d51-5a58-4d8a-9390-c2df70d5dbcc tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.230930 Aug 31 00:22:05.260462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 119/277] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:05 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:05.282372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:05.290429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:05.292493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:05.294040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1611c494-2d54-402d-ac84-c9ba18a25435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1600 microversion: 2.20 time: 0.213685 Aug 31 00:22:05.294621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 159/278] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:05.318379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ac302cb3-0248-4af8-862f-8e50c812e663 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:05.318747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ac302cb3-0248-4af8-862f-8e50c812e663 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:05.326373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac302cb3-0248-4af8-862f-8e50c812e663 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.326939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac302cb3-0248-4af8-862f-8e50c812e663 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.327510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac302cb3-0248-4af8-862f-8e50c812e663 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.328285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac302cb3-0248-4af8-862f-8e50c812e663 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.328786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac302cb3-0248-4af8-862f-8e50c812e663 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.329297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac302cb3-0248-4af8-862f-8e50c812e663 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.420130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ac302cb3-0248-4af8-862f-8e50c812e663 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.105827 Aug 31 00:22:05.420777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 120/279] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 31 00:22:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:22:05.506875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-88d3104f-5385-42bf-bfce-6228b7826f6a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:05.507513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-88d3104f-5385-42bf-bfce-6228b7826f6a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:05.518427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88d3104f-5385-42bf-bfce-6228b7826f6a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.518952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88d3104f-5385-42bf-bfce-6228b7826f6a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.519463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88d3104f-5385-42bf-bfce-6228b7826f6a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.520188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88d3104f-5385-42bf-bfce-6228b7826f6a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.520652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88d3104f-5385-42bf-bfce-6228b7826f6a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.521374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88d3104f-5385-42bf-bfce-6228b7826f6a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.526771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:05.865048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-88d3104f-5385-42bf-bfce-6228b7826f6a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:05.880030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-88d3104f-5385-42bf-bfce-6228b7826f6a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.377604 Aug 31 00:22:05.894236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 160/280] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:05 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:06.281192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0f53a541-eb5a-423b-9432-581044b82944 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:06.282054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0f53a541-eb5a-423b-9432-581044b82944 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:06.289221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f53a541-eb5a-423b-9432-581044b82944 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:06.290677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f53a541-eb5a-423b-9432-581044b82944 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:06.291138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f53a541-eb5a-423b-9432-581044b82944 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:06.291845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f53a541-eb5a-423b-9432-581044b82944 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:06.292312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f53a541-eb5a-423b-9432-581044b82944 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:06.292753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f53a541-eb5a-423b-9432-581044b82944 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:06.766454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0f53a541-eb5a-423b-9432-581044b82944 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:06.780514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0f53a541-eb5a-423b-9432-581044b82944 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.503846 Aug 31 00:22:06.781254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 121/281] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:06 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:06.903467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2e5cdf5d-92cf-427d-9a41-c7e0fdcb0d71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:06.904970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2e5cdf5d-92cf-427d-9a41-c7e0fdcb0d71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:06.912334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e5cdf5d-92cf-427d-9a41-c7e0fdcb0d71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:06.912817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e5cdf5d-92cf-427d-9a41-c7e0fdcb0d71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:06.913248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e5cdf5d-92cf-427d-9a41-c7e0fdcb0d71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:06.913959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e5cdf5d-92cf-427d-9a41-c7e0fdcb0d71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:06.915452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e5cdf5d-92cf-427d-9a41-c7e0fdcb0d71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:06.916141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e5cdf5d-92cf-427d-9a41-c7e0fdcb0d71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:07.244408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2e5cdf5d-92cf-427d-9a41-c7e0fdcb0d71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:07.257565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2e5cdf5d-92cf-427d-9a41-c7e0fdcb0d71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.357907 Aug 31 00:22:07.260785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 161/282] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:06 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:07.448651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-262d26dc-d7a3-424c-9e3c-badaaec8a420 req-8cb8fa31-76b4-4b4b-883b-447aa02ba4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e4497e-f74f-4b4e-aac6-88c39ead5f38", "tag": "8dddb3be-7ff7-4bfa-aebb-406f077a2133"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:07.459922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-262d26dc-d7a3-424c-9e3c-badaaec8a420 req-8cb8fa31-76b4-4b4b-883b-447aa02ba4df service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:07.460488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-262d26dc-d7a3-424c-9e3c-badaaec8a420 req-8cb8fa31-76b4-4b4b-883b-447aa02ba4df service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:07.461104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-262d26dc-d7a3-424c-9e3c-badaaec8a420 req-8cb8fa31-76b4-4b4b-883b-447aa02ba4df service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:07.473593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-262d26dc-d7a3-424c-9e3c-badaaec8a420 req-8cb8fa31-76b4-4b4b-883b-447aa02ba4df service nova] Creating event network-changed:8dddb3be-7ff7-4bfa-aebb-406f077a2133 for instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 on hv-cinder-85506 Aug 31 00:22:07.484651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-262d26dc-d7a3-424c-9e3c-badaaec8a420 req-8cb8fa31-76b4-4b4b-883b-447aa02ba4df service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040562 Aug 31 00:22:07.485537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 122/283] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:07.801821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0ef8df83-ba9e-4cbb-911f-df4e2898d83c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:07.802431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0ef8df83-ba9e-4cbb-911f-df4e2898d83c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:07.809574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ef8df83-ba9e-4cbb-911f-df4e2898d83c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:07.810062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ef8df83-ba9e-4cbb-911f-df4e2898d83c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:07.810652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ef8df83-ba9e-4cbb-911f-df4e2898d83c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:07.811249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ef8df83-ba9e-4cbb-911f-df4e2898d83c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:07.811696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ef8df83-ba9e-4cbb-911f-df4e2898d83c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:07.812117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ef8df83-ba9e-4cbb-911f-df4e2898d83c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:07.951495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0ef8df83-ba9e-4cbb-911f-df4e2898d83c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:07.959386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0ef8df83-ba9e-4cbb-911f-df4e2898d83c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.161427 Aug 31 00:22:07.959942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 162/284] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:07 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:08.282355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-85436233-a477-4f38-8ab7-6f7297240cde tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:08.283055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-85436233-a477-4f38-8ab7-6f7297240cde tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:08.289252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85436233-a477-4f38-8ab7-6f7297240cde tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:08.290327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85436233-a477-4f38-8ab7-6f7297240cde tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:08.290729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85436233-a477-4f38-8ab7-6f7297240cde tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:08.291435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85436233-a477-4f38-8ab7-6f7297240cde tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:08.291883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85436233-a477-4f38-8ab7-6f7297240cde tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:08.292293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85436233-a477-4f38-8ab7-6f7297240cde tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:08.443735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-85436233-a477-4f38-8ab7-6f7297240cde tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:08.455187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-85436233-a477-4f38-8ab7-6f7297240cde tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.176891 Aug 31 00:22:08.468129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 123/285] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:08 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:08.989681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d0a8f566-4349-4c6b-a5c8-cbaedecb3217 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:08.990278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d0a8f566-4349-4c6b-a5c8-cbaedecb3217 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:08.997879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a8f566-4349-4c6b-a5c8-cbaedecb3217 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:08.998362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a8f566-4349-4c6b-a5c8-cbaedecb3217 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:08.998782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a8f566-4349-4c6b-a5c8-cbaedecb3217 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:08.999502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a8f566-4349-4c6b-a5c8-cbaedecb3217 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:08.999945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a8f566-4349-4c6b-a5c8-cbaedecb3217 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:09.000352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a8f566-4349-4c6b-a5c8-cbaedecb3217 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:09.165725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d0a8f566-4349-4c6b-a5c8-cbaedecb3217 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:09.173774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d0a8f566-4349-4c6b-a5c8-cbaedecb3217 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.187893 Aug 31 00:22:09.174344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 163/286] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:08 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:09.478616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b99d7a2e-c7d2-449d-81ad-023f20f7d0fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:09.479267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b99d7a2e-c7d2-449d-81ad-023f20f7d0fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:09.485666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b99d7a2e-c7d2-449d-81ad-023f20f7d0fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:09.486351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b99d7a2e-c7d2-449d-81ad-023f20f7d0fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:09.486792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b99d7a2e-c7d2-449d-81ad-023f20f7d0fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:09.487524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b99d7a2e-c7d2-449d-81ad-023f20f7d0fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:09.487976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b99d7a2e-c7d2-449d-81ad-023f20f7d0fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:09.488401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b99d7a2e-c7d2-449d-81ad-023f20f7d0fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:09.690947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b99d7a2e-c7d2-449d-81ad-023f20f7d0fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:09.699892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b99d7a2e-c7d2-449d-81ad-023f20f7d0fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.225651 Aug 31 00:22:09.700472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 124/287] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:09 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:10.195513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c68dbc56-b739-4751-aa94-4769c572b0b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:10.197013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c68dbc56-b739-4751-aa94-4769c572b0b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:10.203168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68dbc56-b739-4751-aa94-4769c572b0b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:10.204023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68dbc56-b739-4751-aa94-4769c572b0b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:10.204447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68dbc56-b739-4751-aa94-4769c572b0b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:10.205254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68dbc56-b739-4751-aa94-4769c572b0b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:10.205747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68dbc56-b739-4751-aa94-4769c572b0b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:10.206167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68dbc56-b739-4751-aa94-4769c572b0b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:10.351211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c68dbc56-b739-4751-aa94-4769c572b0b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:10.359616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c68dbc56-b739-4751-aa94-4769c572b0b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.167818 Aug 31 00:22:10.360560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 164/288] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:10 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:10.731051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2957696a-1561-48db-8169-4ccc7c3ae67a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:10.731848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2957696a-1561-48db-8169-4ccc7c3ae67a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:10.739116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2957696a-1561-48db-8169-4ccc7c3ae67a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:10.739774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2957696a-1561-48db-8169-4ccc7c3ae67a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:10.740341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2957696a-1561-48db-8169-4ccc7c3ae67a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:10.741345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2957696a-1561-48db-8169-4ccc7c3ae67a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:10.742091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2957696a-1561-48db-8169-4ccc7c3ae67a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:10.743374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2957696a-1561-48db-8169-4ccc7c3ae67a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:10.893729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2957696a-1561-48db-8169-4ccc7c3ae67a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:10.904220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2957696a-1561-48db-8169-4ccc7c3ae67a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.187030 Aug 31 00:22:10.905048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 125/289] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:10 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:11.382537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-eeccc9fc-08b5-4099-af48-0be09e55685d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:11.383565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eeccc9fc-08b5-4099-af48-0be09e55685d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:11.391071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeccc9fc-08b5-4099-af48-0be09e55685d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:11.391800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeccc9fc-08b5-4099-af48-0be09e55685d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:11.392387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeccc9fc-08b5-4099-af48-0be09e55685d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:11.393228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeccc9fc-08b5-4099-af48-0be09e55685d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:11.393933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeccc9fc-08b5-4099-af48-0be09e55685d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:11.394491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeccc9fc-08b5-4099-af48-0be09e55685d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:11.606710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-eeccc9fc-08b5-4099-af48-0be09e55685d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:11.614658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-eeccc9fc-08b5-4099-af48-0be09e55685d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.236199 Aug 31 00:22:11.615805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 165/290] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:11 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:11.936533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-92a434d4-a84a-4266-8783-d003f9babd11 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:11.937649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-92a434d4-a84a-4266-8783-d003f9babd11 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:11.950273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92a434d4-a84a-4266-8783-d003f9babd11 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:11.951644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92a434d4-a84a-4266-8783-d003f9babd11 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:11.952271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92a434d4-a84a-4266-8783-d003f9babd11 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:11.952959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92a434d4-a84a-4266-8783-d003f9babd11 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:11.953509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92a434d4-a84a-4266-8783-d003f9babd11 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:11.953963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92a434d4-a84a-4266-8783-d003f9babd11 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:12.194599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-92a434d4-a84a-4266-8783-d003f9babd11 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:12.207745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-92a434d4-a84a-4266-8783-d003f9babd11 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.281566 Aug 31 00:22:12.216013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 126/291] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:11 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:12.639468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e537e294-9f71-4e51-b001-05fdade08a53 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:12.639468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e537e294-9f71-4e51-b001-05fdade08a53 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:12.644055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e537e294-9f71-4e51-b001-05fdade08a53 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:12.644476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e537e294-9f71-4e51-b001-05fdade08a53 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:12.644905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e537e294-9f71-4e51-b001-05fdade08a53 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:12.645616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e537e294-9f71-4e51-b001-05fdade08a53 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:12.646093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e537e294-9f71-4e51-b001-05fdade08a53 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:12.646512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e537e294-9f71-4e51-b001-05fdade08a53 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:12.783087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e537e294-9f71-4e51-b001-05fdade08a53 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:12.791703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e537e294-9f71-4e51-b001-05fdade08a53 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.159734 Aug 31 00:22:12.792482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 166/292] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:12 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:13.239748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-89a8cf44-9a98-442b-9a96-07d542686373 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:13.240337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-89a8cf44-9a98-442b-9a96-07d542686373 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:13.247850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89a8cf44-9a98-442b-9a96-07d542686373 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.248342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89a8cf44-9a98-442b-9a96-07d542686373 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.248775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89a8cf44-9a98-442b-9a96-07d542686373 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.249458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89a8cf44-9a98-442b-9a96-07d542686373 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.249909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89a8cf44-9a98-442b-9a96-07d542686373 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.250330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89a8cf44-9a98-442b-9a96-07d542686373 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.381251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-89a8cf44-9a98-442b-9a96-07d542686373 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:13.390419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-89a8cf44-9a98-442b-9a96-07d542686373 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.154531 Aug 31 00:22:13.390993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 127/293] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:13 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:13.799708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-1ccc406f-1e2f-4550-8d61-03179292cce0 req-91a7e0dc-6d23-4334-9144-76cce30dd725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17116ede-206d-478f-880b-b8054ccac135", "name": "network-vif-plugged", "status": "completed", "tag": "f53b4304-5d8a-4043-b7d1-51a13d08011f"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:13.810012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1ccc406f-1e2f-4550-8d61-03179292cce0 req-91a7e0dc-6d23-4334-9144-76cce30dd725 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.810501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1ccc406f-1e2f-4550-8d61-03179292cce0 req-91a7e0dc-6d23-4334-9144-76cce30dd725 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.810966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1ccc406f-1e2f-4550-8d61-03179292cce0 req-91a7e0dc-6d23-4334-9144-76cce30dd725 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.817929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cbdfd715-e9a5-4d03-916d-f255be669a7f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:13.818904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cbdfd715-e9a5-4d03-916d-f255be669a7f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:13.825957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbdfd715-e9a5-4d03-916d-f255be669a7f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.826771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbdfd715-e9a5-4d03-916d-f255be669a7f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.827465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbdfd715-e9a5-4d03-916d-f255be669a7f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.828646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbdfd715-e9a5-4d03-916d-f255be669a7f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.829132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-1ccc406f-1e2f-4550-8d61-03179292cce0 req-91a7e0dc-6d23-4334-9144-76cce30dd725 service nova] Creating event network-vif-plugged:f53b4304-5d8a-4043-b7d1-51a13d08011f for instance 17116ede-206d-478f-880b-b8054ccac135 on hv-cinder-85506 Aug 31 00:22:13.829550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbdfd715-e9a5-4d03-916d-f255be669a7f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.830180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbdfd715-e9a5-4d03-916d-f255be669a7f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.834205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-1ccc406f-1e2f-4550-8d61-03179292cce0 req-91a7e0dc-6d23-4334-9144-76cce30dd725 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039425 Aug 31 00:22:13.835237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 167/294] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:13.988754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cbdfd715-e9a5-4d03-916d-f255be669a7f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:14.007493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cbdfd715-e9a5-4d03-916d-f255be669a7f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.193060 Aug 31 00:22:14.010113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 128/295] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:13 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:14.412721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-77b79bbe-f062-4339-8e57-a91796691a13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:14.413401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-77b79bbe-f062-4339-8e57-a91796691a13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:14.420692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b79bbe-f062-4339-8e57-a91796691a13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:14.421173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b79bbe-f062-4339-8e57-a91796691a13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:14.421594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b79bbe-f062-4339-8e57-a91796691a13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:14.422273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b79bbe-f062-4339-8e57-a91796691a13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:14.422715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b79bbe-f062-4339-8e57-a91796691a13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:14.423149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b79bbe-f062-4339-8e57-a91796691a13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:14.682997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-77b79bbe-f062-4339-8e57-a91796691a13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:14.691174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-77b79bbe-f062-4339-8e57-a91796691a13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.282461 Aug 31 00:22:14.691748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 168/296] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:14 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:15.030703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-41757554-9dfc-4a79-8232-45552bdb446a tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:15.031490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-41757554-9dfc-4a79-8232-45552bdb446a tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:15.038077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41757554-9dfc-4a79-8232-45552bdb446a tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:15.038715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41757554-9dfc-4a79-8232-45552bdb446a tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:15.039408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41757554-9dfc-4a79-8232-45552bdb446a tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:15.040361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41757554-9dfc-4a79-8232-45552bdb446a tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:15.040813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41757554-9dfc-4a79-8232-45552bdb446a tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:15.041230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41757554-9dfc-4a79-8232-45552bdb446a tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:15.184859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-41757554-9dfc-4a79-8232-45552bdb446a tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:15.194619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-41757554-9dfc-4a79-8232-45552bdb446a tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.168365 Aug 31 00:22:15.196608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 129/297] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:15 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:15.713859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-eaabc103-5128-4fc8-bd5b-b082c100d111 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:15.715122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eaabc103-5128-4fc8-bd5b-b082c100d111 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:15.723502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaabc103-5128-4fc8-bd5b-b082c100d111 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:15.724047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaabc103-5128-4fc8-bd5b-b082c100d111 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:15.724481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaabc103-5128-4fc8-bd5b-b082c100d111 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:15.725170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaabc103-5128-4fc8-bd5b-b082c100d111 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:15.725615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaabc103-5128-4fc8-bd5b-b082c100d111 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:15.726035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaabc103-5128-4fc8-bd5b-b082c100d111 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:15.868958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-eaabc103-5128-4fc8-bd5b-b082c100d111 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:15.878525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-eaabc103-5128-4fc8-bd5b-b082c100d111 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.169363 Aug 31 00:22:15.879621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 169/298] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:15 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:16.219536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-993c7f55-5110-4372-9116-b94e1635be34 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:16.220330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-993c7f55-5110-4372-9116-b94e1635be34 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:16.226292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-993c7f55-5110-4372-9116-b94e1635be34 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.226760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-993c7f55-5110-4372-9116-b94e1635be34 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.227921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-993c7f55-5110-4372-9116-b94e1635be34 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.228774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-993c7f55-5110-4372-9116-b94e1635be34 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.229362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-993c7f55-5110-4372-9116-b94e1635be34 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.229928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-993c7f55-5110-4372-9116-b94e1635be34 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.373945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-993c7f55-5110-4372-9116-b94e1635be34 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:16.381442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-993c7f55-5110-4372-9116-b94e1635be34 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1314 microversion: 2.1 time: 0.165550 Aug 31 00:22:16.382529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 130/299] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:16 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:16.899967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-29fe519b-180c-494e-8426-c76da01ffa80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:16.900478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-29fe519b-180c-494e-8426-c76da01ffa80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:16.906809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29fe519b-180c-494e-8426-c76da01ffa80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.907318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29fe519b-180c-494e-8426-c76da01ffa80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.907751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29fe519b-180c-494e-8426-c76da01ffa80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.908431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29fe519b-180c-494e-8426-c76da01ffa80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.908873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29fe519b-180c-494e-8426-c76da01ffa80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.909288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29fe519b-180c-494e-8426-c76da01ffa80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:17.042946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-29fe519b-180c-494e-8426-c76da01ffa80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:17.050750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-29fe519b-180c-494e-8426-c76da01ffa80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.154706 Aug 31 00:22:17.051340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 170/300] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:16 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:17.403868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5d26356e-7f2f-4feb-b2ad-2d5ed072e0e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:17.404551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5d26356e-7f2f-4feb-b2ad-2d5ed072e0e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:17.411005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d26356e-7f2f-4feb-b2ad-2d5ed072e0e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:17.411590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d26356e-7f2f-4feb-b2ad-2d5ed072e0e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:17.412143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d26356e-7f2f-4feb-b2ad-2d5ed072e0e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:17.412917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d26356e-7f2f-4feb-b2ad-2d5ed072e0e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:17.413482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d26356e-7f2f-4feb-b2ad-2d5ed072e0e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:17.413976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d26356e-7f2f-4feb-b2ad-2d5ed072e0e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:17.563917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5d26356e-7f2f-4feb-b2ad-2d5ed072e0e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:17.573828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5d26356e-7f2f-4feb-b2ad-2d5ed072e0e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1497 microversion: 2.1 time: 0.174564 Aug 31 00:22:17.574588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 131/301] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:17 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:18.072731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c960dab3-e04f-4030-b439-ab35abcc4c96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:18.073335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c960dab3-e04f-4030-b439-ab35abcc4c96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:18.079592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c960dab3-e04f-4030-b439-ab35abcc4c96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:18.080107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c960dab3-e04f-4030-b439-ab35abcc4c96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:18.080530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c960dab3-e04f-4030-b439-ab35abcc4c96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:18.081205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c960dab3-e04f-4030-b439-ab35abcc4c96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:18.081640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c960dab3-e04f-4030-b439-ab35abcc4c96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:18.082048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c960dab3-e04f-4030-b439-ab35abcc4c96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:18.219456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c960dab3-e04f-4030-b439-ab35abcc4c96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:18.232388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c960dab3-e04f-4030-b439-ab35abcc4c96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.163543 Aug 31 00:22:18.232964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 171/302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:18 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:19.253698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c3cf7f0b-9831-406b-9e33-65c56c4f3702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:19.254309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c3cf7f0b-9831-406b-9e33-65c56c4f3702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:19.261361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3cf7f0b-9831-406b-9e33-65c56c4f3702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:19.261848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3cf7f0b-9831-406b-9e33-65c56c4f3702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:19.262282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3cf7f0b-9831-406b-9e33-65c56c4f3702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:19.262985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3cf7f0b-9831-406b-9e33-65c56c4f3702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:19.263740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3cf7f0b-9831-406b-9e33-65c56c4f3702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:19.264157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3cf7f0b-9831-406b-9e33-65c56c4f3702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:19.449904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c3cf7f0b-9831-406b-9e33-65c56c4f3702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:19.458162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c3cf7f0b-9831-406b-9e33-65c56c4f3702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.208498 Aug 31 00:22:19.458733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 132/303] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:19 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:20.479986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-edb3da08-d5af-4807-a7ec-6260bab1caec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:20.480691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-edb3da08-d5af-4807-a7ec-6260bab1caec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:20.486842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edb3da08-d5af-4807-a7ec-6260bab1caec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:20.487428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edb3da08-d5af-4807-a7ec-6260bab1caec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:20.487861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edb3da08-d5af-4807-a7ec-6260bab1caec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:20.488539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edb3da08-d5af-4807-a7ec-6260bab1caec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:20.488986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edb3da08-d5af-4807-a7ec-6260bab1caec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:20.489396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edb3da08-d5af-4807-a7ec-6260bab1caec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:20.835634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-edb3da08-d5af-4807-a7ec-6260bab1caec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:20.845972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-edb3da08-d5af-4807-a7ec-6260bab1caec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.370264 Aug 31 00:22:20.846562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 172/304] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:20 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:21.873786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d13dbe62-2082-4525-b179-101d1d8ea66b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:21.874389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d13dbe62-2082-4525-b179-101d1d8ea66b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:21.880690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d13dbe62-2082-4525-b179-101d1d8ea66b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:21.881169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d13dbe62-2082-4525-b179-101d1d8ea66b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:21.881600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d13dbe62-2082-4525-b179-101d1d8ea66b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:21.882463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d13dbe62-2082-4525-b179-101d1d8ea66b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:21.882739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d13dbe62-2082-4525-b179-101d1d8ea66b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:21.883193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d13dbe62-2082-4525-b179-101d1d8ea66b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:22.033011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d13dbe62-2082-4525-b179-101d1d8ea66b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:22.041763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d13dbe62-2082-4525-b179-101d1d8ea66b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.171639 Aug 31 00:22:22.042342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 133/305] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:21 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:23.065187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bc7478d7-3790-4fd9-833e-a7a4c097e995 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:23.066148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bc7478d7-3790-4fd9-833e-a7a4c097e995 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:23.075279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc7478d7-3790-4fd9-833e-a7a4c097e995 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.075769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc7478d7-3790-4fd9-833e-a7a4c097e995 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.076205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc7478d7-3790-4fd9-833e-a7a4c097e995 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.076962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc7478d7-3790-4fd9-833e-a7a4c097e995 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.077591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc7478d7-3790-4fd9-833e-a7a4c097e995 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.078016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc7478d7-3790-4fd9-833e-a7a4c097e995 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.089357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-396de00d-2540-46c7-9385-a517fceebab3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:23.090201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-396de00d-2540-46c7-9385-a517fceebab3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:23.096794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-396de00d-2540-46c7-9385-a517fceebab3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.097280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-396de00d-2540-46c7-9385-a517fceebab3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.097712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-396de00d-2540-46c7-9385-a517fceebab3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.098738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-396de00d-2540-46c7-9385-a517fceebab3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.099762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-396de00d-2540-46c7-9385-a517fceebab3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.100387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-396de00d-2540-46c7-9385-a517fceebab3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.156427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-396de00d-2540-46c7-9385-a517fceebab3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:22:23.237567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bc7478d7-3790-4fd9-833e-a7a4c097e995 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:23.247712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bc7478d7-3790-4fd9-833e-a7a4c097e995 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.188430 Aug 31 00:22:23.248182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 173/306] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:23 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:23.257822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-396de00d-2540-46c7-9385-a517fceebab3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "DELETE /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 204 len: 0 microversion: 2.1 time: 0.173145 Aug 31 00:22:23.259479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 134/307] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:22:23 2022] DELETE /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:22:23.270187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-707674d6-615c-40c2-bd92-6efd9ecccc8f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:23.270950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-707674d6-615c-40c2-bd92-6efd9ecccc8f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:23.277252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-707674d6-615c-40c2-bd92-6efd9ecccc8f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.277837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-707674d6-615c-40c2-bd92-6efd9ecccc8f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.278237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-707674d6-615c-40c2-bd92-6efd9ecccc8f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.279096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-707674d6-615c-40c2-bd92-6efd9ecccc8f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.279538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-707674d6-615c-40c2-bd92-6efd9ecccc8f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.280000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-707674d6-615c-40c2-bd92-6efd9ecccc8f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.420986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-707674d6-615c-40c2-bd92-6efd9ecccc8f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:23.428699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-707674d6-615c-40c2-bd92-6efd9ecccc8f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.162293 Aug 31 00:22:23.429260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 174/308] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:23 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:24.270368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d1954a34-4e74-46c5-8aa2-d1d76b7fdf2f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:24.271237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d1954a34-4e74-46c5-8aa2-d1d76b7fdf2f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:24.280723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1954a34-4e74-46c5-8aa2-d1d76b7fdf2f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:24.281204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1954a34-4e74-46c5-8aa2-d1d76b7fdf2f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:24.281633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1954a34-4e74-46c5-8aa2-d1d76b7fdf2f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:24.282318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1954a34-4e74-46c5-8aa2-d1d76b7fdf2f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:24.282763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1954a34-4e74-46c5-8aa2-d1d76b7fdf2f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:24.283251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1954a34-4e74-46c5-8aa2-d1d76b7fdf2f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:24.287445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:24.421548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d1954a34-4e74-46c5-8aa2-d1d76b7fdf2f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:24.429352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d1954a34-4e74-46c5-8aa2-d1d76b7fdf2f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.163192 Aug 31 00:22:24.429920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 135/309] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:24 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:24.451709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-abcb2cdd-ec9f-4de1-aa35-5a9d43dd0cc3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:24.452311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-abcb2cdd-ec9f-4de1-aa35-5a9d43dd0cc3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:24.458331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abcb2cdd-ec9f-4de1-aa35-5a9d43dd0cc3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:24.458720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abcb2cdd-ec9f-4de1-aa35-5a9d43dd0cc3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:24.459189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abcb2cdd-ec9f-4de1-aa35-5a9d43dd0cc3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:24.459867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abcb2cdd-ec9f-4de1-aa35-5a9d43dd0cc3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:24.460310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abcb2cdd-ec9f-4de1-aa35-5a9d43dd0cc3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:24.460725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abcb2cdd-ec9f-4de1-aa35-5a9d43dd0cc3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:24.610937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-abcb2cdd-ec9f-4de1-aa35-5a9d43dd0cc3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:24.619657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-abcb2cdd-ec9f-4de1-aa35-5a9d43dd0cc3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.172131 Aug 31 00:22:24.620290 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 175/310] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:24 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:25.451284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b00ed1b2-4743-448c-9d46-8780284a843c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:25.451889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b00ed1b2-4743-448c-9d46-8780284a843c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:25.458164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b00ed1b2-4743-448c-9d46-8780284a843c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.458642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b00ed1b2-4743-448c-9d46-8780284a843c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.459104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b00ed1b2-4743-448c-9d46-8780284a843c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:25.459797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b00ed1b2-4743-448c-9d46-8780284a843c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.460319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b00ed1b2-4743-448c-9d46-8780284a843c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.460731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b00ed1b2-4743-448c-9d46-8780284a843c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:25.597292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b00ed1b2-4743-448c-9d46-8780284a843c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:25.605642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b00ed1b2-4743-448c-9d46-8780284a843c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.158230 Aug 31 00:22:25.606289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 136/311] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:25 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:25.641665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3b98e79f-7096-48f2-96fa-f7cb32dc1586 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:25.642267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3b98e79f-7096-48f2-96fa-f7cb32dc1586 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:25.644224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=67 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:25.649917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b98e79f-7096-48f2-96fa-f7cb32dc1586 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.650399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b98e79f-7096-48f2-96fa-f7cb32dc1586 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.650824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b98e79f-7096-48f2-96fa-f7cb32dc1586 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:25.651532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b98e79f-7096-48f2-96fa-f7cb32dc1586 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.651975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b98e79f-7096-48f2-96fa-f7cb32dc1586 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.652390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b98e79f-7096-48f2-96fa-f7cb32dc1586 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:25.786206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3b98e79f-7096-48f2-96fa-f7cb32dc1586 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:25.794065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3b98e79f-7096-48f2-96fa-f7cb32dc1586 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.156594 Aug 31 00:22:25.794725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 176/312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:25 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:26.626944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ec80512c-c19b-4a1c-83c5-936461d2281b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:26.627580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ec80512c-c19b-4a1c-83c5-936461d2281b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:26.634300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec80512c-c19b-4a1c-83c5-936461d2281b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:26.634752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec80512c-c19b-4a1c-83c5-936461d2281b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:26.635352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec80512c-c19b-4a1c-83c5-936461d2281b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:26.636031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec80512c-c19b-4a1c-83c5-936461d2281b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:26.636477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec80512c-c19b-4a1c-83c5-936461d2281b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:26.636893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec80512c-c19b-4a1c-83c5-936461d2281b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:26.769105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ec80512c-c19b-4a1c-83c5-936461d2281b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:26.776867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ec80512c-c19b-4a1c-83c5-936461d2281b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.153716 Aug 31 00:22:26.777422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 137/313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:26 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:26.814770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8b697eee-1fd2-47ad-8a23-16ecaa4cfef5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:26.815412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8b697eee-1fd2-47ad-8a23-16ecaa4cfef5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:26.821824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b697eee-1fd2-47ad-8a23-16ecaa4cfef5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:26.822371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b697eee-1fd2-47ad-8a23-16ecaa4cfef5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:26.822789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b697eee-1fd2-47ad-8a23-16ecaa4cfef5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:26.823485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b697eee-1fd2-47ad-8a23-16ecaa4cfef5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:26.823915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b697eee-1fd2-47ad-8a23-16ecaa4cfef5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:26.824321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b697eee-1fd2-47ad-8a23-16ecaa4cfef5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:26.842915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:26.952835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8b697eee-1fd2-47ad-8a23-16ecaa4cfef5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:26.960440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8b697eee-1fd2-47ad-8a23-16ecaa4cfef5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.149416 Aug 31 00:22:26.960990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 177/314] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:26 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:27.798541 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a092fd29-14f7-4110-b5bf-87362f0d1627 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:27.799149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a092fd29-14f7-4110-b5bf-87362f0d1627 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:27.805599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a092fd29-14f7-4110-b5bf-87362f0d1627 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:27.806081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a092fd29-14f7-4110-b5bf-87362f0d1627 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:27.806505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a092fd29-14f7-4110-b5bf-87362f0d1627 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:27.807225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a092fd29-14f7-4110-b5bf-87362f0d1627 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:27.807674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a092fd29-14f7-4110-b5bf-87362f0d1627 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:27.808088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a092fd29-14f7-4110-b5bf-87362f0d1627 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:27.957027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a092fd29-14f7-4110-b5bf-87362f0d1627 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:27.965694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a092fd29-14f7-4110-b5bf-87362f0d1627 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.170998 Aug 31 00:22:27.966245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 138/315] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:27 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:27.981963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d64c26d8-9b92-4ca5-ad42-7289eb9d9d5c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:27.982565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d64c26d8-9b92-4ca5-ad42-7289eb9d9d5c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:27.988504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d64c26d8-9b92-4ca5-ad42-7289eb9d9d5c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:27.988981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d64c26d8-9b92-4ca5-ad42-7289eb9d9d5c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:27.989407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d64c26d8-9b92-4ca5-ad42-7289eb9d9d5c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:27.990083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d64c26d8-9b92-4ca5-ad42-7289eb9d9d5c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:27.990525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d64c26d8-9b92-4ca5-ad42-7289eb9d9d5c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:27.990938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d64c26d8-9b92-4ca5-ad42-7289eb9d9d5c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:28.120109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d64c26d8-9b92-4ca5-ad42-7289eb9d9d5c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:28.127582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d64c26d8-9b92-4ca5-ad42-7289eb9d9d5c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.150093 Aug 31 00:22:28.128146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 178/316] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:27 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:28.987113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aa9997ea-bce3-4683-8f3a-9cb2ea8b7855 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:28.987974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aa9997ea-bce3-4683-8f3a-9cb2ea8b7855 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:28.995709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa9997ea-bce3-4683-8f3a-9cb2ea8b7855 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:28.996525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa9997ea-bce3-4683-8f3a-9cb2ea8b7855 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:28.996765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa9997ea-bce3-4683-8f3a-9cb2ea8b7855 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:28.997452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa9997ea-bce3-4683-8f3a-9cb2ea8b7855 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:28.997894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa9997ea-bce3-4683-8f3a-9cb2ea8b7855 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:28.998331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa9997ea-bce3-4683-8f3a-9cb2ea8b7855 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:29.148594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-73b3a23c-ef9b-4c0e-8cc9-b3c5b7444d63 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:29.149199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-73b3a23c-ef9b-4c0e-8cc9-b3c5b7444d63 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:29.155624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73b3a23c-ef9b-4c0e-8cc9-b3c5b7444d63 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:29.156128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73b3a23c-ef9b-4c0e-8cc9-b3c5b7444d63 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:29.156555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73b3a23c-ef9b-4c0e-8cc9-b3c5b7444d63 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:29.157233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73b3a23c-ef9b-4c0e-8cc9-b3c5b7444d63 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:29.157675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73b3a23c-ef9b-4c0e-8cc9-b3c5b7444d63 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:29.158086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73b3a23c-ef9b-4c0e-8cc9-b3c5b7444d63 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:29.330636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aa9997ea-bce3-4683-8f3a-9cb2ea8b7855 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:29.339430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aa9997ea-bce3-4683-8f3a-9cb2ea8b7855 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.356036 Aug 31 00:22:29.340001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 139/317] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:28 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:29.342289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-73b3a23c-ef9b-4c0e-8cc9-b3c5b7444d63 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:29.350169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-73b3a23c-ef9b-4c0e-8cc9-b3c5b7444d63 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.205591 Aug 31 00:22:29.351257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 179/318] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:29 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:30.361316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c26740ba-e059-4032-ad0b-2907d9537f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:30.361922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c26740ba-e059-4032-ad0b-2907d9537f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:30.369021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c26740ba-e059-4032-ad0b-2907d9537f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:30.369796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c26740ba-e059-4032-ad0b-2907d9537f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:30.370236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c26740ba-e059-4032-ad0b-2907d9537f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:30.370928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c26740ba-e059-4032-ad0b-2907d9537f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:30.371405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c26740ba-e059-4032-ad0b-2907d9537f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:30.371828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c26740ba-e059-4032-ad0b-2907d9537f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:30.372369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e47322eb-155f-4819-87c3-fa97035cb682 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:30.372971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e47322eb-155f-4819-87c3-fa97035cb682 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:30.379234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e47322eb-155f-4819-87c3-fa97035cb682 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:30.379710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e47322eb-155f-4819-87c3-fa97035cb682 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:30.380137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e47322eb-155f-4819-87c3-fa97035cb682 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:30.380816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e47322eb-155f-4819-87c3-fa97035cb682 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:30.381259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e47322eb-155f-4819-87c3-fa97035cb682 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:30.381672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e47322eb-155f-4819-87c3-fa97035cb682 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:30.566173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c26740ba-e059-4032-ad0b-2907d9537f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:30.574548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c26740ba-e059-4032-ad0b-2907d9537f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.217039 Aug 31 00:22:30.575146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 140/319] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:30 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:30.577218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e47322eb-155f-4819-87c3-fa97035cb682 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:30.585019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e47322eb-155f-4819-87c3-fa97035cb682 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.217216 Aug 31 00:22:30.588829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 180/320] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:30 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:31.584667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6977ef63-6df0-4cab-96f0-08f8b6fa03e5 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:31.585162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6977ef63-6df0-4cab-96f0-08f8b6fa03e5 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:31.587556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:31.592321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6977ef63-6df0-4cab-96f0-08f8b6fa03e5 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:31.592867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6977ef63-6df0-4cab-96f0-08f8b6fa03e5 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:31.593306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6977ef63-6df0-4cab-96f0-08f8b6fa03e5 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.593999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6977ef63-6df0-4cab-96f0-08f8b6fa03e5 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:31.594447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6977ef63-6df0-4cab-96f0-08f8b6fa03e5 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:31.594862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6977ef63-6df0-4cab-96f0-08f8b6fa03e5 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.597632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-aca4c843-12df-42f0-895b-a147208e1e23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:31.598597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-aca4c843-12df-42f0-895b-a147208e1e23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:31.607467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aca4c843-12df-42f0-895b-a147208e1e23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:31.607810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aca4c843-12df-42f0-895b-a147208e1e23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:31.608641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aca4c843-12df-42f0-895b-a147208e1e23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.609333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aca4c843-12df-42f0-895b-a147208e1e23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:31.609775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aca4c843-12df-42f0-895b-a147208e1e23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:31.610186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aca4c843-12df-42f0-895b-a147208e1e23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.622939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6977ef63-6df0-4cab-96f0-08f8b6fa03e5 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:22:31.705197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6977ef63-6df0-4cab-96f0-08f8b6fa03e5 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 204 len: 0 microversion: 2.1 time: 0.123974 Aug 31 00:22:31.706005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 141/321] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:22:31 2022] DELETE /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:22:31.711718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a251c744-0602-4efc-b458-be1ad9b79994 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:31.712412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a251c744-0602-4efc-b458-be1ad9b79994 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:31.719157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a251c744-0602-4efc-b458-be1ad9b79994 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:31.719916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a251c744-0602-4efc-b458-be1ad9b79994 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:31.720425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a251c744-0602-4efc-b458-be1ad9b79994 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.721109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a251c744-0602-4efc-b458-be1ad9b79994 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:31.721558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a251c744-0602-4efc-b458-be1ad9b79994 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:31.721977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a251c744-0602-4efc-b458-be1ad9b79994 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.760466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-aca4c843-12df-42f0-895b-a147208e1e23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:31.769147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-aca4c843-12df-42f0-895b-a147208e1e23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.176459 Aug 31 00:22:31.770066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 181/322] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:31 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:31.774789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c1726a09-b275-4dcb-8d28-6cb7c44225e3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:31.775700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c1726a09-b275-4dcb-8d28-6cb7c44225e3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:31.782314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1726a09-b275-4dcb-8d28-6cb7c44225e3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:31.782826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1726a09-b275-4dcb-8d28-6cb7c44225e3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:31.783350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1726a09-b275-4dcb-8d28-6cb7c44225e3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.784109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1726a09-b275-4dcb-8d28-6cb7c44225e3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:31.784626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1726a09-b275-4dcb-8d28-6cb7c44225e3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:31.785138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1726a09-b275-4dcb-8d28-6cb7c44225e3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.912357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a251c744-0602-4efc-b458-be1ad9b79994 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:31.920772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a251c744-0602-4efc-b458-be1ad9b79994 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.213841 Aug 31 00:22:31.921384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 142/323] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:31 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:31.957551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c1726a09-b275-4dcb-8d28-6cb7c44225e3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:31.966022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c1726a09-b275-4dcb-8d28-6cb7c44225e3 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.194814 Aug 31 00:22:31.966583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 182/324] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:31 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:32.792103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bd6db167-7035-475f-95eb-57448e7a8084 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:32.792643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bd6db167-7035-475f-95eb-57448e7a8084 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:32.799276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6db167-7035-475f-95eb-57448e7a8084 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:32.799753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6db167-7035-475f-95eb-57448e7a8084 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:32.800183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6db167-7035-475f-95eb-57448e7a8084 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:32.800871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6db167-7035-475f-95eb-57448e7a8084 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:32.801317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6db167-7035-475f-95eb-57448e7a8084 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:32.801733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6db167-7035-475f-95eb-57448e7a8084 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:32.941835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bd6db167-7035-475f-95eb-57448e7a8084 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:32.942960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-caa64e6f-81a4-422d-ba90-1eac17aa0066 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:32.943588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-caa64e6f-81a4-422d-ba90-1eac17aa0066 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:32.950471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caa64e6f-81a4-422d-ba90-1eac17aa0066 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:32.950653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bd6db167-7035-475f-95eb-57448e7a8084 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.162558 Aug 31 00:22:32.950944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caa64e6f-81a4-422d-ba90-1eac17aa0066 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:32.951141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 143/325] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:32 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:32.951410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caa64e6f-81a4-422d-ba90-1eac17aa0066 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:32.952435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caa64e6f-81a4-422d-ba90-1eac17aa0066 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:32.952877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caa64e6f-81a4-422d-ba90-1eac17aa0066 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:32.953285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caa64e6f-81a4-422d-ba90-1eac17aa0066 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:32.987183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d91a56e3-ab0f-4d6f-b835-d3574b93bada tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:32.987824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d91a56e3-ab0f-4d6f-b835-d3574b93bada tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:32.995281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d91a56e3-ab0f-4d6f-b835-d3574b93bada tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:32.995841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d91a56e3-ab0f-4d6f-b835-d3574b93bada tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:32.996257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d91a56e3-ab0f-4d6f-b835-d3574b93bada tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:32.996958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d91a56e3-ab0f-4d6f-b835-d3574b93bada tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:32.997404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d91a56e3-ab0f-4d6f-b835-d3574b93bada tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:32.998206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d91a56e3-ab0f-4d6f-b835-d3574b93bada tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:33.134193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-caa64e6f-81a4-422d-ba90-1eac17aa0066 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:33.142901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-caa64e6f-81a4-422d-ba90-1eac17aa0066 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.203715 Aug 31 00:22:33.143501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 183/326] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:32 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:33.165128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d91a56e3-ab0f-4d6f-b835-d3574b93bada tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:33.173456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d91a56e3-ab0f-4d6f-b835-d3574b93bada tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.190075 Aug 31 00:22:33.174018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 144/327] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:32 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:33.972203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0061d7c7-1662-4529-baa8-cbe860adbb8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:33.972813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0061d7c7-1662-4529-baa8-cbe860adbb8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:33.979259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0061d7c7-1662-4529-baa8-cbe860adbb8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:33.979734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0061d7c7-1662-4529-baa8-cbe860adbb8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:33.980161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0061d7c7-1662-4529-baa8-cbe860adbb8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:33.980840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0061d7c7-1662-4529-baa8-cbe860adbb8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:33.981287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0061d7c7-1662-4529-baa8-cbe860adbb8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:33.981704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0061d7c7-1662-4529-baa8-cbe860adbb8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.113972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0061d7c7-1662-4529-baa8-cbe860adbb8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:34.122242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0061d7c7-1662-4529-baa8-cbe860adbb8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.153867 Aug 31 00:22:34.122925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 184/328] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:33 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:34.163623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6899550e-b17c-41f8-b38a-91f9c6e4b9c6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:34.164235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6899550e-b17c-41f8-b38a-91f9c6e4b9c6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:34.171362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6899550e-b17c-41f8-b38a-91f9c6e4b9c6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.171844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6899550e-b17c-41f8-b38a-91f9c6e4b9c6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.172272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6899550e-b17c-41f8-b38a-91f9c6e4b9c6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.172954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6899550e-b17c-41f8-b38a-91f9c6e4b9c6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.173412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6899550e-b17c-41f8-b38a-91f9c6e4b9c6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.173834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6899550e-b17c-41f8-b38a-91f9c6e4b9c6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.194094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c8083758-2eb2-4145-bacc-5e30b347aced tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:34.194692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c8083758-2eb2-4145-bacc-5e30b347aced tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:34.200508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c8083758-2eb2-4145-bacc-5e30b347aced tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.200986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c8083758-2eb2-4145-bacc-5e30b347aced tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.201414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c8083758-2eb2-4145-bacc-5e30b347aced tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.202096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c8083758-2eb2-4145-bacc-5e30b347aced tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.202538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c8083758-2eb2-4145-bacc-5e30b347aced tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.202955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c8083758-2eb2-4145-bacc-5e30b347aced tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.382683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6899550e-b17c-41f8-b38a-91f9c6e4b9c6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:34.387621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c8083758-2eb2-4145-bacc-5e30b347aced tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:34.393133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6899550e-b17c-41f8-b38a-91f9c6e4b9c6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.233242 Aug 31 00:22:34.393721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 145/329] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:34 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:34.397196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c8083758-2eb2-4145-bacc-5e30b347aced tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.206851 Aug 31 00:22:34.397754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 185/330] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:34 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:35.143547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7529ee49-155c-4f17-a792-0dcf3bb6ff95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:35.144149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7529ee49-155c-4f17-a792-0dcf3bb6ff95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:35.150006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7529ee49-155c-4f17-a792-0dcf3bb6ff95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.150481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7529ee49-155c-4f17-a792-0dcf3bb6ff95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.150909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7529ee49-155c-4f17-a792-0dcf3bb6ff95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.151617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7529ee49-155c-4f17-a792-0dcf3bb6ff95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.152067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7529ee49-155c-4f17-a792-0dcf3bb6ff95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.153115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7529ee49-155c-4f17-a792-0dcf3bb6ff95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.280938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7529ee49-155c-4f17-a792-0dcf3bb6ff95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:35.288700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7529ee49-155c-4f17-a792-0dcf3bb6ff95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.148999 Aug 31 00:22:35.289294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 146/331] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:35 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:35.416365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9ed4df47-57f9-4f53-b6a2-d556de72dfa7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:35.416894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9ed4df47-57f9-4f53-b6a2-d556de72dfa7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:35.417698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3e644c66-18e5-4080-8885-b5dbbcf4004f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:35.418884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3e644c66-18e5-4080-8885-b5dbbcf4004f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:35.423721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ed4df47-57f9-4f53-b6a2-d556de72dfa7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.424196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ed4df47-57f9-4f53-b6a2-d556de72dfa7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.424625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e644c66-18e5-4080-8885-b5dbbcf4004f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.424723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ed4df47-57f9-4f53-b6a2-d556de72dfa7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.425128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e644c66-18e5-4080-8885-b5dbbcf4004f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.425311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ed4df47-57f9-4f53-b6a2-d556de72dfa7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.425549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e644c66-18e5-4080-8885-b5dbbcf4004f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.425753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ed4df47-57f9-4f53-b6a2-d556de72dfa7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.426174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ed4df47-57f9-4f53-b6a2-d556de72dfa7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.426276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e644c66-18e5-4080-8885-b5dbbcf4004f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.426646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e644c66-18e5-4080-8885-b5dbbcf4004f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.427078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e644c66-18e5-4080-8885-b5dbbcf4004f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.622824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3e644c66-18e5-4080-8885-b5dbbcf4004f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:35.626756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9ed4df47-57f9-4f53-b6a2-d556de72dfa7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:35.631187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3e644c66-18e5-4080-8885-b5dbbcf4004f tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.217360 Aug 31 00:22:35.631765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 147/332] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:35 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:35.634643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9ed4df47-57f9-4f53-b6a2-d556de72dfa7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.222223 Aug 31 00:22:35.635216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 186/333] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:35 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:36.312425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f710d24b-6503-497e-868c-67da8b69af8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:36.313035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f710d24b-6503-497e-868c-67da8b69af8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:36.319303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f710d24b-6503-497e-868c-67da8b69af8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.319776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f710d24b-6503-497e-868c-67da8b69af8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.320199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f710d24b-6503-497e-868c-67da8b69af8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.320866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f710d24b-6503-497e-868c-67da8b69af8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.321309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f710d24b-6503-497e-868c-67da8b69af8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.321715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f710d24b-6503-497e-868c-67da8b69af8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.451512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f710d24b-6503-497e-868c-67da8b69af8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:36.459208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f710d24b-6503-497e-868c-67da8b69af8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.151769 Aug 31 00:22:36.459775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 148/334] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:36 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:36.654310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d565bc18-ff81-4218-b360-6eab68d90ce1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:36.655018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d565bc18-ff81-4218-b360-6eab68d90ce1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:36.656380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1f0c72cb-51dc-413d-8232-47a259eb6b42 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:36.656984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1f0c72cb-51dc-413d-8232-47a259eb6b42 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:36.660929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d565bc18-ff81-4218-b360-6eab68d90ce1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.661412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d565bc18-ff81-4218-b360-6eab68d90ce1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.661842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d565bc18-ff81-4218-b360-6eab68d90ce1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.662523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d565bc18-ff81-4218-b360-6eab68d90ce1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.662970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d565bc18-ff81-4218-b360-6eab68d90ce1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.663276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f0c72cb-51dc-413d-8232-47a259eb6b42 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.663419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d565bc18-ff81-4218-b360-6eab68d90ce1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.663752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f0c72cb-51dc-413d-8232-47a259eb6b42 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.664177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f0c72cb-51dc-413d-8232-47a259eb6b42 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.664889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f0c72cb-51dc-413d-8232-47a259eb6b42 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.665335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f0c72cb-51dc-413d-8232-47a259eb6b42 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.665746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f0c72cb-51dc-413d-8232-47a259eb6b42 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.860883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d565bc18-ff81-4218-b360-6eab68d90ce1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:36.871207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1f0c72cb-51dc-413d-8232-47a259eb6b42 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:36.873741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d565bc18-ff81-4218-b360-6eab68d90ce1 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.223881 Aug 31 00:22:36.874781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 187/335] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:36 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:36.889530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1f0c72cb-51dc-413d-8232-47a259eb6b42 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.237106 Aug 31 00:22:36.890375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 149/336] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:36 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:36.923557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-d3bf9a08-c6e0-4560-8baa-5563dcf85828 req-1722e6f9-836b-48b3-ba43-9130490ba54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17116ede-206d-478f-880b-b8054ccac135", "name": "network-vif-unplugged", "status": "completed", "tag": "f53b4304-5d8a-4043-b7d1-51a13d08011f"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:36.933431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d3bf9a08-c6e0-4560-8baa-5563dcf85828 req-1722e6f9-836b-48b3-ba43-9130490ba54b service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.933904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d3bf9a08-c6e0-4560-8baa-5563dcf85828 req-1722e6f9-836b-48b3-ba43-9130490ba54b service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.934349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d3bf9a08-c6e0-4560-8baa-5563dcf85828 req-1722e6f9-836b-48b3-ba43-9130490ba54b service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.945874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-d3bf9a08-c6e0-4560-8baa-5563dcf85828 req-1722e6f9-836b-48b3-ba43-9130490ba54b service nova] Creating event network-vif-unplugged:f53b4304-5d8a-4043-b7d1-51a13d08011f for instance 17116ede-206d-478f-880b-b8054ccac135 on hv-cinder-85506 Aug 31 00:22:36.951885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-d3bf9a08-c6e0-4560-8baa-5563dcf85828 req-1722e6f9-836b-48b3-ba43-9130490ba54b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032008 Aug 31 00:22:36.952959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 188/337] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:37.479961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-696a00f0-833b-42d0-8e03-fbc44fe6496e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:37.480690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-696a00f0-833b-42d0-8e03-fbc44fe6496e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:37.486792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-696a00f0-833b-42d0-8e03-fbc44fe6496e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:37.487303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-696a00f0-833b-42d0-8e03-fbc44fe6496e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:37.487735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-696a00f0-833b-42d0-8e03-fbc44fe6496e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:37.488427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-696a00f0-833b-42d0-8e03-fbc44fe6496e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:37.488876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-696a00f0-833b-42d0-8e03-fbc44fe6496e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:37.489296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-696a00f0-833b-42d0-8e03-fbc44fe6496e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:37.494318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:37.630127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-696a00f0-833b-42d0-8e03-fbc44fe6496e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:37.638570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-696a00f0-833b-42d0-8e03-fbc44fe6496e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.162446 Aug 31 00:22:37.639423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 150/338] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:37 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:37.898160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f3056c55-7a9e-41fe-8599-dc35d964e4da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:37.898928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f3056c55-7a9e-41fe-8599-dc35d964e4da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:37.906881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3056c55-7a9e-41fe-8599-dc35d964e4da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:37.906881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3056c55-7a9e-41fe-8599-dc35d964e4da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:37.907143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3056c55-7a9e-41fe-8599-dc35d964e4da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:37.907764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3056c55-7a9e-41fe-8599-dc35d964e4da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:37.908215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3056c55-7a9e-41fe-8599-dc35d964e4da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:37.908665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3056c55-7a9e-41fe-8599-dc35d964e4da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:37.914528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-347e8305-bca5-4def-8c42-e4f434d7c611 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:37.915418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-347e8305-bca5-4def-8c42-e4f434d7c611 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:37.925920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-347e8305-bca5-4def-8c42-e4f434d7c611 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:37.926416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-347e8305-bca5-4def-8c42-e4f434d7c611 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:37.926851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-347e8305-bca5-4def-8c42-e4f434d7c611 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:37.927590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-347e8305-bca5-4def-8c42-e4f434d7c611 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:37.928193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-347e8305-bca5-4def-8c42-e4f434d7c611 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:37.928767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-347e8305-bca5-4def-8c42-e4f434d7c611 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.131713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3056c55-7a9e-41fe-8599-dc35d964e4da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.138347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-347e8305-bca5-4def-8c42-e4f434d7c611 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.141427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f3056c55-7a9e-41fe-8599-dc35d964e4da tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.247534 Aug 31 00:22:38.142085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 189/339] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:37 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:38.151575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-347e8305-bca5-4def-8c42-e4f434d7c611 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.239490 Aug 31 00:22:38.151575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 151/340] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:37 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:38.660031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b9ff8b39-c16e-43f7-aeac-725079bf6d73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:38.660627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b9ff8b39-c16e-43f7-aeac-725079bf6d73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:38.666436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9ff8b39-c16e-43f7-aeac-725079bf6d73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:38.666911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9ff8b39-c16e-43f7-aeac-725079bf6d73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:38.667362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9ff8b39-c16e-43f7-aeac-725079bf6d73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.668579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9ff8b39-c16e-43f7-aeac-725079bf6d73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:38.669304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9ff8b39-c16e-43f7-aeac-725079bf6d73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:38.669727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9ff8b39-c16e-43f7-aeac-725079bf6d73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.797798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b9ff8b39-c16e-43f7-aeac-725079bf6d73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.805377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b9ff8b39-c16e-43f7-aeac-725079bf6d73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.149251 Aug 31 00:22:38.805995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 190/341] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:38 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:39.163477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f2051701-1250-4188-9e06-50f3b9d46f0b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:39.164082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f2051701-1250-4188-9e06-50f3b9d46f0b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:39.170396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-43e79ae7-5817-4a28-aa09-108cc81e3993 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:39.170998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-43e79ae7-5817-4a28-aa09-108cc81e3993 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:39.171830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2051701-1250-4188-9e06-50f3b9d46f0b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.172321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2051701-1250-4188-9e06-50f3b9d46f0b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:39.172757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2051701-1250-4188-9e06-50f3b9d46f0b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:39.173449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2051701-1250-4188-9e06-50f3b9d46f0b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.173905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2051701-1250-4188-9e06-50f3b9d46f0b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:39.174331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2051701-1250-4188-9e06-50f3b9d46f0b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:39.176780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43e79ae7-5817-4a28-aa09-108cc81e3993 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.177250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43e79ae7-5817-4a28-aa09-108cc81e3993 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:39.177680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43e79ae7-5817-4a28-aa09-108cc81e3993 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:39.178355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43e79ae7-5817-4a28-aa09-108cc81e3993 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.178800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43e79ae7-5817-4a28-aa09-108cc81e3993 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:39.179251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43e79ae7-5817-4a28-aa09-108cc81e3993 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:39.367098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f2051701-1250-4188-9e06-50f3b9d46f0b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:39.371201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-43e79ae7-5817-4a28-aa09-108cc81e3993 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:39.375500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f2051701-1250-4188-9e06-50f3b9d46f0b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.216047 Aug 31 00:22:39.376073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 152/342] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:39 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:39.379898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-43e79ae7-5817-4a28-aa09-108cc81e3993 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.214171 Aug 31 00:22:39.380456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 191/343] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:39 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:39.828151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6523edeb-bc42-4853-b4ab-6cf301d5a5e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:39.828757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6523edeb-bc42-4853-b4ab-6cf301d5a5e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:39.834602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6523edeb-bc42-4853-b4ab-6cf301d5a5e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.835106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6523edeb-bc42-4853-b4ab-6cf301d5a5e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:39.835542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6523edeb-bc42-4853-b4ab-6cf301d5a5e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:39.836222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6523edeb-bc42-4853-b4ab-6cf301d5a5e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.836672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6523edeb-bc42-4853-b4ab-6cf301d5a5e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:39.837090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6523edeb-bc42-4853-b4ab-6cf301d5a5e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:39.969095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6523edeb-bc42-4853-b4ab-6cf301d5a5e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:39.977152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6523edeb-bc42-4853-b4ab-6cf301d5a5e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.153578 Aug 31 00:22:39.977734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 153/344] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:39 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:40.397677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5b7e1cd5-75a5-42a3-9ebf-c0e687e2138b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:40.398583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5b7e1cd5-75a5-42a3-9ebf-c0e687e2138b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:40.401860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a043c818-7ca0-4589-a608-91201f2a8780 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:40.402971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a043c818-7ca0-4589-a608-91201f2a8780 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:40.405271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7e1cd5-75a5-42a3-9ebf-c0e687e2138b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.405754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7e1cd5-75a5-42a3-9ebf-c0e687e2138b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.406195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7e1cd5-75a5-42a3-9ebf-c0e687e2138b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.406870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7e1cd5-75a5-42a3-9ebf-c0e687e2138b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.407345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7e1cd5-75a5-42a3-9ebf-c0e687e2138b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.407764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b7e1cd5-75a5-42a3-9ebf-c0e687e2138b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.409394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a043c818-7ca0-4589-a608-91201f2a8780 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.409876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a043c818-7ca0-4589-a608-91201f2a8780 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.410306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a043c818-7ca0-4589-a608-91201f2a8780 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.410996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a043c818-7ca0-4589-a608-91201f2a8780 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.411467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a043c818-7ca0-4589-a608-91201f2a8780 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.411886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a043c818-7ca0-4589-a608-91201f2a8780 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.599501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5b7e1cd5-75a5-42a3-9ebf-c0e687e2138b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:40.609810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5b7e1cd5-75a5-42a3-9ebf-c0e687e2138b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.216524 Aug 31 00:22:40.613165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 192/345] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:40 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:40.613305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a043c818-7ca0-4589-a608-91201f2a8780 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:40.620946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a043c818-7ca0-4589-a608-91201f2a8780 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.222949 Aug 31 00:22:40.621562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 154/346] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:40 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:41.001551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6dd07cea-c880-4af6-9d42-5964b5612fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:41.002159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6dd07cea-c880-4af6-9d42-5964b5612fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:41.008086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dd07cea-c880-4af6-9d42-5964b5612fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.008561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dd07cea-c880-4af6-9d42-5964b5612fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.008996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dd07cea-c880-4af6-9d42-5964b5612fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.009670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dd07cea-c880-4af6-9d42-5964b5612fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.010115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dd07cea-c880-4af6-9d42-5964b5612fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.010532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dd07cea-c880-4af6-9d42-5964b5612fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.144599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6dd07cea-c880-4af6-9d42-5964b5612fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:41.152218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6dd07cea-c880-4af6-9d42-5964b5612fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.154752 Aug 31 00:22:41.153058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 193/347] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:40 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:41.629726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed2dfd1e-7078-4077-9815-5274fe4900ba tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:41.630331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ed2dfd1e-7078-4077-9815-5274fe4900ba tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:41.636915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2dfd1e-7078-4077-9815-5274fe4900ba tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.637398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2dfd1e-7078-4077-9815-5274fe4900ba tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.637832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2dfd1e-7078-4077-9815-5274fe4900ba tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.638556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2dfd1e-7078-4077-9815-5274fe4900ba tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.639388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2dfd1e-7078-4077-9815-5274fe4900ba tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.639810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2dfd1e-7078-4077-9815-5274fe4900ba tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.643412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9001e822-3795-4b02-9d8b-d613694b9192 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:41.644372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9001e822-3795-4b02-9d8b-d613694b9192 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:41.652729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9001e822-3795-4b02-9d8b-d613694b9192 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.653431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9001e822-3795-4b02-9d8b-d613694b9192 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.654065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9001e822-3795-4b02-9d8b-d613694b9192 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.655118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9001e822-3795-4b02-9d8b-d613694b9192 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.655823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9001e822-3795-4b02-9d8b-d613694b9192 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.656445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9001e822-3795-4b02-9d8b-d613694b9192 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.835098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ed2dfd1e-7078-4077-9815-5274fe4900ba tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:41.842806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9001e822-3795-4b02-9d8b-d613694b9192 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:41.843819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ed2dfd1e-7078-4077-9815-5274fe4900ba tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.217915 Aug 31 00:22:41.843819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 155/348] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:41 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:41.846600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:41.850913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9001e822-3795-4b02-9d8b-d613694b9192 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.213216 Aug 31 00:22:41.851941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 194/349] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:41 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:42.172889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a96d49eb-84fb-4bbc-bf1d-a1c4e7f2db6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:42.173422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a96d49eb-84fb-4bbc-bf1d-a1c4e7f2db6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:42.179367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a96d49eb-84fb-4bbc-bf1d-a1c4e7f2db6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.179872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a96d49eb-84fb-4bbc-bf1d-a1c4e7f2db6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.180303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a96d49eb-84fb-4bbc-bf1d-a1c4e7f2db6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:42.180979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a96d49eb-84fb-4bbc-bf1d-a1c4e7f2db6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.181426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a96d49eb-84fb-4bbc-bf1d-a1c4e7f2db6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.181843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a96d49eb-84fb-4bbc-bf1d-a1c4e7f2db6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:42.307121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a96d49eb-84fb-4bbc-bf1d-a1c4e7f2db6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:42.314734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a96d49eb-84fb-4bbc-bf1d-a1c4e7f2db6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.145830 Aug 31 00:22:42.315332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 156/350] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:42 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:42.868264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b8188114-7ce9-4f6d-b063-11ba90c81e81 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:42.869605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b8188114-7ce9-4f6d-b063-11ba90c81e81 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:42.873079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e86a6bdc-0520-41b9-a564-0057f1c0a302 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:42.874426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e86a6bdc-0520-41b9-a564-0057f1c0a302 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:42.880730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8188114-7ce9-4f6d-b063-11ba90c81e81 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.881229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8188114-7ce9-4f6d-b063-11ba90c81e81 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.881660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8188114-7ce9-4f6d-b063-11ba90c81e81 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:42.882511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e86a6bdc-0520-41b9-a564-0057f1c0a302 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.882753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8188114-7ce9-4f6d-b063-11ba90c81e81 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.883256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8188114-7ce9-4f6d-b063-11ba90c81e81 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.883621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e86a6bdc-0520-41b9-a564-0057f1c0a302 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.883760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8188114-7ce9-4f6d-b063-11ba90c81e81 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:42.884574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e86a6bdc-0520-41b9-a564-0057f1c0a302 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:42.885868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e86a6bdc-0520-41b9-a564-0057f1c0a302 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.886686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e86a6bdc-0520-41b9-a564-0057f1c0a302 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.887325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e86a6bdc-0520-41b9-a564-0057f1c0a302 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:43.252112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b8188114-7ce9-4f6d-b063-11ba90c81e81 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.260513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e86a6bdc-0520-41b9-a564-0057f1c0a302 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.262698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b8188114-7ce9-4f6d-b063-11ba90c81e81 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.398518 Aug 31 00:22:43.264659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 195/351] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:42 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:43.270912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e86a6bdc-0520-41b9-a564-0057f1c0a302 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1503 microversion: 2.1 time: 0.402380 Aug 31 00:22:43.283562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 157/352] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:42 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:43.336111 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e762cde9-9863-4fa7-9312-e38482cfa84f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:43.336938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e762cde9-9863-4fa7-9312-e38482cfa84f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:43.344295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e762cde9-9863-4fa7-9312-e38482cfa84f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:43.348180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e762cde9-9863-4fa7-9312-e38482cfa84f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:43.348837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e762cde9-9863-4fa7-9312-e38482cfa84f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:43.349568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e762cde9-9863-4fa7-9312-e38482cfa84f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:43.350179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e762cde9-9863-4fa7-9312-e38482cfa84f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:43.350926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e762cde9-9863-4fa7-9312-e38482cfa84f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:43.556823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e762cde9-9863-4fa7-9312-e38482cfa84f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.565759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e762cde9-9863-4fa7-9312-e38482cfa84f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.233543 Aug 31 00:22:43.566692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 196/353] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:43 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:43.734320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-18060517-dace-4ab2-8f89-e9ada7f769d0 req-c40f9df4-1763-4795-aded-e045f7b35815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17116ede-206d-478f-880b-b8054ccac135", "name": "network-vif-deleted", "tag": "f53b4304-5d8a-4043-b7d1-51a13d08011f"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:43.743834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-18060517-dace-4ab2-8f89-e9ada7f769d0 req-c40f9df4-1763-4795-aded-e045f7b35815 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:43.744312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-18060517-dace-4ab2-8f89-e9ada7f769d0 req-c40f9df4-1763-4795-aded-e045f7b35815 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:43.744725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-18060517-dace-4ab2-8f89-e9ada7f769d0 req-c40f9df4-1763-4795-aded-e045f7b35815 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:43.755893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-18060517-dace-4ab2-8f89-e9ada7f769d0 req-c40f9df4-1763-4795-aded-e045f7b35815 service nova] Creating event network-vif-deleted:f53b4304-5d8a-4043-b7d1-51a13d08011f for instance 17116ede-206d-478f-880b-b8054ccac135 on hv-cinder-85506 Aug 31 00:22:43.760848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-18060517-dace-4ab2-8f89-e9ada7f769d0 req-c40f9df4-1763-4795-aded-e045f7b35815 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031111 Aug 31 00:22:43.761434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 158/354] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:44.284801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fae45116-a31c-416f-b63b-374af937d904 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:44.285331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fae45116-a31c-416f-b63b-374af937d904 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:44.291385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fae45116-a31c-416f-b63b-374af937d904 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.291885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fae45116-a31c-416f-b63b-374af937d904 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.292308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fae45116-a31c-416f-b63b-374af937d904 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.292986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fae45116-a31c-416f-b63b-374af937d904 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.293432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fae45116-a31c-416f-b63b-374af937d904 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.293844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fae45116-a31c-416f-b63b-374af937d904 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.295322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eadc4299-fc43-4830-b55b-10f673acc0d9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:44.295993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eadc4299-fc43-4830-b55b-10f673acc0d9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:44.302516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadc4299-fc43-4830-b55b-10f673acc0d9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.303000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadc4299-fc43-4830-b55b-10f673acc0d9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.303455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadc4299-fc43-4830-b55b-10f673acc0d9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.304157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadc4299-fc43-4830-b55b-10f673acc0d9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.304606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadc4299-fc43-4830-b55b-10f673acc0d9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.305023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadc4299-fc43-4830-b55b-10f673acc0d9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.390707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eadc4299-fc43-4830-b55b-10f673acc0d9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.409309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eadc4299-fc43-4830-b55b-10f673acc0d9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1461 microversion: 2.1 time: 0.119450 Aug 31 00:22:44.409894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 159/355] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:44 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1461 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:44.497989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fae45116-a31c-416f-b63b-374af937d904 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.526477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fae45116-a31c-416f-b63b-374af937d904 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.245547 Aug 31 00:22:44.527288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 197/356] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:44 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:44.587818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-31b960bd-8bce-495d-a285-6391b23788df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:44.588423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-31b960bd-8bce-495d-a285-6391b23788df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:44.594429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31b960bd-8bce-495d-a285-6391b23788df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.594903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31b960bd-8bce-495d-a285-6391b23788df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.595437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31b960bd-8bce-495d-a285-6391b23788df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.596116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31b960bd-8bce-495d-a285-6391b23788df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.596563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31b960bd-8bce-495d-a285-6391b23788df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.596978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31b960bd-8bce-495d-a285-6391b23788df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.726398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-31b960bd-8bce-495d-a285-6391b23788df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.734712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-31b960bd-8bce-495d-a285-6391b23788df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.150735 Aug 31 00:22:44.735321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 160/357] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:44 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:45.430515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:45.431140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:45.437145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.437620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.438049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.438722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.439192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.439611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.471333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.471800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.472254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.472686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lazy-loading 'fault' on Instance uuid 17116ede-206d-478f-880b-b8054ccac135 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:22:45.515389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:45.522864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e06a76c4-5266-4835-b32c-6425c78f3603 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1304 microversion: 2.1 time: 0.096217 Aug 31 00:22:45.523444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 198/358] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:45 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:45.547473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-585444be-8c34-4242-8d75-ef9ffa319af8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:45.548088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-585444be-8c34-4242-8d75-ef9ffa319af8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:45.554491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-585444be-8c34-4242-8d75-ef9ffa319af8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.554976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-585444be-8c34-4242-8d75-ef9ffa319af8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.555453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-585444be-8c34-4242-8d75-ef9ffa319af8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.556199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-585444be-8c34-4242-8d75-ef9ffa319af8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.556594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-585444be-8c34-4242-8d75-ef9ffa319af8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.557014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-585444be-8c34-4242-8d75-ef9ffa319af8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.696644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-585444be-8c34-4242-8d75-ef9ffa319af8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:45.705868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-585444be-8c34-4242-8d75-ef9ffa319af8 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.162583 Aug 31 00:22:45.706432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 161/359] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:45 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:45.755692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f4d306ea-a1bb-4511-b854-b0c2effd34ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:45.756288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f4d306ea-a1bb-4511-b854-b0c2effd34ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:45.762087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4d306ea-a1bb-4511-b854-b0c2effd34ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.762555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4d306ea-a1bb-4511-b854-b0c2effd34ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.762976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4d306ea-a1bb-4511-b854-b0c2effd34ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.764481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4d306ea-a1bb-4511-b854-b0c2effd34ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.764927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4d306ea-a1bb-4511-b854-b0c2effd34ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.765339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4d306ea-a1bb-4511-b854-b0c2effd34ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.903356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f4d306ea-a1bb-4511-b854-b0c2effd34ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:45.911329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f4d306ea-a1bb-4511-b854-b0c2effd34ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.159358 Aug 31 00:22:45.911944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 199/360] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:45 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:46.547328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:46.547948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.554037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.554520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.554938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.555695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.556088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.556498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.587711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.588203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.588635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.589093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lazy-loading 'fault' on Instance uuid 17116ede-206d-478f-880b-b8054ccac135 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:22:46.645124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.653304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5677f26f-4f6b-4535-888b-945e8a558540 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 200 len: 1304 microversion: 2.1 time: 0.112273 Aug 31 00:22:46.654669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 162/361] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:46 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:46.726026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a719193d-98f0-452e-962f-928080aeb433 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:46.726646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a719193d-98f0-452e-962f-928080aeb433 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.732737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a719193d-98f0-452e-962f-928080aeb433 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.733218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a719193d-98f0-452e-962f-928080aeb433 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.733642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a719193d-98f0-452e-962f-928080aeb433 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.734511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a719193d-98f0-452e-962f-928080aeb433 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.735183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a719193d-98f0-452e-962f-928080aeb433 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.735607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a719193d-98f0-452e-962f-928080aeb433 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.934514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1e6d8155-f9bf-4b07-8ff7-46a1dbf4207b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:46.935895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1e6d8155-f9bf-4b07-8ff7-46a1dbf4207b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.947633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6d8155-f9bf-4b07-8ff7-46a1dbf4207b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.949110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6d8155-f9bf-4b07-8ff7-46a1dbf4207b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.954918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6d8155-f9bf-4b07-8ff7-46a1dbf4207b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.955958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6d8155-f9bf-4b07-8ff7-46a1dbf4207b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.957373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6d8155-f9bf-4b07-8ff7-46a1dbf4207b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.959197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6d8155-f9bf-4b07-8ff7-46a1dbf4207b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.966195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a719193d-98f0-452e-962f-928080aeb433 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:47.009017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a719193d-98f0-452e-962f-928080aeb433 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1552 microversion: 2.1 time: 0.284865 Aug 31 00:22:47.012449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 200/362] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:46 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1552 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:47.447024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1e6d8155-f9bf-4b07-8ff7-46a1dbf4207b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:47.459707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1e6d8155-f9bf-4b07-8ff7-46a1dbf4207b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1521 microversion: 2.1 time: 0.529172 Aug 31 00:22:47.461612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 163/363] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:46 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1521 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:47.675670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:47.676424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: 17116ede-206d-478f-880b-b8054ccac135] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:47.682927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.684081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.685544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.686742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.687392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.687817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.700138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-d229fe2e-8828-4e2f-8948-258dce0fb626 req-eaa68383-0a74-4502-8910-d9c8ae3b1252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2cfd30-5052-44b3-8237-9a4be97fc51e", "name": "network-vif-deleted", "tag": "e37680ba-ffb5-455c-94ed-561aea176f93"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:47.709483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] HTTP exception thrown: Instance 17116ede-206d-478f-880b-b8054ccac135 could not be found. Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Request method failure captured: Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 HTTP/1.1 Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqmHSNagBRFmK3pv0aElC4zYWTOPszHfNkl6lI1ePtbpa2jWhGsil54sAA8hzZrEOZhZFuDSMvo7P3IuNeXjP6XQF7igv8MYUNg2qwJKhjlffSxnUMIGEnHtar5tuWvakgiStLXvns86jU9koRz-uJaF1T8640-faSHWXVzR5Neyf64 Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: d94c6a3ef756488eac765456d78ff335 Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesActionsTest-2109410617 Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:22:47.714497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d94c6a3ef756488eac765456d78ff335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d94c6a3ef756488eac765456d78ff335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d94c6a3ef756488eac765456d78ff335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d94c6a3ef756488eac765456d78ff335", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesActionsTest-2109410617 Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: d94c6a3ef756488eac765456d78ff335 Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesActionsTest-2109410617 Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesActionsTest-2109410617-project Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 95e5a1b739a54c3aa4dcb53e5bbe0452 Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesActionsTest-2109410617-project Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance 17116ede-206d-478f-880b-b8054ccac135 could not be found. Aug 31 00:22:47.715873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '17116ede-206d-478f-880b-b8054ccac135'} Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17116ede-206d-478f-880b-b8054ccac135 could not be found. Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:47.717495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17116ede-206d-478f-880b-b8054ccac135 could not be found. Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17116ede-206d-478f-880b-b8054ccac135 could not be found. Aug 31 00:22:47.718977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:47.722722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Returning 404 to user: Instance 17116ede-206d-478f-880b-b8054ccac135 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:47.722867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-d229fe2e-8828-4e2f-8948-258dce0fb626 req-eaa68383-0a74-4502-8910-d9c8ae3b1252 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.723020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c03d5f58-ba0a-45e8-b84a-f19b0d45a321 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135" status: 404 len: 111 microversion: 2.1 time: 0.044123 Aug 31 00:22:47.723196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-d229fe2e-8828-4e2f-8948-258dce0fb626 req-eaa68383-0a74-4502-8910-d9c8ae3b1252 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.723196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-d229fe2e-8828-4e2f-8948-258dce0fb626 req-eaa68383-0a74-4502-8910-d9c8ae3b1252 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.734149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 201/364] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:47 2022] GET /compute/v2.1/servers/17116ede-206d-478f-880b-b8054ccac135 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:47.738640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-d229fe2e-8828-4e2f-8948-258dce0fb626 req-eaa68383-0a74-4502-8910-d9c8ae3b1252 service nova] Creating event network-vif-deleted:e37680ba-ffb5-455c-94ed-561aea176f93 for instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e on hv-cinder-85506 Aug 31 00:22:47.748692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-d229fe2e-8828-4e2f-8948-258dce0fb626 req-eaa68383-0a74-4502-8910-d9c8ae3b1252 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052392 Aug 31 00:22:47.749296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 164/365] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:47.869930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1840371917", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "networks": [{"uuid": "854828e6-33d4-4798-897d-8d0eac09d5f6"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:47.942152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] validate_networks() for [('854828e6-33d4-4798-897d-8d0eac09d5f6', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:22:48.034400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-648abaf6-ccb4-4e3e-9058-6bb8823fcb90 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:48.035202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-648abaf6-ccb4-4e3e-9058-6bb8823fcb90 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:48.041851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-648abaf6-ccb4-4e3e-9058-6bb8823fcb90 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.043239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-648abaf6-ccb4-4e3e-9058-6bb8823fcb90 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.043441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-648abaf6-ccb4-4e3e-9058-6bb8823fcb90 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.044008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-648abaf6-ccb4-4e3e-9058-6bb8823fcb90 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.044557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-648abaf6-ccb4-4e3e-9058-6bb8823fcb90 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.044930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-648abaf6-ccb4-4e3e-9058-6bb8823fcb90 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.151944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-648abaf6-ccb4-4e3e-9058-6bb8823fcb90 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10b50451d4b48f0b2377626ed609de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788926197c5042b99931f959426cff47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:48.162395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-648abaf6-ccb4-4e3e-9058-6bb8823fcb90 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 200 len: 1345 microversion: 2.1 time: 0.131907 Aug 31 00:22:48.176591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 165/366] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:48 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 1345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:48.337623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:22:48.338039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:22:48.338491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:22:48.338883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:22:48.339437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:22:48.348975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.349451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.349871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.350574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.351014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.351454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.370513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Getting quotas for project d94c6a3ef756488eac765456d78ff335. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:22:48.375657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Getting quotas for user 95e5a1b739a54c3aa4dcb53e5bbe0452 and project d94c6a3ef756488eac765456d78ff335. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:22:48.386964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:22:48.389678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:22:48.449002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-30d5d464-3538-4ac2-a0f8-58e87afb235b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584440 Aug 31 00:22:48.455705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 202/367] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:22:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:22:48.462104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-387b8c37-2de6-4ee7-aa19-baacaf3db3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:48.464013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-387b8c37-2de6-4ee7-aa19-baacaf3db3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:48.486053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-92c8df9f-9224-41d3-b612-34c4b761cc12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:48.487136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-92c8df9f-9224-41d3-b612-34c4b761cc12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:48.494128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c8df9f-9224-41d3-b612-34c4b761cc12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.494734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c8df9f-9224-41d3-b612-34c4b761cc12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.495541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c8df9f-9224-41d3-b612-34c4b761cc12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.496765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c8df9f-9224-41d3-b612-34c4b761cc12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.498577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c8df9f-9224-41d3-b612-34c4b761cc12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.499266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c8df9f-9224-41d3-b612-34c4b761cc12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.525209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-387b8c37-2de6-4ee7-aa19-baacaf3db3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:48.536909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-387b8c37-2de6-4ee7-aa19-baacaf3db3c7 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1214 microversion: 2.1 time: 0.078728 Aug 31 00:22:48.539615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 166/368] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:48 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:48.827534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-92c8df9f-9224-41d3-b612-34c4b761cc12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:48.836751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-92c8df9f-9224-41d3-b612-34c4b761cc12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1501 microversion: 2.1 time: 0.358197 Aug 31 00:22:48.837917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 203/369] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:48 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1501 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:48.859595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a5e223ff-8fe0-4463-a36d-7ae21afb3439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:48.861020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a5e223ff-8fe0-4463-a36d-7ae21afb3439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:48.873567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5e223ff-8fe0-4463-a36d-7ae21afb3439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.874294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5e223ff-8fe0-4463-a36d-7ae21afb3439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.874886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5e223ff-8fe0-4463-a36d-7ae21afb3439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.875823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5e223ff-8fe0-4463-a36d-7ae21afb3439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.876461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5e223ff-8fe0-4463-a36d-7ae21afb3439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.878943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5e223ff-8fe0-4463-a36d-7ae21afb3439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.139760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a5e223ff-8fe0-4463-a36d-7ae21afb3439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.147965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a5e223ff-8fe0-4463-a36d-7ae21afb3439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1515 microversion: 2.1 time: 0.292252 Aug 31 00:22:49.148536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 167/370] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:48 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1515 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:49.189811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:49.190701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:49.197997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.198664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.199188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.199947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.200588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.201535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.219144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] HTTP exception thrown: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Request method failure captured: Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e HTTP/1.1 Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlXiC6_q0qD8S2cYCfLC7RO_qihT4Ndii-haFV-rscSBD1I1Toqqr6VZTLI-TQUqomDKroaBQrjmsPsa3uktr3galdwuKlpakK8R2-OmrmQ3HbEdEIH9tXJv4dqODJ-Ji1k-lZz6Uzrd4L5lAL5BcozJr6I91bU2213xa7YiTSET8s Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 788926197c5042b99931f959426cff47 Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:22:49.221816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/788926197c5042b99931f959426cff47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/788926197c5042b99931f959426cff47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/788926197c5042b99931f959426cff47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_788926197c5042b99931f959426cff47", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 788926197c5042b99931f959426cff47 Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-DeleteServersTestJSON-866613037-project Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: d10b50451d4b48f0b2377626ed609de4 Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-DeleteServersTestJSON-866613037-project Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:49.223316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '5d2cfd30-5052-44b3-8237-9a4be97fc51e'} Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:49.224182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:49.225488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:49.228251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Returning 404 to user: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:49.229078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ac2b0341-b115-46e2-bf2a-a5ed48b5453b tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 404 len: 111 microversion: 2.1 time: 0.048968 Aug 31 00:22:49.229868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 204/371] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:49 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:49.366315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:49.376637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:49.397579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.398089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.400679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.403025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.404838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.405292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.440745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] HTTP exception thrown: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Request method failure captured: Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e/os-volume_attachments HTTP/1.1 Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlXiC6_q0qD8S2cYCfLC7RO_qihT4Ndii-haFV-rscSBD1I1Toqqr6VZTLI-TQUqomDKroaBQrjmsPsa3uktr3galdwuKlpakK8R2-OmrmQ3HbEdEIH9tXJv4dqODJ-Ji1k-lZz6Uzrd4L5lAL5BcozJr6I91bU2213xa7YiTSET8s Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 788926197c5042b99931f959426cff47 Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:22:49.449018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/788926197c5042b99931f959426cff47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/788926197c5042b99931f959426cff47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/788926197c5042b99931f959426cff47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_788926197c5042b99931f959426cff47", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 788926197c5042b99931f959426cff47 Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-DeleteServersTestJSON-866613037-project Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: d10b50451d4b48f0b2377626ed609de4 Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-DeleteServersTestJSON-866613037-project Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:49.450310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '5d2cfd30-5052-44b3-8237-9a4be97fc51e'} Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:49.452434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:49.453491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:22:49.456684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Returning 404 to user: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:49.457955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-831690ba-7002-4634-8f89-e2c5349f3999 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.097336 Aug 31 00:22:49.459092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 168/372] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:22:49 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e/os-volume_attachments => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:49.572887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3b3d0cd4-873d-427e-b39d-d9e4fc34c4d4 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:49.573799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3b3d0cd4-873d-427e-b39d-d9e4fc34c4d4 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:49.590905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b3d0cd4-873d-427e-b39d-d9e4fc34c4d4 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.593224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b3d0cd4-873d-427e-b39d-d9e4fc34c4d4 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.593879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b3d0cd4-873d-427e-b39d-d9e4fc34c4d4 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.595668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b3d0cd4-873d-427e-b39d-d9e4fc34c4d4 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.597578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b3d0cd4-873d-427e-b39d-d9e4fc34c4d4 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.599098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b3d0cd4-873d-427e-b39d-d9e4fc34c4d4 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.711170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3b3d0cd4-873d-427e-b39d-d9e4fc34c4d4 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.725028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3b3d0cd4-873d-427e-b39d-d9e4fc34c4d4 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1266 microversion: 2.1 time: 0.159262 Aug 31 00:22:49.725616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 205/373] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:49 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:50.752661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0d85893b-3b7e-418c-a8ea-2cacdf279f0e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:50.754711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0d85893b-3b7e-418c-a8ea-2cacdf279f0e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:50.760100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d85893b-3b7e-418c-a8ea-2cacdf279f0e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.760410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d85893b-3b7e-418c-a8ea-2cacdf279f0e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.760821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d85893b-3b7e-418c-a8ea-2cacdf279f0e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.761508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d85893b-3b7e-418c-a8ea-2cacdf279f0e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.762307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d85893b-3b7e-418c-a8ea-2cacdf279f0e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.762869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d85893b-3b7e-418c-a8ea-2cacdf279f0e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.790417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:50.856162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0d85893b-3b7e-418c-a8ea-2cacdf279f0e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.866325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0d85893b-3b7e-418c-a8ea-2cacdf279f0e tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1272 microversion: 2.1 time: 0.118807 Aug 31 00:22:50.866898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 169/374] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:50 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:51.777856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-16188bfd-969b-4d2d-8f7c-cccc4f525df7 req-0ff2ad89-8553-468c-a313-013bbd607f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df50fb74-c0ba-4741-95e4-8cae91fac7dd", "tag": "283b37e6-36c4-4137-bd93-b317149a34f3"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:51.805778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-16188bfd-969b-4d2d-8f7c-cccc4f525df7 req-0ff2ad89-8553-468c-a313-013bbd607f2d service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.806367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-16188bfd-969b-4d2d-8f7c-cccc4f525df7 req-0ff2ad89-8553-468c-a313-013bbd607f2d service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.806789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-16188bfd-969b-4d2d-8f7c-cccc4f525df7 req-0ff2ad89-8553-468c-a313-013bbd607f2d service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.816878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-46fd37aa-bd48-4a9d-8355-85bdf246feb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:51.819540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-46fd37aa-bd48-4a9d-8355-85bdf246feb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:51.843789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fd37aa-bd48-4a9d-8355-85bdf246feb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.846444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fd37aa-bd48-4a9d-8355-85bdf246feb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.848035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fd37aa-bd48-4a9d-8355-85bdf246feb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.848904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fd37aa-bd48-4a9d-8355-85bdf246feb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.853802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fd37aa-bd48-4a9d-8355-85bdf246feb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.855435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fd37aa-bd48-4a9d-8355-85bdf246feb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.877662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-16188bfd-969b-4d2d-8f7c-cccc4f525df7 req-0ff2ad89-8553-468c-a313-013bbd607f2d service nova] Creating event network-changed:283b37e6-36c4-4137-bd93-b317149a34f3 for instance df50fb74-c0ba-4741-95e4-8cae91fac7dd on hv-cinder-85506 Aug 31 00:22:51.889643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-16188bfd-969b-4d2d-8f7c-cccc4f525df7 req-0ff2ad89-8553-468c-a313-013bbd607f2d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114867 Aug 31 00:22:51.901550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 206/375] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:51.921393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-46fd37aa-bd48-4a9d-8355-85bdf246feb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'flavor' on Instance uuid 82098e98-ab74-415b-9d57-1e55a9524ce1 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:22:51.924513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:51.927608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:51.951942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.952585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.954252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.958194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.962551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.962877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.008158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] HTTP exception thrown: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Request method failure captured: Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e HTTP/1.1 Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlXiC6_q0qD8S2cYCfLC7RO_qihT4Ndii-haFV-rscSBD1I1Toqqr6VZTLI-TQUqomDKroaBQrjmsPsa3uktr3galdwuKlpakK8R2-OmrmQ3HbEdEIH9tXJv4dqODJ-Ji1k-lZz6Uzrd4L5lAL5BcozJr6I91bU2213xa7YiTSET8s Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 788926197c5042b99931f959426cff47 Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:22:52.010406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/788926197c5042b99931f959426cff47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/788926197c5042b99931f959426cff47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/788926197c5042b99931f959426cff47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_788926197c5042b99931f959426cff47", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 788926197c5042b99931f959426cff47 Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-DeleteServersTestJSON-866613037-project Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: d10b50451d4b48f0b2377626ed609de4 Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-DeleteServersTestJSON-866613037-project Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:52.011821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '5d2cfd30-5052-44b3-8237-9a4be97fc51e'} Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:52.012602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:52.014696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:22:52.016980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Returning 404 to user: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:52.018042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3bfa7606-3aac-43f9-b755-4aa8a21f9d72 tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 404 len: 111 microversion: 2.1 time: 0.115299 Aug 31 00:22:52.019100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 207/376] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:22:51 2022] DELETE /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:52.024414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-94f19ab1-f1a5-41c1-8947-7433c81e37fe tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:52.025025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-94f19ab1-f1a5-41c1-8947-7433c81e37fe tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:52.032141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94f19ab1-f1a5-41c1-8947-7433c81e37fe tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.032853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94f19ab1-f1a5-41c1-8947-7433c81e37fe tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.033428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94f19ab1-f1a5-41c1-8947-7433c81e37fe tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.034301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94f19ab1-f1a5-41c1-8947-7433c81e37fe tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.034893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94f19ab1-f1a5-41c1-8947-7433c81e37fe tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.035536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94f19ab1-f1a5-41c1-8947-7433c81e37fe tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.149780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-46fd37aa-bd48-4a9d-8355-85bdf246feb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1/action" status: 200 len: 32 microversion: 2.1 time: 0.339628 Aug 31 00:22:52.150422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 170/377] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 00:22:51 2022] POST /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 00:22:52.157817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:52.159414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] [instance: 5d2cfd30-5052-44b3-8237-9a4be97fc51e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:52.167566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.168539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.169254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.170733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.171251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.171763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.188882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] HTTP exception thrown: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Request method failure captured: Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e HTTP/1.1 Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlXiC6_q0qD8S2cYCfLC7RO_qihT4Ndii-haFV-rscSBD1I1Toqqr6VZTLI-TQUqomDKroaBQrjmsPsa3uktr3galdwuKlpakK8R2-OmrmQ3HbEdEIH9tXJv4dqODJ-Ji1k-lZz6Uzrd4L5lAL5BcozJr6I91bU2213xa7YiTSET8s Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 788926197c5042b99931f959426cff47 Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:22:52.191522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/788926197c5042b99931f959426cff47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/788926197c5042b99931f959426cff47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/788926197c5042b99931f959426cff47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_788926197c5042b99931f959426cff47", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 788926197c5042b99931f959426cff47 Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-DeleteServersTestJSON-866613037 Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-DeleteServersTestJSON-866613037-project Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: d10b50451d4b48f0b2377626ed609de4 Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-DeleteServersTestJSON-866613037-project Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:52.192798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': '5d2cfd30-5052-44b3-8237-9a4be97fc51e'} Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:52.193481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. Aug 31 00:22:52.194532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:22:52.196241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] Returning 404 to user: Instance 5d2cfd30-5052-44b3-8237-9a4be97fc51e could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:52.196241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e1c71786-87de-4292-b673-942428484fdb tempest-DeleteServersTestJSON-866613037 tempest-DeleteServersTestJSON-866613037-project] 10.222.0.67 "GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e" status: 404 len: 111 microversion: 2.1 time: 0.041089 Aug 31 00:22:52.196241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 171/378] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:52 2022] GET /compute/v2.1/servers/5d2cfd30-5052-44b3-8237-9a4be97fc51e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:52.199467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-87618885-091b-48a3-9089-89499bf85553 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:52.200349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-87618885-091b-48a3-9089-89499bf85553 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:52.210462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87618885-091b-48a3-9089-89499bf85553 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.210813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87618885-091b-48a3-9089-89499bf85553 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.211464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87618885-091b-48a3-9089-89499bf85553 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.211978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87618885-091b-48a3-9089-89499bf85553 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.212425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87618885-091b-48a3-9089-89499bf85553 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.220448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87618885-091b-48a3-9089-89499bf85553 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.613980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-94f19ab1-f1a5-41c1-8947-7433c81e37fe tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.632284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-94f19ab1-f1a5-41c1-8947-7433c81e37fe tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.611814 Aug 31 00:22:52.633142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 208/379] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:52 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:52.721150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-87618885-091b-48a3-9089-89499bf85553 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.738027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-87618885-091b-48a3-9089-89499bf85553 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.543524 Aug 31 00:22:52.738868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 172/380] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:52 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:53.653754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-201553ba-bde9-4274-baf8-d2bb5f7d55c9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:53.655521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-201553ba-bde9-4274-baf8-d2bb5f7d55c9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:53.664326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201553ba-bde9-4274-baf8-d2bb5f7d55c9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.664985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201553ba-bde9-4274-baf8-d2bb5f7d55c9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.665421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201553ba-bde9-4274-baf8-d2bb5f7d55c9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.666714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201553ba-bde9-4274-baf8-d2bb5f7d55c9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.667182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201553ba-bde9-4274-baf8-d2bb5f7d55c9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.673968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201553ba-bde9-4274-baf8-d2bb5f7d55c9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.759275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-94308217-1e4f-4970-8290-7c77f9f4084a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:53.759874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-94308217-1e4f-4970-8290-7c77f9f4084a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:53.766882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94308217-1e4f-4970-8290-7c77f9f4084a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.767396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94308217-1e4f-4970-8290-7c77f9f4084a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.767822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94308217-1e4f-4970-8290-7c77f9f4084a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.768518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94308217-1e4f-4970-8290-7c77f9f4084a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.768961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94308217-1e4f-4970-8290-7c77f9f4084a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.769552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94308217-1e4f-4970-8290-7c77f9f4084a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.973789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-201553ba-bde9-4274-baf8-d2bb5f7d55c9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.983185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-201553ba-bde9-4274-baf8-d2bb5f7d55c9 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.332641 Aug 31 00:22:54.002111 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 209/381] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:53 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:54.076193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-94308217-1e4f-4970-8290-7c77f9f4084a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:54.084435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-94308217-1e4f-4970-8290-7c77f9f4084a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.328991 Aug 31 00:22:54.089962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 173/382] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:53 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:55.007790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a9569709-7245-400b-9c32-238b31342dda tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:55.008414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a9569709-7245-400b-9c32-238b31342dda tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:55.020005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9569709-7245-400b-9c32-238b31342dda tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.020782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9569709-7245-400b-9c32-238b31342dda tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.021368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9569709-7245-400b-9c32-238b31342dda tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.022753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9569709-7245-400b-9c32-238b31342dda tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.023392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9569709-7245-400b-9c32-238b31342dda tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.025087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9569709-7245-400b-9c32-238b31342dda tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.115509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-255f82fe-a7ed-4dec-b708-8d3ad0d3d60f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:55.117366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-255f82fe-a7ed-4dec-b708-8d3ad0d3d60f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:55.133094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-255f82fe-a7ed-4dec-b708-8d3ad0d3d60f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.133692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-255f82fe-a7ed-4dec-b708-8d3ad0d3d60f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.138101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-255f82fe-a7ed-4dec-b708-8d3ad0d3d60f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.139401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-255f82fe-a7ed-4dec-b708-8d3ad0d3d60f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.140346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-255f82fe-a7ed-4dec-b708-8d3ad0d3d60f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.140972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-255f82fe-a7ed-4dec-b708-8d3ad0d3d60f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.406574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a9569709-7245-400b-9c32-238b31342dda tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.422241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a9569709-7245-400b-9c32-238b31342dda tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.414521 Aug 31 00:22:55.423154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 210/383] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:55 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:55.464309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-255f82fe-a7ed-4dec-b708-8d3ad0d3d60f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.476857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-255f82fe-a7ed-4dec-b708-8d3ad0d3d60f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.365937 Aug 31 00:22:55.479203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 174/384] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:55 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:56.451899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d7b723d5-8782-4f77-9d52-ef12a7419936 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:56.453110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d7b723d5-8782-4f77-9d52-ef12a7419936 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:56.455762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:56.461477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7b723d5-8782-4f77-9d52-ef12a7419936 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.462062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7b723d5-8782-4f77-9d52-ef12a7419936 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.462598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7b723d5-8782-4f77-9d52-ef12a7419936 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.463573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7b723d5-8782-4f77-9d52-ef12a7419936 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.468404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7b723d5-8782-4f77-9d52-ef12a7419936 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.468986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7b723d5-8782-4f77-9d52-ef12a7419936 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.500931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1ff58b8b-656b-4f93-b67c-c4259081090c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:56.502102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1ff58b8b-656b-4f93-b67c-c4259081090c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:56.508996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ff58b8b-656b-4f93-b67c-c4259081090c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.516809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ff58b8b-656b-4f93-b67c-c4259081090c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.517513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ff58b8b-656b-4f93-b67c-c4259081090c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.518410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ff58b8b-656b-4f93-b67c-c4259081090c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.519269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ff58b8b-656b-4f93-b67c-c4259081090c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.519844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ff58b8b-656b-4f93-b67c-c4259081090c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.727485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d7b723d5-8782-4f77-9d52-ef12a7419936 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.748951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d7b723d5-8782-4f77-9d52-ef12a7419936 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.302168 Aug 31 00:22:56.750875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 211/385] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:56 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:56.765431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1ff58b8b-656b-4f93-b67c-c4259081090c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.773243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1ff58b8b-656b-4f93-b67c-c4259081090c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.276814 Aug 31 00:22:56.773816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 175/386] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:56 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:57.777844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8b6b2685-3e2f-4904-9ac8-1d45400cda7c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:57.778635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8b6b2685-3e2f-4904-9ac8-1d45400cda7c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:57.786011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b6b2685-3e2f-4904-9ac8-1d45400cda7c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:57.786639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b6b2685-3e2f-4904-9ac8-1d45400cda7c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:57.787297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b6b2685-3e2f-4904-9ac8-1d45400cda7c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:57.788250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b6b2685-3e2f-4904-9ac8-1d45400cda7c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:57.788918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b6b2685-3e2f-4904-9ac8-1d45400cda7c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:57.789574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b6b2685-3e2f-4904-9ac8-1d45400cda7c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:57.796379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c6208bc6-ebfd-4b06-9c51-392e0130f226 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:57.797093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c6208bc6-ebfd-4b06-9c51-392e0130f226 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:57.806955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6208bc6-ebfd-4b06-9c51-392e0130f226 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:57.809736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6208bc6-ebfd-4b06-9c51-392e0130f226 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:57.811410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6208bc6-ebfd-4b06-9c51-392e0130f226 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:57.824376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6208bc6-ebfd-4b06-9c51-392e0130f226 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:57.825206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6208bc6-ebfd-4b06-9c51-392e0130f226 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:57.825864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6208bc6-ebfd-4b06-9c51-392e0130f226 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:58.190318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c6208bc6-ebfd-4b06-9c51-392e0130f226 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:58.204531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c6208bc6-ebfd-4b06-9c51-392e0130f226 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.413059 Aug 31 00:22:58.220165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 176/387] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:57 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:58.286980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8b6b2685-3e2f-4904-9ac8-1d45400cda7c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:58.309058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8b6b2685-3e2f-4904-9ac8-1d45400cda7c tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.540394 Aug 31 00:22:58.309649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 212/388] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:57 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:59.245347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-91e15b9e-2652-4a2c-8337-079a0dd2a4f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:59.246713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-91e15b9e-2652-4a2c-8337-079a0dd2a4f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:59.266144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:59.270242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91e15b9e-2652-4a2c-8337-079a0dd2a4f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.274580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91e15b9e-2652-4a2c-8337-079a0dd2a4f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.276476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91e15b9e-2652-4a2c-8337-079a0dd2a4f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.279690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91e15b9e-2652-4a2c-8337-079a0dd2a4f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.280472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91e15b9e-2652-4a2c-8337-079a0dd2a4f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.281655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91e15b9e-2652-4a2c-8337-079a0dd2a4f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.327344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:59.329227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:59.335145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f07e04c2-3d51-4bd6-9105-3ffdc07ed03f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:59.335778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f07e04c2-3d51-4bd6-9105-3ffdc07ed03f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:59.354782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f07e04c2-3d51-4bd6-9105-3ffdc07ed03f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.355617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f07e04c2-3d51-4bd6-9105-3ffdc07ed03f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.357033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f07e04c2-3d51-4bd6-9105-3ffdc07ed03f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.359820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f07e04c2-3d51-4bd6-9105-3ffdc07ed03f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.360531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f07e04c2-3d51-4bd6-9105-3ffdc07ed03f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.369884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f07e04c2-3d51-4bd6-9105-3ffdc07ed03f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.904719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91e15b9e-2652-4a2c-8337-079a0dd2a4f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:59.914827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-91e15b9e-2652-4a2c-8337-079a0dd2a4f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.675953 Aug 31 00:22:59.915825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 177/389] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:59 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:59.931528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f07e04c2-3d51-4bd6-9105-3ffdc07ed03f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:59.941881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f07e04c2-3d51-4bd6-9105-3ffdc07ed03f tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.615774 Aug 31 00:22:59.943098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 213/390] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:59 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:00.937410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2500ffb3-17ef-4037-a42d-7e39ed22ef33 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:00.938612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2500ffb3-17ef-4037-a42d-7e39ed22ef33 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:00.947913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2500ffb3-17ef-4037-a42d-7e39ed22ef33 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.948948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2500ffb3-17ef-4037-a42d-7e39ed22ef33 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.949639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2500ffb3-17ef-4037-a42d-7e39ed22ef33 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.950351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2500ffb3-17ef-4037-a42d-7e39ed22ef33 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.950975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2500ffb3-17ef-4037-a42d-7e39ed22ef33 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.952443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2500ffb3-17ef-4037-a42d-7e39ed22ef33 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.964635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-926eb515-162e-4abd-b1ba-6a446c947da5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:00.965354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-926eb515-162e-4abd-b1ba-6a446c947da5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:00.974291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-926eb515-162e-4abd-b1ba-6a446c947da5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.975410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-926eb515-162e-4abd-b1ba-6a446c947da5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.977219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-926eb515-162e-4abd-b1ba-6a446c947da5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.979864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-926eb515-162e-4abd-b1ba-6a446c947da5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.980594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-926eb515-162e-4abd-b1ba-6a446c947da5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.981499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-926eb515-162e-4abd-b1ba-6a446c947da5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:01.016935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:01.362324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2500ffb3-17ef-4037-a42d-7e39ed22ef33 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:01.367751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-926eb515-162e-4abd-b1ba-6a446c947da5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:01.378435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2500ffb3-17ef-4037-a42d-7e39ed22ef33 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.446013 Aug 31 00:23:01.379021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 178/391] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:00 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:01.382224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-926eb515-162e-4abd-b1ba-6a446c947da5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.421336 Aug 31 00:23:01.383281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 214/392] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:00 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:01.510169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-ddcc9ef8-5371-4c96-b523-afa0bdf8f548 req-e092afd4-a610-4058-bad6-f4f738139f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df50fb74-c0ba-4741-95e4-8cae91fac7dd", "name": "network-vif-plugged", "status": "completed", "tag": "283b37e6-36c4-4137-bd93-b317149a34f3"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:01.527551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-ddcc9ef8-5371-4c96-b523-afa0bdf8f548 req-e092afd4-a610-4058-bad6-f4f738139f0a service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:01.535912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-ddcc9ef8-5371-4c96-b523-afa0bdf8f548 req-e092afd4-a610-4058-bad6-f4f738139f0a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:01.536290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-ddcc9ef8-5371-4c96-b523-afa0bdf8f548 req-e092afd4-a610-4058-bad6-f4f738139f0a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:01.553814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-ddcc9ef8-5371-4c96-b523-afa0bdf8f548 req-e092afd4-a610-4058-bad6-f4f738139f0a service nova] Creating event network-vif-plugged:283b37e6-36c4-4137-bd93-b317149a34f3 for instance df50fb74-c0ba-4741-95e4-8cae91fac7dd on hv-cinder-85506 Aug 31 00:23:01.564763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-ddcc9ef8-5371-4c96-b523-afa0bdf8f548 req-e092afd4-a610-4058-bad6-f4f738139f0a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058163 Aug 31 00:23:01.566197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 179/393] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:02.033198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-164be71e-9453-4543-8f50-6231149f70cb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Action: 'create', calling method: .version_select at 0x7fa7f419b280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1651012719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLf697s5C3MkwbaDtLf+TxRu8HoV0umTIYxxEs9UhATP/MXrUJgc0g1DyLag6yU3lwJ4bLWtJBALtr1zSPQLRi5eDdVmflzT13A7lY2RDtSKCceYa4UxBqqKgmsOKBckSQ=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:02.049224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-164be71e-9453-4543-8f50-6231149f70cb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Getting quotas for project d201c4183dde4ac693ac92c43c02df77. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:23:02.053136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-164be71e-9453-4543-8f50-6231149f70cb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Getting quotas for user f9add734db2a4adc9857040166c02675 and project d201c4183dde4ac693ac92c43c02df77. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:23:02.078247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-164be71e-9453-4543-8f50-6231149f70cb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.244363 Aug 31 00:23:02.078852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 215/394] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 31 00:23:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:02.403828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-111dc39f-564f-440e-ba7a-7fbc84550f80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:02.405313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-111dc39f-564f-440e-ba7a-7fbc84550f80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:02.405884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dc399c00-0f80-4b8f-86b9-6f4a6684c7b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:02.406573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dc399c00-0f80-4b8f-86b9-6f4a6684c7b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:02.407426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:02.414409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-111dc39f-564f-440e-ba7a-7fbc84550f80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:02.414839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc399c00-0f80-4b8f-86b9-6f4a6684c7b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:02.415410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc399c00-0f80-4b8f-86b9-6f4a6684c7b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:02.415788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-111dc39f-564f-440e-ba7a-7fbc84550f80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:02.415944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc399c00-0f80-4b8f-86b9-6f4a6684c7b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.416522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-111dc39f-564f-440e-ba7a-7fbc84550f80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.416656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc399c00-0f80-4b8f-86b9-6f4a6684c7b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:02.417008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc399c00-0f80-4b8f-86b9-6f4a6684c7b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:02.417209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-111dc39f-564f-440e-ba7a-7fbc84550f80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:02.417455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc399c00-0f80-4b8f-86b9-6f4a6684c7b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.417972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-111dc39f-564f-440e-ba7a-7fbc84550f80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:02.418544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-111dc39f-564f-440e-ba7a-7fbc84550f80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.645698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dc399c00-0f80-4b8f-86b9-6f4a6684c7b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:02.649259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-111dc39f-564f-440e-ba7a-7fbc84550f80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:02.656109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dc399c00-0f80-4b8f-86b9-6f4a6684c7b3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.255142 Aug 31 00:23:02.657097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 216/395] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:02 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:02.662791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-111dc39f-564f-440e-ba7a-7fbc84550f80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.261479 Aug 31 00:23:02.662791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 180/396] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:02 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:03.677929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fe2764de-0379-4952-b118-ee0c613be2de tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:03.679246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fe2764de-0379-4952-b118-ee0c613be2de tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:03.686338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-986274a6-9891-40d3-aebc-467316ca3fb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:03.686929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-986274a6-9891-40d3-aebc-467316ca3fb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:03.695506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-986274a6-9891-40d3-aebc-467316ca3fb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:03.696230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-986274a6-9891-40d3-aebc-467316ca3fb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:03.696473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe2764de-0379-4952-b118-ee0c613be2de tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:03.697019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe2764de-0379-4952-b118-ee0c613be2de tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:03.697249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-986274a6-9891-40d3-aebc-467316ca3fb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:03.697452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe2764de-0379-4952-b118-ee0c613be2de tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:03.698210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe2764de-0379-4952-b118-ee0c613be2de tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:03.698544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-986274a6-9891-40d3-aebc-467316ca3fb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:03.698720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe2764de-0379-4952-b118-ee0c613be2de tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:03.699272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe2764de-0379-4952-b118-ee0c613be2de tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:03.699594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-986274a6-9891-40d3-aebc-467316ca3fb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:03.700210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-986274a6-9891-40d3-aebc-467316ca3fb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:03.911226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fe2764de-0379-4952-b118-ee0c613be2de tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:03.918056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-986274a6-9891-40d3-aebc-467316ca3fb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:03.919942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fe2764de-0379-4952-b118-ee0c613be2de tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.245688 Aug 31 00:23:03.920507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 181/397] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:03 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:03.926087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-986274a6-9891-40d3-aebc-467316ca3fb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.244910 Aug 31 00:23:03.926827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 217/398] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:03 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:04.943150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9e2ef72e-0760-4d3d-a559-8bba9b24ced6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:04.943856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9e2ef72e-0760-4d3d-a559-8bba9b24ced6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:04.948316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-15e09e8b-a78e-4393-8496-f251f44e185d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:04.949559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-15e09e8b-a78e-4393-8496-f251f44e185d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:04.950702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e2ef72e-0760-4d3d-a559-8bba9b24ced6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.951875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e2ef72e-0760-4d3d-a559-8bba9b24ced6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.952487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e2ef72e-0760-4d3d-a559-8bba9b24ced6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:04.953507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e2ef72e-0760-4d3d-a559-8bba9b24ced6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.954308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e2ef72e-0760-4d3d-a559-8bba9b24ced6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.954732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e2ef72e-0760-4d3d-a559-8bba9b24ced6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:04.958260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e09e8b-a78e-4393-8496-f251f44e185d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.958951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e09e8b-a78e-4393-8496-f251f44e185d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.959612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e09e8b-a78e-4393-8496-f251f44e185d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:04.960746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e09e8b-a78e-4393-8496-f251f44e185d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.961457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e09e8b-a78e-4393-8496-f251f44e185d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.962332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e09e8b-a78e-4393-8496-f251f44e185d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:05.200531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-15e09e8b-a78e-4393-8496-f251f44e185d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:05.209445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-15e09e8b-a78e-4393-8496-f251f44e185d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.265600 Aug 31 00:23:05.210368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 218/399] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:04 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:05.211794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9e2ef72e-0760-4d3d-a559-8bba9b24ced6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:05.221450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9e2ef72e-0760-4d3d-a559-8bba9b24ced6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.283865 Aug 31 00:23:05.222873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 182/400] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:04 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:06.244667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-405a3ddf-d560-42f7-9ea9-9063e714e7fa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:06.245301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-405a3ddf-d560-42f7-9ea9-9063e714e7fa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:06.245821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd896e86-60bf-42e9-abba-358dc2e37070 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:06.246440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dd896e86-60bf-42e9-abba-358dc2e37070 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:06.252116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-405a3ddf-d560-42f7-9ea9-9063e714e7fa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.252599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-405a3ddf-d560-42f7-9ea9-9063e714e7fa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.253032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-405a3ddf-d560-42f7-9ea9-9063e714e7fa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.253725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-405a3ddf-d560-42f7-9ea9-9063e714e7fa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.254176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-405a3ddf-d560-42f7-9ea9-9063e714e7fa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.254286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd896e86-60bf-42e9-abba-358dc2e37070 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.254597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-405a3ddf-d560-42f7-9ea9-9063e714e7fa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.254770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd896e86-60bf-42e9-abba-358dc2e37070 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.255239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd896e86-60bf-42e9-abba-358dc2e37070 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.255939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd896e86-60bf-42e9-abba-358dc2e37070 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.256422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd896e86-60bf-42e9-abba-358dc2e37070 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.256857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd896e86-60bf-42e9-abba-358dc2e37070 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.450057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dd896e86-60bf-42e9-abba-358dc2e37070 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:06.457687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-405a3ddf-d560-42f7-9ea9-9063e714e7fa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:06.457886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dd896e86-60bf-42e9-abba-358dc2e37070 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1314 microversion: 2.1 time: 0.216038 Aug 31 00:23:06.458445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 183/401] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:06 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:06.466611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-405a3ddf-d560-42f7-9ea9-9063e714e7fa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.226266 Aug 31 00:23:06.467395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 219/402] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:06 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:07.478121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-75a1c9ee-b926-410f-9106-a5c38ee27889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:07.478712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-75a1c9ee-b926-410f-9106-a5c38ee27889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:07.485984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a1c9ee-b926-410f-9106-a5c38ee27889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:07.486470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a1c9ee-b926-410f-9106-a5c38ee27889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:07.486904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a1c9ee-b926-410f-9106-a5c38ee27889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:07.487421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0b406f6d-20a5-4107-b5eb-a4bf6deb1e89 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:07.487851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a1c9ee-b926-410f-9106-a5c38ee27889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:07.488069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a1c9ee-b926-410f-9106-a5c38ee27889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:07.488172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0b406f6d-20a5-4107-b5eb-a4bf6deb1e89 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:07.488490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a1c9ee-b926-410f-9106-a5c38ee27889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:07.493965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b406f6d-20a5-4107-b5eb-a4bf6deb1e89 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:07.494432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b406f6d-20a5-4107-b5eb-a4bf6deb1e89 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:07.494852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b406f6d-20a5-4107-b5eb-a4bf6deb1e89 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:07.495641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b406f6d-20a5-4107-b5eb-a4bf6deb1e89 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:07.496169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b406f6d-20a5-4107-b5eb-a4bf6deb1e89 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:07.497251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b406f6d-20a5-4107-b5eb-a4bf6deb1e89 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:07.688742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-75a1c9ee-b926-410f-9106-a5c38ee27889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:07.692079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0b406f6d-20a5-4107-b5eb-a4bf6deb1e89 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:07.696902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-75a1c9ee-b926-410f-9106-a5c38ee27889 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1498 microversion: 2.1 time: 0.223045 Aug 31 00:23:07.697470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 184/403] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:07 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1498 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:07.699775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0b406f6d-20a5-4107-b5eb-a4bf6deb1e89 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.216333 Aug 31 00:23:07.700325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 220/404] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:07 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:08.724274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-945f7413-df0d-4643-a0f7-ee9f897e27bc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:08.724876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-945f7413-df0d-4643-a0f7-ee9f897e27bc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:08.731667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-945f7413-df0d-4643-a0f7-ee9f897e27bc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:08.732146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-945f7413-df0d-4643-a0f7-ee9f897e27bc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:08.732639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-945f7413-df0d-4643-a0f7-ee9f897e27bc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:08.733482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-945f7413-df0d-4643-a0f7-ee9f897e27bc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:08.733931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-945f7413-df0d-4643-a0f7-ee9f897e27bc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:08.734349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-945f7413-df0d-4643-a0f7-ee9f897e27bc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:08.753400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:08.870998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-945f7413-df0d-4643-a0f7-ee9f897e27bc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:08.880283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-945f7413-df0d-4643-a0f7-ee9f897e27bc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.159795 Aug 31 00:23:08.880853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 185/405] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:08 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:09.903664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d8a513dc-edd1-4aed-8a2f-0787ed495e92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:09.904223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d8a513dc-edd1-4aed-8a2f-0787ed495e92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:09.911173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8a513dc-edd1-4aed-8a2f-0787ed495e92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:09.911655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8a513dc-edd1-4aed-8a2f-0787ed495e92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:09.912084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8a513dc-edd1-4aed-8a2f-0787ed495e92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:09.912768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8a513dc-edd1-4aed-8a2f-0787ed495e92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:09.913214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8a513dc-edd1-4aed-8a2f-0787ed495e92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:09.913631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8a513dc-edd1-4aed-8a2f-0787ed495e92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:10.047306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d8a513dc-edd1-4aed-8a2f-0787ed495e92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:10.055146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d8a513dc-edd1-4aed-8a2f-0787ed495e92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.155266 Aug 31 00:23:10.055730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 221/406] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:09 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:11.076464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c9f8e702-8c88-4fb8-a732-268f11953a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:11.077776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c9f8e702-8c88-4fb8-a732-268f11953a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:11.084277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f8e702-8c88-4fb8-a732-268f11953a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.084757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f8e702-8c88-4fb8-a732-268f11953a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.085274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f8e702-8c88-4fb8-a732-268f11953a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.085967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f8e702-8c88-4fb8-a732-268f11953a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.086415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f8e702-8c88-4fb8-a732-268f11953a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.086830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f8e702-8c88-4fb8-a732-268f11953a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.244161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c9f8e702-8c88-4fb8-a732-268f11953a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:11.253446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c9f8e702-8c88-4fb8-a732-268f11953a02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.180753 Aug 31 00:23:11.254416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 186/407] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:11 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:11.279205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2164c24c-6917-4dd0-a1b3-1f0342f404d3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:11.279855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2164c24c-6917-4dd0-a1b3-1f0342f404d3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:11.285535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2164c24c-6917-4dd0-a1b3-1f0342f404d3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.286002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2164c24c-6917-4dd0-a1b3-1f0342f404d3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.286419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2164c24c-6917-4dd0-a1b3-1f0342f404d3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.287103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2164c24c-6917-4dd0-a1b3-1f0342f404d3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.287547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2164c24c-6917-4dd0-a1b3-1f0342f404d3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.287968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2164c24c-6917-4dd0-a1b3-1f0342f404d3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.313348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2164c24c-6917-4dd0-a1b3-1f0342f404d3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:23:11.399931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2164c24c-6917-4dd0-a1b3-1f0342f404d3 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "DELETE /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 204 len: 0 microversion: 2.1 time: 0.124444 Aug 31 00:23:11.400512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 222/408] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:23:11 2022] DELETE /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:23:11.409471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ac803aa3-1442-4d65-9f4c-9032cab282e6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:11.410072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ac803aa3-1442-4d65-9f4c-9032cab282e6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:11.416099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac803aa3-1442-4d65-9f4c-9032cab282e6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.416580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac803aa3-1442-4d65-9f4c-9032cab282e6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.417007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac803aa3-1442-4d65-9f4c-9032cab282e6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.417691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac803aa3-1442-4d65-9f4c-9032cab282e6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.418139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac803aa3-1442-4d65-9f4c-9032cab282e6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.418555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac803aa3-1442-4d65-9f4c-9032cab282e6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.554023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ac803aa3-1442-4d65-9f4c-9032cab282e6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:11.561813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ac803aa3-1442-4d65-9f4c-9032cab282e6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.156776 Aug 31 00:23:11.562377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 187/409] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:11 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:12.280522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e1160ef5-81bc-429c-967a-66b95cf743e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:12.281684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e1160ef5-81bc-429c-967a-66b95cf743e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:12.283920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:12.291841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1160ef5-81bc-429c-967a-66b95cf743e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.293052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1160ef5-81bc-429c-967a-66b95cf743e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.293663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1160ef5-81bc-429c-967a-66b95cf743e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.294519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1160ef5-81bc-429c-967a-66b95cf743e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.295909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1160ef5-81bc-429c-967a-66b95cf743e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.296619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1160ef5-81bc-429c-967a-66b95cf743e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.443342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1160ef5-81bc-429c-967a-66b95cf743e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:12.451349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e1160ef5-81bc-429c-967a-66b95cf743e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.175486 Aug 31 00:23:12.452527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 223/410] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:12 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:12.583905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a51b425e-a065-47fd-99b1-b93c0ffae122 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:12.584606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a51b425e-a065-47fd-99b1-b93c0ffae122 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:12.591000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a51b425e-a065-47fd-99b1-b93c0ffae122 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.591711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a51b425e-a065-47fd-99b1-b93c0ffae122 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.594881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a51b425e-a065-47fd-99b1-b93c0ffae122 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.596052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a51b425e-a065-47fd-99b1-b93c0ffae122 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.596582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a51b425e-a065-47fd-99b1-b93c0ffae122 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.597214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a51b425e-a065-47fd-99b1-b93c0ffae122 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.734820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a51b425e-a065-47fd-99b1-b93c0ffae122 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:12.742654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a51b425e-a065-47fd-99b1-b93c0ffae122 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.162531 Aug 31 00:23:12.743240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 188/411] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:12 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:13.475224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-612e7c84-5e55-4bcb-8aa8-88edecc23b60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:13.475880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-612e7c84-5e55-4bcb-8aa8-88edecc23b60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:13.482278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-612e7c84-5e55-4bcb-8aa8-88edecc23b60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.482773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-612e7c84-5e55-4bcb-8aa8-88edecc23b60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.483985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-612e7c84-5e55-4bcb-8aa8-88edecc23b60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.484876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-612e7c84-5e55-4bcb-8aa8-88edecc23b60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.485333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-612e7c84-5e55-4bcb-8aa8-88edecc23b60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.485755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-612e7c84-5e55-4bcb-8aa8-88edecc23b60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.620187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-612e7c84-5e55-4bcb-8aa8-88edecc23b60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:13.628909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-612e7c84-5e55-4bcb-8aa8-88edecc23b60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.157872 Aug 31 00:23:13.629508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 224/412] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:13 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:13.766066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c5073e95-f327-4057-a6b6-445db1812525 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:13.766660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c5073e95-f327-4057-a6b6-445db1812525 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:13.773196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5073e95-f327-4057-a6b6-445db1812525 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.773666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5073e95-f327-4057-a6b6-445db1812525 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.774094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5073e95-f327-4057-a6b6-445db1812525 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.774766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5073e95-f327-4057-a6b6-445db1812525 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.775257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5073e95-f327-4057-a6b6-445db1812525 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.775670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5073e95-f327-4057-a6b6-445db1812525 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.906353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c5073e95-f327-4057-a6b6-445db1812525 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:13.914311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c5073e95-f327-4057-a6b6-445db1812525 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.152636 Aug 31 00:23:13.914883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 189/413] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:13 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:14.650504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cb93d0f7-7788-4003-91b3-e7bf6505eb5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:14.651133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cb93d0f7-7788-4003-91b3-e7bf6505eb5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:14.658128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb93d0f7-7788-4003-91b3-e7bf6505eb5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.658610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb93d0f7-7788-4003-91b3-e7bf6505eb5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.659060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb93d0f7-7788-4003-91b3-e7bf6505eb5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.659746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb93d0f7-7788-4003-91b3-e7bf6505eb5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.660199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb93d0f7-7788-4003-91b3-e7bf6505eb5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.660618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb93d0f7-7788-4003-91b3-e7bf6505eb5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.788307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cb93d0f7-7788-4003-91b3-e7bf6505eb5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:14.797079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cb93d0f7-7788-4003-91b3-e7bf6505eb5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.150247 Aug 31 00:23:14.797675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 225/414] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:14 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:14.936747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bb3ddc62-500d-4f72-b036-e4c8205db8ce tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:14.937488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bb3ddc62-500d-4f72-b036-e4c8205db8ce tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:14.943722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb3ddc62-500d-4f72-b036-e4c8205db8ce tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.944231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb3ddc62-500d-4f72-b036-e4c8205db8ce tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.944658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb3ddc62-500d-4f72-b036-e4c8205db8ce tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.945328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb3ddc62-500d-4f72-b036-e4c8205db8ce tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.945772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb3ddc62-500d-4f72-b036-e4c8205db8ce tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.946227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb3ddc62-500d-4f72-b036-e4c8205db8ce tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.084124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bb3ddc62-500d-4f72-b036-e4c8205db8ce tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:15.091770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bb3ddc62-500d-4f72-b036-e4c8205db8ce tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.159723 Aug 31 00:23:15.092357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 190/415] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:14 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:15.819603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-21c0c210-db95-4d4e-8978-fd65d99ddb7a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:15.820198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-21c0c210-db95-4d4e-8978-fd65d99ddb7a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:15.826098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c0c210-db95-4d4e-8978-fd65d99ddb7a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.827344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c0c210-db95-4d4e-8978-fd65d99ddb7a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.827714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c0c210-db95-4d4e-8978-fd65d99ddb7a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.828391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c0c210-db95-4d4e-8978-fd65d99ddb7a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.828828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c0c210-db95-4d4e-8978-fd65d99ddb7a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.829238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c0c210-db95-4d4e-8978-fd65d99ddb7a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.958573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-21c0c210-db95-4d4e-8978-fd65d99ddb7a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:15.966079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-21c0c210-db95-4d4e-8978-fd65d99ddb7a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.150405 Aug 31 00:23:15.966637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 226/416] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:15 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:16.113721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bc0f988b-c3e0-4cac-a573-d2a8947a41e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:16.114308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bc0f988b-c3e0-4cac-a573-d2a8947a41e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:16.120685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0f988b-c3e0-4cac-a573-d2a8947a41e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.121154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0f988b-c3e0-4cac-a573-d2a8947a41e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.121574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0f988b-c3e0-4cac-a573-d2a8947a41e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.122244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0f988b-c3e0-4cac-a573-d2a8947a41e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.122683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0f988b-c3e0-4cac-a573-d2a8947a41e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.123115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0f988b-c3e0-4cac-a573-d2a8947a41e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.257791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bc0f988b-c3e0-4cac-a573-d2a8947a41e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:16.265893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bc0f988b-c3e0-4cac-a573-d2a8947a41e5 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.156061 Aug 31 00:23:16.266456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 191/417] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:16 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:16.988354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bae37abe-a80c-4bfe-8976-48809e39190e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:16.988900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bae37abe-a80c-4bfe-8976-48809e39190e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:16.994909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bae37abe-a80c-4bfe-8976-48809e39190e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.995429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bae37abe-a80c-4bfe-8976-48809e39190e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.995864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bae37abe-a80c-4bfe-8976-48809e39190e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.996550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bae37abe-a80c-4bfe-8976-48809e39190e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.997001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bae37abe-a80c-4bfe-8976-48809e39190e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.997424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bae37abe-a80c-4bfe-8976-48809e39190e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.129197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bae37abe-a80c-4bfe-8976-48809e39190e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:17.136896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bae37abe-a80c-4bfe-8976-48809e39190e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.152635 Aug 31 00:23:17.137456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 227/418] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:16 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:17.293308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d25cffd5-fa5c-4976-86dc-cb87c788a988 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:17.293848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d25cffd5-fa5c-4976-86dc-cb87c788a988 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:17.301400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25cffd5-fa5c-4976-86dc-cb87c788a988 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.301878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25cffd5-fa5c-4976-86dc-cb87c788a988 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.302300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25cffd5-fa5c-4976-86dc-cb87c788a988 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.302980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25cffd5-fa5c-4976-86dc-cb87c788a988 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.303446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25cffd5-fa5c-4976-86dc-cb87c788a988 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.303855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25cffd5-fa5c-4976-86dc-cb87c788a988 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.439053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d25cffd5-fa5c-4976-86dc-cb87c788a988 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:17.446690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d25cffd5-fa5c-4976-86dc-cb87c788a988 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.157327 Aug 31 00:23:17.447378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 192/419] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:17 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:18.162280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3eb760b5-5de0-444b-93da-878f702e2fbf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:18.162886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3eb760b5-5de0-444b-93da-878f702e2fbf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:18.168963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb760b5-5de0-444b-93da-878f702e2fbf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.169454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb760b5-5de0-444b-93da-878f702e2fbf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.169929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb760b5-5de0-444b-93da-878f702e2fbf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.170618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb760b5-5de0-444b-93da-878f702e2fbf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.171082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb760b5-5de0-444b-93da-878f702e2fbf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.171501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb760b5-5de0-444b-93da-878f702e2fbf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.309156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3eb760b5-5de0-444b-93da-878f702e2fbf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:18.317216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3eb760b5-5de0-444b-93da-878f702e2fbf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.161812 Aug 31 00:23:18.317800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 228/420] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:18 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:18.469587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-99d75609-c8b7-4d0f-bbeb-53646c49eb79 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:18.470197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-99d75609-c8b7-4d0f-bbeb-53646c49eb79 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:18.476562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99d75609-c8b7-4d0f-bbeb-53646c49eb79 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.477048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99d75609-c8b7-4d0f-bbeb-53646c49eb79 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.477483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99d75609-c8b7-4d0f-bbeb-53646c49eb79 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.478241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99d75609-c8b7-4d0f-bbeb-53646c49eb79 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.478767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99d75609-c8b7-4d0f-bbeb-53646c49eb79 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.479229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99d75609-c8b7-4d0f-bbeb-53646c49eb79 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.606145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-99d75609-c8b7-4d0f-bbeb-53646c49eb79 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:18.614930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-99d75609-c8b7-4d0f-bbeb-53646c49eb79 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.149708 Aug 31 00:23:18.615523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 193/421] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:18 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:19.338733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1c2d922e-39ab-4b6b-ae29-b17f1b372c8b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:19.339354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1c2d922e-39ab-4b6b-ae29-b17f1b372c8b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:19.345920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c2d922e-39ab-4b6b-ae29-b17f1b372c8b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.346389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c2d922e-39ab-4b6b-ae29-b17f1b372c8b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.346812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c2d922e-39ab-4b6b-ae29-b17f1b372c8b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.347562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c2d922e-39ab-4b6b-ae29-b17f1b372c8b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.347989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c2d922e-39ab-4b6b-ae29-b17f1b372c8b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.348398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c2d922e-39ab-4b6b-ae29-b17f1b372c8b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.482082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1c2d922e-39ab-4b6b-ae29-b17f1b372c8b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:19.490810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1c2d922e-39ab-4b6b-ae29-b17f1b372c8b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.155887 Aug 31 00:23:19.491401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 229/422] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:19 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:19.636317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d4623857-811a-4855-8490-2ecd81ec6549 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:19.636867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d4623857-811a-4855-8490-2ecd81ec6549 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:19.644193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4623857-811a-4855-8490-2ecd81ec6549 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.644678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4623857-811a-4855-8490-2ecd81ec6549 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.645107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4623857-811a-4855-8490-2ecd81ec6549 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.645792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4623857-811a-4855-8490-2ecd81ec6549 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.646242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4623857-811a-4855-8490-2ecd81ec6549 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.646653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4623857-811a-4855-8490-2ecd81ec6549 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.778782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d4623857-811a-4855-8490-2ecd81ec6549 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:19.786794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d4623857-811a-4855-8490-2ecd81ec6549 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.154435 Aug 31 00:23:19.787393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 194/423] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:19 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:20.512776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-37889dd7-001d-4be0-821f-90bd80bfaeb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:20.513405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-37889dd7-001d-4be0-821f-90bd80bfaeb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:20.520630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37889dd7-001d-4be0-821f-90bd80bfaeb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.521468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37889dd7-001d-4be0-821f-90bd80bfaeb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.522254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37889dd7-001d-4be0-821f-90bd80bfaeb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.523054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37889dd7-001d-4be0-821f-90bd80bfaeb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.523509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37889dd7-001d-4be0-821f-90bd80bfaeb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.523930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37889dd7-001d-4be0-821f-90bd80bfaeb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.543806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:20.657563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-37889dd7-001d-4be0-821f-90bd80bfaeb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:20.665232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-37889dd7-001d-4be0-821f-90bd80bfaeb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.156666 Aug 31 00:23:20.665791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 230/424] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:20 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:20.809117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1b77968e-8b88-4a66-be06-9171922c717b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:20.809658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1b77968e-8b88-4a66-be06-9171922c717b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:20.816101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b77968e-8b88-4a66-be06-9171922c717b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.816583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b77968e-8b88-4a66-be06-9171922c717b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.817010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b77968e-8b88-4a66-be06-9171922c717b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.817688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b77968e-8b88-4a66-be06-9171922c717b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.818135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b77968e-8b88-4a66-be06-9171922c717b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.818556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b77968e-8b88-4a66-be06-9171922c717b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.954854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1b77968e-8b88-4a66-be06-9171922c717b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:20.962391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1b77968e-8b88-4a66-be06-9171922c717b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.157650 Aug 31 00:23:20.962949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 195/425] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:20 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:21.687767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fa5ba2a7-7fd7-4dde-96ac-03885d41d183 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:21.688373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fa5ba2a7-7fd7-4dde-96ac-03885d41d183 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:21.694321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5ba2a7-7fd7-4dde-96ac-03885d41d183 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:21.694802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5ba2a7-7fd7-4dde-96ac-03885d41d183 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:21.695268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5ba2a7-7fd7-4dde-96ac-03885d41d183 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:21.695962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5ba2a7-7fd7-4dde-96ac-03885d41d183 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:21.696415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5ba2a7-7fd7-4dde-96ac-03885d41d183 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:21.696871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5ba2a7-7fd7-4dde-96ac-03885d41d183 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:21.830903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fa5ba2a7-7fd7-4dde-96ac-03885d41d183 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:21.838760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fa5ba2a7-7fd7-4dde-96ac-03885d41d183 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.155235 Aug 31 00:23:21.839683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 231/426] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:21 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:21.983698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-27b10809-0e33-4758-8ca8-36e3e3b716dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:21.984399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-27b10809-0e33-4758-8ca8-36e3e3b716dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:21.990898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b10809-0e33-4758-8ca8-36e3e3b716dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:21.991422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b10809-0e33-4758-8ca8-36e3e3b716dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:21.991854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b10809-0e33-4758-8ca8-36e3e3b716dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:21.992542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b10809-0e33-4758-8ca8-36e3e3b716dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:21.992995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b10809-0e33-4758-8ca8-36e3e3b716dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:21.993412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b10809-0e33-4758-8ca8-36e3e3b716dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:22.127282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-27b10809-0e33-4758-8ca8-36e3e3b716dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:22.135129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-27b10809-0e33-4758-8ca8-36e3e3b716dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.155846 Aug 31 00:23:22.135917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 196/427] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:21 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:22.861381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-55e69913-cfbd-474e-971a-488b6b7f7d17 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:22.861999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-55e69913-cfbd-474e-971a-488b6b7f7d17 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:22.868051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55e69913-cfbd-474e-971a-488b6b7f7d17 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:22.868706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55e69913-cfbd-474e-971a-488b6b7f7d17 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:22.869137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55e69913-cfbd-474e-971a-488b6b7f7d17 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:22.869818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55e69913-cfbd-474e-971a-488b6b7f7d17 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:22.870263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55e69913-cfbd-474e-971a-488b6b7f7d17 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:22.870683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55e69913-cfbd-474e-971a-488b6b7f7d17 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.017256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-55e69913-cfbd-474e-971a-488b6b7f7d17 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:23.025026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-55e69913-cfbd-474e-971a-488b6b7f7d17 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.168029 Aug 31 00:23:23.025580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 232/428] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:22 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:23.158024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ab6571b4-8c8e-4398-9f4e-e82d3569a402 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:23.158617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ab6571b4-8c8e-4398-9f4e-e82d3569a402 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:23.165299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab6571b4-8c8e-4398-9f4e-e82d3569a402 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.165777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab6571b4-8c8e-4398-9f4e-e82d3569a402 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.166235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab6571b4-8c8e-4398-9f4e-e82d3569a402 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.166925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab6571b4-8c8e-4398-9f4e-e82d3569a402 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.167403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab6571b4-8c8e-4398-9f4e-e82d3569a402 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.167820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab6571b4-8c8e-4398-9f4e-e82d3569a402 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.347586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ab6571b4-8c8e-4398-9f4e-e82d3569a402 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:23.356281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ab6571b4-8c8e-4398-9f4e-e82d3569a402 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1504 microversion: 2.1 time: 0.202206 Aug 31 00:23:23.371732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 197/429] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:23 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:23.767654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-07369c68-76c9-41e2-9ba0-92f92c510104 req-e2d7fde5-8880-463f-93ff-e6ea95567b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df50fb74-c0ba-4741-95e4-8cae91fac7dd", "name": "network-vif-deleted", "tag": "283b37e6-36c4-4137-bd93-b317149a34f3"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:23.778695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-07369c68-76c9-41e2-9ba0-92f92c510104 req-e2d7fde5-8880-463f-93ff-e6ea95567b79 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.779202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-07369c68-76c9-41e2-9ba0-92f92c510104 req-e2d7fde5-8880-463f-93ff-e6ea95567b79 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.779631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-07369c68-76c9-41e2-9ba0-92f92c510104 req-e2d7fde5-8880-463f-93ff-e6ea95567b79 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.791307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-07369c68-76c9-41e2-9ba0-92f92c510104 req-e2d7fde5-8880-463f-93ff-e6ea95567b79 service nova] Creating event network-vif-deleted:283b37e6-36c4-4137-bd93-b317149a34f3 for instance df50fb74-c0ba-4741-95e4-8cae91fac7dd on hv-cinder-85506 Aug 31 00:23:23.796230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-07369c68-76c9-41e2-9ba0-92f92c510104 req-e2d7fde5-8880-463f-93ff-e6ea95567b79 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033725 Aug 31 00:23:23.796802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 233/430] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:24.046823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9a5bda4a-7bcf-4669-a606-ee94eec4ba1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:24.047537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9a5bda4a-7bcf-4669-a606-ee94eec4ba1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:24.053444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a5bda4a-7bcf-4669-a606-ee94eec4ba1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:24.053916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a5bda4a-7bcf-4669-a606-ee94eec4ba1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:24.054340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a5bda4a-7bcf-4669-a606-ee94eec4ba1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:24.055008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a5bda4a-7bcf-4669-a606-ee94eec4ba1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:24.055476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a5bda4a-7bcf-4669-a606-ee94eec4ba1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:24.055888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a5bda4a-7bcf-4669-a606-ee94eec4ba1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:24.185277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9a5bda4a-7bcf-4669-a606-ee94eec4ba1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:24.193630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9a5bda4a-7bcf-4669-a606-ee94eec4ba1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.150533 Aug 31 00:23:24.194189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 198/431] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:24 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:24.380014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8fc5a128-341a-4295-93e1-6423ea0ce7ef tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:24.380709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8fc5a128-341a-4295-93e1-6423ea0ce7ef tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:24.386802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fc5a128-341a-4295-93e1-6423ea0ce7ef tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:24.387309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fc5a128-341a-4295-93e1-6423ea0ce7ef tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:24.387744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fc5a128-341a-4295-93e1-6423ea0ce7ef tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:24.388424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fc5a128-341a-4295-93e1-6423ea0ce7ef tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:24.388873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fc5a128-341a-4295-93e1-6423ea0ce7ef tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:24.389291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fc5a128-341a-4295-93e1-6423ea0ce7ef tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:24.454428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8fc5a128-341a-4295-93e1-6423ea0ce7ef tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:24.462092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8fc5a128-341a-4295-93e1-6423ea0ce7ef tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1462 microversion: 2.1 time: 0.086335 Aug 31 00:23:24.462654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 234/432] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:24 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1462 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:25.215305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-01b3df19-aa8f-466f-962f-ba5420710f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:25.215936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-01b3df19-aa8f-466f-962f-ba5420710f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:25.223673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01b3df19-aa8f-466f-962f-ba5420710f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:25.224152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01b3df19-aa8f-466f-962f-ba5420710f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:25.224581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01b3df19-aa8f-466f-962f-ba5420710f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:25.225260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01b3df19-aa8f-466f-962f-ba5420710f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:25.225708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01b3df19-aa8f-466f-962f-ba5420710f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:25.226130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01b3df19-aa8f-466f-962f-ba5420710f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:25.353054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01b3df19-aa8f-466f-962f-ba5420710f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:25.361307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-01b3df19-aa8f-466f-962f-ba5420710f75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.149832 Aug 31 00:23:25.361878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 199/433] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:25 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:25.484160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5373f42a-cb3f-4d24-868f-75d1a9f9af2b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:25.484766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5373f42a-cb3f-4d24-868f-75d1a9f9af2b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:25.490760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5373f42a-cb3f-4d24-868f-75d1a9f9af2b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:25.491276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5373f42a-cb3f-4d24-868f-75d1a9f9af2b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:25.491713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5373f42a-cb3f-4d24-868f-75d1a9f9af2b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:25.492408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5373f42a-cb3f-4d24-868f-75d1a9f9af2b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:25.492859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5373f42a-cb3f-4d24-868f-75d1a9f9af2b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:25.493275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5373f42a-cb3f-4d24-868f-75d1a9f9af2b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:25.558481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5373f42a-cb3f-4d24-868f-75d1a9f9af2b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:25.567345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5373f42a-cb3f-4d24-868f-75d1a9f9af2b tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1462 microversion: 2.1 time: 0.087012 Aug 31 00:23:25.567908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 235/434] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:25 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1462 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:26.382507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-93b50411-3f2d-4459-82e8-cdd1b71b5beb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:26.383141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-93b50411-3f2d-4459-82e8-cdd1b71b5beb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:26.389603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93b50411-3f2d-4459-82e8-cdd1b71b5beb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:26.390084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93b50411-3f2d-4459-82e8-cdd1b71b5beb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:26.390520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93b50411-3f2d-4459-82e8-cdd1b71b5beb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:26.391933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93b50411-3f2d-4459-82e8-cdd1b71b5beb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:26.392427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93b50411-3f2d-4459-82e8-cdd1b71b5beb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:26.392854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93b50411-3f2d-4459-82e8-cdd1b71b5beb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:26.521162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-93b50411-3f2d-4459-82e8-cdd1b71b5beb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:26.528765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-93b50411-3f2d-4459-82e8-cdd1b71b5beb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.150106 Aug 31 00:23:26.529319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 200/435] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:26 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:26.588821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-714bd98d-b39b-447a-9a3e-590225f719dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:26.589415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-714bd98d-b39b-447a-9a3e-590225f719dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:26.591374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:26.596651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-714bd98d-b39b-447a-9a3e-590225f719dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:26.597122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-714bd98d-b39b-447a-9a3e-590225f719dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:26.597549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-714bd98d-b39b-447a-9a3e-590225f719dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:26.598217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-714bd98d-b39b-447a-9a3e-590225f719dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:26.598657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-714bd98d-b39b-447a-9a3e-590225f719dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:26.599086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-714bd98d-b39b-447a-9a3e-590225f719dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:26.659787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-714bd98d-b39b-447a-9a3e-590225f719dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:26.667409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-714bd98d-b39b-447a-9a3e-590225f719dd tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1462 microversion: 2.1 time: 0.082305 Aug 31 00:23:26.667948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 236/436] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:26 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1462 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:27.549785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ffe2e46c-15a8-4e40-9c88-181fd9292811 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:27.550392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ffe2e46c-15a8-4e40-9c88-181fd9292811 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:27.556790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffe2e46c-15a8-4e40-9c88-181fd9292811 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:27.557265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffe2e46c-15a8-4e40-9c88-181fd9292811 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:27.557696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffe2e46c-15a8-4e40-9c88-181fd9292811 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:27.558600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffe2e46c-15a8-4e40-9c88-181fd9292811 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:27.559063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffe2e46c-15a8-4e40-9c88-181fd9292811 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:27.559485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffe2e46c-15a8-4e40-9c88-181fd9292811 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:27.689267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-26061a66-f907-4de5-bd7d-34e92d5b6c4d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:27.689760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ffe2e46c-15a8-4e40-9c88-181fd9292811 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:27.689886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-26061a66-f907-4de5-bd7d-34e92d5b6c4d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:27.695810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26061a66-f907-4de5-bd7d-34e92d5b6c4d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:27.696285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26061a66-f907-4de5-bd7d-34e92d5b6c4d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:27.696711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26061a66-f907-4de5-bd7d-34e92d5b6c4d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:27.697356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ffe2e46c-15a8-4e40-9c88-181fd9292811 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.151727 Aug 31 00:23:27.697456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26061a66-f907-4de5-bd7d-34e92d5b6c4d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:27.697822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26061a66-f907-4de5-bd7d-34e92d5b6c4d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:27.697928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 201/437] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:27 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:27.698239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26061a66-f907-4de5-bd7d-34e92d5b6c4d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:27.761204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-26061a66-f907-4de5-bd7d-34e92d5b6c4d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:27.769325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-26061a66-f907-4de5-bd7d-34e92d5b6c4d tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1462 microversion: 2.1 time: 0.084460 Aug 31 00:23:27.769885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 237/438] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:27 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:28.719449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-85a63564-41fb-4d2d-a2ca-18bf60dce2ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:28.720128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-85a63564-41fb-4d2d-a2ca-18bf60dce2ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:28.726555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85a63564-41fb-4d2d-a2ca-18bf60dce2ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.727029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85a63564-41fb-4d2d-a2ca-18bf60dce2ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.727486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85a63564-41fb-4d2d-a2ca-18bf60dce2ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.728163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85a63564-41fb-4d2d-a2ca-18bf60dce2ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.728614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85a63564-41fb-4d2d-a2ca-18bf60dce2ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.729029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85a63564-41fb-4d2d-a2ca-18bf60dce2ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.732978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:28.789866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d40323c5-7a63-4dbc-a4a7-5addb781bc65 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:28.790489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d40323c5-7a63-4dbc-a4a7-5addb781bc65 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:28.796314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d40323c5-7a63-4dbc-a4a7-5addb781bc65 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.796793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d40323c5-7a63-4dbc-a4a7-5addb781bc65 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.797225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d40323c5-7a63-4dbc-a4a7-5addb781bc65 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.798725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d40323c5-7a63-4dbc-a4a7-5addb781bc65 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.799417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d40323c5-7a63-4dbc-a4a7-5addb781bc65 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.799949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d40323c5-7a63-4dbc-a4a7-5addb781bc65 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.872547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d40323c5-7a63-4dbc-a4a7-5addb781bc65 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:28.881099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d40323c5-7a63-4dbc-a4a7-5addb781bc65 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1462 microversion: 2.1 time: 0.095180 Aug 31 00:23:28.881723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 238/439] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:28 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1462 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:28.887383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-85a63564-41fb-4d2d-a2ca-18bf60dce2ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:28.897979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-85a63564-41fb-4d2d-a2ca-18bf60dce2ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.182393 Aug 31 00:23:28.898956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 202/440] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:28 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:29.903453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8c88b393-71f4-434a-a786-807b7bf14808 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:29.904159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8c88b393-71f4-434a-a786-807b7bf14808 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:29.910566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c88b393-71f4-434a-a786-807b7bf14808 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:29.911065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c88b393-71f4-434a-a786-807b7bf14808 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:29.911512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c88b393-71f4-434a-a786-807b7bf14808 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:29.912198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c88b393-71f4-434a-a786-807b7bf14808 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:29.912941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c88b393-71f4-434a-a786-807b7bf14808 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:29.913375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c88b393-71f4-434a-a786-807b7bf14808 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:29.919375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-93cbb594-1e15-4c0c-b71f-39c1f516426b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:29.919967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-93cbb594-1e15-4c0c-b71f-39c1f516426b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:29.926773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93cbb594-1e15-4c0c-b71f-39c1f516426b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:29.927277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93cbb594-1e15-4c0c-b71f-39c1f516426b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:29.927705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93cbb594-1e15-4c0c-b71f-39c1f516426b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:29.928386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93cbb594-1e15-4c0c-b71f-39c1f516426b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:29.928833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93cbb594-1e15-4c0c-b71f-39c1f516426b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:29.929264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93cbb594-1e15-4c0c-b71f-39c1f516426b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:29.978720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8c88b393-71f4-434a-a786-807b7bf14808 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:29.986654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8c88b393-71f4-434a-a786-807b7bf14808 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1299 microversion: 2.1 time: 0.087186 Aug 31 00:23:29.987321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 239/441] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:29 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:30.088253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-93cbb594-1e15-4c0c-b71f-39c1f516426b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:30.095950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-93cbb594-1e15-4c0c-b71f-39c1f516426b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.180514 Aug 31 00:23:30.096561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 203/442] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:29 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:31.007817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:31.008458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:31.014303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.014759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.015232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.015955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.017215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.017664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.050271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.050751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.051211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.051654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lazy-loading 'fault' on Instance uuid df50fb74-c0ba-4741-95e4-8cae91fac7dd {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:31.093224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:31.101676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6e34de95-9843-4806-bdc3-dba7ac01d1b6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1304 microversion: 2.1 time: 0.097668 Aug 31 00:23:31.102235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 240/443] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:31 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:31.119776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-27bcf4c4-75b3-4a96-865f-46922d800a35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:31.120423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-27bcf4c4-75b3-4a96-865f-46922d800a35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:31.126959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27bcf4c4-75b3-4a96-865f-46922d800a35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.127471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27bcf4c4-75b3-4a96-865f-46922d800a35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.127894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27bcf4c4-75b3-4a96-865f-46922d800a35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.128570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27bcf4c4-75b3-4a96-865f-46922d800a35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.129013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27bcf4c4-75b3-4a96-865f-46922d800a35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.129426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27bcf4c4-75b3-4a96-865f-46922d800a35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.273671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-27bcf4c4-75b3-4a96-865f-46922d800a35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:31.281256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-27bcf4c4-75b3-4a96-865f-46922d800a35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.165430 Aug 31 00:23:31.281816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 204/444] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:31 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:32.121579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:32.122209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:32.129203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.129686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.130114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.130797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.131285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.131691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.165859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.166338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.166769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.167244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lazy-loading 'fault' on Instance uuid df50fb74-c0ba-4741-95e4-8cae91fac7dd {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:32.207423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5a1b739a54c3aa4dcb53e5bbe0452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c6a3ef756488eac765456d78ff335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:32.215193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6220aaef-0671-4b04-aa43-2d2909a160a6 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 200 len: 1304 microversion: 2.1 time: 0.097421 Aug 31 00:23:32.215758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 241/445] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:32 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:32.302367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a6c8104c-62b2-4ea3-b274-9a0d96837ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:32.303003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a6c8104c-62b2-4ea3-b274-9a0d96837ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:32.309540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6c8104c-62b2-4ea3-b274-9a0d96837ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.309966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6c8104c-62b2-4ea3-b274-9a0d96837ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.310399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6c8104c-62b2-4ea3-b274-9a0d96837ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.311112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6c8104c-62b2-4ea3-b274-9a0d96837ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.311563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6c8104c-62b2-4ea3-b274-9a0d96837ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.311983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6c8104c-62b2-4ea3-b274-9a0d96837ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.447300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a6c8104c-62b2-4ea3-b274-9a0d96837ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:32.455119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a6c8104c-62b2-4ea3-b274-9a0d96837ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1501 microversion: 2.1 time: 0.156631 Aug 31 00:23:32.455692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 205/446] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:32 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:32.476534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20530f93-61ab-45f7-9ac4-9dbba5740d57"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:32.478196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:32.484137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.484607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.485783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.486259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.486692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.487154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.511743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Cannot 'attach_volume' instance 82098e98-ab74-415b-9d57-1e55a9524ce1 while it is in vm_state rescued Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: POST /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1/os-volume_attachments HTTP/1.1 Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 74 Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:23:32.513397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {"volumeAttachment": {"volumeId": "20530f93-61ab-45f7-9ac4-9dbba5740d57"}} Aug 31 00:23:32.514897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Cannot 'attach_volume' instance 82098e98-ab74-415b-9d57-1e55a9524ce1 while it is in vm_state rescued Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '82098e98-ab74-415b-9d57-1e55a9524ce1', 'body': {'volumeAttachment': {'volumeId': '20530f93-61ab-45f7-9ac4-9dbba5740d57'}}} Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82098e98-ab74-415b-9d57-1e55a9524ce1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:23:32.515820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 82098e98-ab74-415b-9d57-1e55a9524ce1 while it is in vm_state rescued Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:23:32.517849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:23:32.519283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:23:32.519283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:23:32.519283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 82098e98-ab74-415b-9d57-1e55a9524ce1 while it is in vm_state rescued Aug 31 00:23:32.519283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:23:32.519283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 409 to user: Cannot 'attach_volume' instance 82098e98-ab74-415b-9d57-1e55a9524ce1 while it is in vm_state rescued {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:23:32.519283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-db330179-8049-4a0b-8ab1-ce3694bfa7bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042785 Aug 31 00:23:32.519283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 242/447] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 00:23:32 2022] POST /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:23:32.524829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-39b867f1-2c92-4bc9-98a8-02f230a2913a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:32.525356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-39b867f1-2c92-4bc9-98a8-02f230a2913a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:32.527202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:32.533190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39b867f1-2c92-4bc9-98a8-02f230a2913a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.533671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39b867f1-2c92-4bc9-98a8-02f230a2913a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.534100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39b867f1-2c92-4bc9-98a8-02f230a2913a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.534785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39b867f1-2c92-4bc9-98a8-02f230a2913a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.535276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39b867f1-2c92-4bc9-98a8-02f230a2913a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.535695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39b867f1-2c92-4bc9-98a8-02f230a2913a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.602660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-39b867f1-2c92-4bc9-98a8-02f230a2913a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1/action" status: 202 len: 0 microversion: 2.1 time: 0.081450 Aug 31 00:23:32.603326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 206/448] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 00:23:32 2022] POST /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:23:32.612014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d08f4e6f-205a-455e-bc0d-7e1896f0a44d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:32.612611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d08f4e6f-205a-455e-bc0d-7e1896f0a44d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:32.618557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d08f4e6f-205a-455e-bc0d-7e1896f0a44d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.619025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d08f4e6f-205a-455e-bc0d-7e1896f0a44d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.619484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d08f4e6f-205a-455e-bc0d-7e1896f0a44d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.620157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d08f4e6f-205a-455e-bc0d-7e1896f0a44d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.620598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d08f4e6f-205a-455e-bc0d-7e1896f0a44d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.621008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d08f4e6f-205a-455e-bc0d-7e1896f0a44d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.755743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d08f4e6f-205a-455e-bc0d-7e1896f0a44d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:32.763401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d08f4e6f-205a-455e-bc0d-7e1896f0a44d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.155820 Aug 31 00:23:32.763959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 243/449] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:32 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:33.237034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:33.237736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] [instance: df50fb74-c0ba-4741-95e4-8cae91fac7dd] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:33.244591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:33.245062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:33.245543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:33.246167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:33.246615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:33.247059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:33.260863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] HTTP exception thrown: Instance df50fb74-c0ba-4741-95e4-8cae91fac7dd could not be found. Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Request method failure captured: Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd HTTP/1.1 Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqmHSNagBRFmK3pv0aElC4zYWTOPszHfNkl6lI1ePtbpa2jWhGsil54sAA8hzZrEOZhZFuDSMvo7P3IuNeXjP6XQF7igv8MYUNg2qwJKhjlffSxnUMIGEnHtar5tuWvakgiStLXvns86jU9koRz-uJaF1T8640-faSHWXVzR5Neyf64 Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: d94c6a3ef756488eac765456d78ff335 Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesActionsTest-2109410617 Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:23:33.262438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d94c6a3ef756488eac765456d78ff335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d94c6a3ef756488eac765456d78ff335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d94c6a3ef756488eac765456d78ff335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d94c6a3ef756488eac765456d78ff335", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesActionsTest-2109410617 Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: d94c6a3ef756488eac765456d78ff335 Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesActionsTest-2109410617 Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesActionsTest-2109410617-project Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 95e5a1b739a54c3aa4dcb53e5bbe0452 Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesActionsTest-2109410617-project Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance df50fb74-c0ba-4741-95e4-8cae91fac7dd could not be found. Aug 31 00:23:33.263920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': 'df50fb74-c0ba-4741-95e4-8cae91fac7dd'} Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df50fb74-c0ba-4741-95e4-8cae91fac7dd could not be found. Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:23:33.264772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df50fb74-c0ba-4741-95e4-8cae91fac7dd could not be found. Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df50fb74-c0ba-4741-95e4-8cae91fac7dd could not be found. Aug 31 00:23:33.265912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:23:33.267952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] Returning 404 to user: Instance df50fb74-c0ba-4741-95e4-8cae91fac7dd could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:23:33.267952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8f18fe88-1afc-4299-9300-cf480a3f9d44 tempest-VolumesActionsTest-2109410617 tempest-VolumesActionsTest-2109410617-project] 10.222.0.67 "GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd" status: 404 len: 111 microversion: 2.1 time: 0.031553 Aug 31 00:23:33.267952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 207/450] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:33 2022] GET /compute/v2.1/servers/df50fb74-c0ba-4741-95e4-8cae91fac7dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:23:33.786391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e09d563a-de52-45e5-bf29-1a881888b497 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:33.787263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e09d563a-de52-45e5-bf29-1a881888b497 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:33.793348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e09d563a-de52-45e5-bf29-1a881888b497 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:33.793831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e09d563a-de52-45e5-bf29-1a881888b497 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:33.794266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e09d563a-de52-45e5-bf29-1a881888b497 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:33.794958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e09d563a-de52-45e5-bf29-1a881888b497 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:33.795437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e09d563a-de52-45e5-bf29-1a881888b497 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:33.795861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e09d563a-de52-45e5-bf29-1a881888b497 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:33.929707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e09d563a-de52-45e5-bf29-1a881888b497 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:33.937445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e09d563a-de52-45e5-bf29-1a881888b497 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.155679 Aug 31 00:23:33.937995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 244/451] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:33 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:34.959874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f7de7bab-80eb-49b9-a9d7-231318f0f5f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:34.960423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f7de7bab-80eb-49b9-a9d7-231318f0f5f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:34.967171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7de7bab-80eb-49b9-a9d7-231318f0f5f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:34.967662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7de7bab-80eb-49b9-a9d7-231318f0f5f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:34.968092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7de7bab-80eb-49b9-a9d7-231318f0f5f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:34.968790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7de7bab-80eb-49b9-a9d7-231318f0f5f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:34.969237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7de7bab-80eb-49b9-a9d7-231318f0f5f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:34.970314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7de7bab-80eb-49b9-a9d7-231318f0f5f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:35.105643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f7de7bab-80eb-49b9-a9d7-231318f0f5f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:35.113734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f7de7bab-80eb-49b9-a9d7-231318f0f5f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.157891 Aug 31 00:23:35.114291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 208/452] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:34 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:36.135059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a81a135e-424e-48b4-a48a-3810500a3b0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:36.135684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a81a135e-424e-48b4-a48a-3810500a3b0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:36.142402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a81a135e-424e-48b4-a48a-3810500a3b0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.142915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a81a135e-424e-48b4-a48a-3810500a3b0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.143390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a81a135e-424e-48b4-a48a-3810500a3b0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a81a135e-424e-48b4-a48a-3810500a3b0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.145371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a81a135e-424e-48b4-a48a-3810500a3b0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.145371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a81a135e-424e-48b4-a48a-3810500a3b0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.281731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a81a135e-424e-48b4-a48a-3810500a3b0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:36.289646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a81a135e-424e-48b4-a48a-3810500a3b0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.158427 Aug 31 00:23:36.290215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 245/453] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:36 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:37.311493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-38fa9e01-a28f-43d6-8f49-9c6d14c685b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:37.312048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-38fa9e01-a28f-43d6-8f49-9c6d14c685b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:37.318918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38fa9e01-a28f-43d6-8f49-9c6d14c685b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.319451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38fa9e01-a28f-43d6-8f49-9c6d14c685b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.319881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38fa9e01-a28f-43d6-8f49-9c6d14c685b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.320559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38fa9e01-a28f-43d6-8f49-9c6d14c685b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.321004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38fa9e01-a28f-43d6-8f49-9c6d14c685b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.321417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38fa9e01-a28f-43d6-8f49-9c6d14c685b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.452213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-38fa9e01-a28f-43d6-8f49-9c6d14c685b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:37.459860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-38fa9e01-a28f-43d6-8f49-9c6d14c685b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.152303 Aug 31 00:23:37.460413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 209/454] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:37 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:38.481705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-39648348-99c9-4005-a2c8-560cbe788121 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:38.482312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-39648348-99c9-4005-a2c8-560cbe788121 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:38.488362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39648348-99c9-4005-a2c8-560cbe788121 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.488838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39648348-99c9-4005-a2c8-560cbe788121 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.489272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39648348-99c9-4005-a2c8-560cbe788121 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.489955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39648348-99c9-4005-a2c8-560cbe788121 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.490403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39648348-99c9-4005-a2c8-560cbe788121 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.490823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39648348-99c9-4005-a2c8-560cbe788121 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.624766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-39648348-99c9-4005-a2c8-560cbe788121 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:38.632700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-39648348-99c9-4005-a2c8-560cbe788121 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.154831 Aug 31 00:23:38.633261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 246/455] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:38 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:39.654531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6e427a39-a5dc-4e39-a770-bae2dbc19f5c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:39.655199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6e427a39-a5dc-4e39-a770-bae2dbc19f5c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:39.662058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e427a39-a5dc-4e39-a770-bae2dbc19f5c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:39.662537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e427a39-a5dc-4e39-a770-bae2dbc19f5c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:39.662994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e427a39-a5dc-4e39-a770-bae2dbc19f5c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:39.663687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e427a39-a5dc-4e39-a770-bae2dbc19f5c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:39.664142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e427a39-a5dc-4e39-a770-bae2dbc19f5c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:39.664564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e427a39-a5dc-4e39-a770-bae2dbc19f5c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:39.793756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6e427a39-a5dc-4e39-a770-bae2dbc19f5c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:39.801416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6e427a39-a5dc-4e39-a770-bae2dbc19f5c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.150745 Aug 31 00:23:39.801966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 210/456] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:39 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:40.823078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f5cf872b-35e0-438f-9d3a-9735164c0077 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:40.823612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f5cf872b-35e0-438f-9d3a-9735164c0077 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:40.829671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf872b-35e0-438f-9d3a-9735164c0077 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:40.830146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf872b-35e0-438f-9d3a-9735164c0077 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:40.830575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf872b-35e0-438f-9d3a-9735164c0077 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:40.831280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf872b-35e0-438f-9d3a-9735164c0077 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:40.831730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf872b-35e0-438f-9d3a-9735164c0077 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:40.832147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf872b-35e0-438f-9d3a-9735164c0077 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:40.849822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:40.981969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f5cf872b-35e0-438f-9d3a-9735164c0077 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:40.990173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f5cf872b-35e0-438f-9d3a-9735164c0077 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.170998 Aug 31 00:23:40.990734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 247/457] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:40 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:42.011874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9914d2ea-44a6-41bf-b03e-808359f7fc02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:42.012658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9914d2ea-44a6-41bf-b03e-808359f7fc02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:42.019509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9914d2ea-44a6-41bf-b03e-808359f7fc02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:42.019999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9914d2ea-44a6-41bf-b03e-808359f7fc02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:42.020431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9914d2ea-44a6-41bf-b03e-808359f7fc02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:42.021115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9914d2ea-44a6-41bf-b03e-808359f7fc02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:42.021566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9914d2ea-44a6-41bf-b03e-808359f7fc02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:42.021987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9914d2ea-44a6-41bf-b03e-808359f7fc02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:42.387813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9914d2ea-44a6-41bf-b03e-808359f7fc02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:42.396314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9914d2ea-44a6-41bf-b03e-808359f7fc02 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.388305 Aug 31 00:23:42.396873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 211/458] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:42 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:43.418745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-01f18adf-78b6-465e-8ddc-98c722333394 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:43.419402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-01f18adf-78b6-465e-8ddc-98c722333394 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:43.425696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01f18adf-78b6-465e-8ddc-98c722333394 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:43.426179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01f18adf-78b6-465e-8ddc-98c722333394 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:43.426607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01f18adf-78b6-465e-8ddc-98c722333394 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:43.427326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01f18adf-78b6-465e-8ddc-98c722333394 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:43.427778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01f18adf-78b6-465e-8ddc-98c722333394 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:43.428200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01f18adf-78b6-465e-8ddc-98c722333394 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:43.553694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01f18adf-78b6-465e-8ddc-98c722333394 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:43.561295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-01f18adf-78b6-465e-8ddc-98c722333394 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.146373 Aug 31 00:23:43.561855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 248/459] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:43 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:44.583000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-640ba921-dc04-4c15-8675-2b9beb8264b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:44.583641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-640ba921-dc04-4c15-8675-2b9beb8264b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:44.590254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-640ba921-dc04-4c15-8675-2b9beb8264b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:44.590738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-640ba921-dc04-4c15-8675-2b9beb8264b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:44.591207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-640ba921-dc04-4c15-8675-2b9beb8264b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:44.591895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-640ba921-dc04-4c15-8675-2b9beb8264b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:44.592347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-640ba921-dc04-4c15-8675-2b9beb8264b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:44.592763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-640ba921-dc04-4c15-8675-2b9beb8264b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:44.724758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-640ba921-dc04-4c15-8675-2b9beb8264b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:44.732628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-640ba921-dc04-4c15-8675-2b9beb8264b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.153514 Aug 31 00:23:44.733183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 212/460] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:44 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:45.753694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-51642d30-cb3e-40e6-a3f6-e51c49811a22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:45.754328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-51642d30-cb3e-40e6-a3f6-e51c49811a22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:45.760405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51642d30-cb3e-40e6-a3f6-e51c49811a22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.760887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51642d30-cb3e-40e6-a3f6-e51c49811a22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.761327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51642d30-cb3e-40e6-a3f6-e51c49811a22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.762019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51642d30-cb3e-40e6-a3f6-e51c49811a22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.762467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51642d30-cb3e-40e6-a3f6-e51c49811a22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.762889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51642d30-cb3e-40e6-a3f6-e51c49811a22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.889611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-51642d30-cb3e-40e6-a3f6-e51c49811a22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:45.898394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-51642d30-cb3e-40e6-a3f6-e51c49811a22 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.148624 Aug 31 00:23:45.898974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 249/461] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:45 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:46.922258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fd9d5e22-e4b5-45b5-9d07-7d86f9644b35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:46.922869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fd9d5e22-e4b5-45b5-9d07-7d86f9644b35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:46.929610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d5e22-e4b5-45b5-9d07-7d86f9644b35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:46.930093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d5e22-e4b5-45b5-9d07-7d86f9644b35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:46.930526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d5e22-e4b5-45b5-9d07-7d86f9644b35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:46.931317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d5e22-e4b5-45b5-9d07-7d86f9644b35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:46.931776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d5e22-e4b5-45b5-9d07-7d86f9644b35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:46.932200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d5e22-e4b5-45b5-9d07-7d86f9644b35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:47.062925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fd9d5e22-e4b5-45b5-9d07-7d86f9644b35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:47.071141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fd9d5e22-e4b5-45b5-9d07-7d86f9644b35 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.152723 Aug 31 00:23:47.071724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 213/462] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:46 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:48.093062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f3c7464a-6aa4-41c3-9ccc-cff3acd7cda1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:48.093590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f3c7464a-6aa4-41c3-9ccc-cff3acd7cda1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:48.099806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3c7464a-6aa4-41c3-9ccc-cff3acd7cda1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:48.100285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3c7464a-6aa4-41c3-9ccc-cff3acd7cda1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:48.100711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3c7464a-6aa4-41c3-9ccc-cff3acd7cda1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:48.101389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3c7464a-6aa4-41c3-9ccc-cff3acd7cda1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:48.101837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3c7464a-6aa4-41c3-9ccc-cff3acd7cda1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:48.102252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3c7464a-6aa4-41c3-9ccc-cff3acd7cda1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:48.230638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3c7464a-6aa4-41c3-9ccc-cff3acd7cda1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:48.238940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f3c7464a-6aa4-41c3-9ccc-cff3acd7cda1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.149822 Aug 31 00:23:48.239533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 250/463] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:48 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:49.261031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4189f562-73b0-4fe1-b93a-3149c7e5e09c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:49.261591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4189f562-73b0-4fe1-b93a-3149c7e5e09c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:49.268248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4189f562-73b0-4fe1-b93a-3149c7e5e09c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:49.268718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4189f562-73b0-4fe1-b93a-3149c7e5e09c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:49.269151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4189f562-73b0-4fe1-b93a-3149c7e5e09c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:49.269826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4189f562-73b0-4fe1-b93a-3149c7e5e09c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:49.270268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4189f562-73b0-4fe1-b93a-3149c7e5e09c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:49.270683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4189f562-73b0-4fe1-b93a-3149c7e5e09c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:49.401900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4189f562-73b0-4fe1-b93a-3149c7e5e09c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:49.410217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4189f562-73b0-4fe1-b93a-3149c7e5e09c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.153115 Aug 31 00:23:49.410786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 214/464] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:49 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:50.432021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-41f5d230-f5d3-4f97-9f11-c8e72e50c155 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:50.432622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-41f5d230-f5d3-4f97-9f11-c8e72e50c155 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:50.438465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f5d230-f5d3-4f97-9f11-c8e72e50c155 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.439738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f5d230-f5d3-4f97-9f11-c8e72e50c155 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.440180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f5d230-f5d3-4f97-9f11-c8e72e50c155 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.440855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f5d230-f5d3-4f97-9f11-c8e72e50c155 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.441303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f5d230-f5d3-4f97-9f11-c8e72e50c155 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.441744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f5d230-f5d3-4f97-9f11-c8e72e50c155 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.569811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-41f5d230-f5d3-4f97-9f11-c8e72e50c155 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:50.577385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-41f5d230-f5d3-4f97-9f11-c8e72e50c155 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.149151 Aug 31 00:23:50.577941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 251/465] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:50 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:51.599297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-96d7a7bf-5c73-4167-a5c2-c750ef04bf05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:51.599888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-96d7a7bf-5c73-4167-a5c2-c750ef04bf05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:51.605774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96d7a7bf-5c73-4167-a5c2-c750ef04bf05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.606249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96d7a7bf-5c73-4167-a5c2-c750ef04bf05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.606671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96d7a7bf-5c73-4167-a5c2-c750ef04bf05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.607370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96d7a7bf-5c73-4167-a5c2-c750ef04bf05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.607813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96d7a7bf-5c73-4167-a5c2-c750ef04bf05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.608222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96d7a7bf-5c73-4167-a5c2-c750ef04bf05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.740276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-96d7a7bf-5c73-4167-a5c2-c750ef04bf05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:51.748218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-96d7a7bf-5c73-4167-a5c2-c750ef04bf05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.153489 Aug 31 00:23:51.748779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 215/466] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:51 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:52.770279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c6acd2e7-aa0c-4b20-a2a1-979ec88d101d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:52.770880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c6acd2e7-aa0c-4b20-a2a1-979ec88d101d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:52.777067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6acd2e7-aa0c-4b20-a2a1-979ec88d101d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:52.777537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6acd2e7-aa0c-4b20-a2a1-979ec88d101d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:52.777962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6acd2e7-aa0c-4b20-a2a1-979ec88d101d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:52.778662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6acd2e7-aa0c-4b20-a2a1-979ec88d101d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:52.779127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6acd2e7-aa0c-4b20-a2a1-979ec88d101d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:52.779542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6acd2e7-aa0c-4b20-a2a1-979ec88d101d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:52.909463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c6acd2e7-aa0c-4b20-a2a1-979ec88d101d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:52.917027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c6acd2e7-aa0c-4b20-a2a1-979ec88d101d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.151292 Aug 31 00:23:52.917581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 252/467] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:52 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:53.940939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2c268080-cf80-408b-ae0c-c187fd4fa5f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:53.941764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2c268080-cf80-408b-ae0c-c187fd4fa5f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:53.948227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c268080-cf80-408b-ae0c-c187fd4fa5f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:53.948703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c268080-cf80-408b-ae0c-c187fd4fa5f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:53.949132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c268080-cf80-408b-ae0c-c187fd4fa5f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:53.949818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c268080-cf80-408b-ae0c-c187fd4fa5f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:53.950266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c268080-cf80-408b-ae0c-c187fd4fa5f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:53.950712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c268080-cf80-408b-ae0c-c187fd4fa5f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:54.078869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2c268080-cf80-408b-ae0c-c187fd4fa5f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:54.087544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2c268080-cf80-408b-ae0c-c187fd4fa5f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.151101 Aug 31 00:23:54.088108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 216/468] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:53 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:55.109156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9048edbc-a0e5-4e14-ac4d-583178db5dbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:55.110391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9048edbc-a0e5-4e14-ac4d-583178db5dbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:55.117465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9048edbc-a0e5-4e14-ac4d-583178db5dbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:55.118011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9048edbc-a0e5-4e14-ac4d-583178db5dbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:55.118448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9048edbc-a0e5-4e14-ac4d-583178db5dbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:55.119263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9048edbc-a0e5-4e14-ac4d-583178db5dbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:55.119717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9048edbc-a0e5-4e14-ac4d-583178db5dbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:55.120207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9048edbc-a0e5-4e14-ac4d-583178db5dbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:55.264669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9048edbc-a0e5-4e14-ac4d-583178db5dbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:55.273825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9048edbc-a0e5-4e14-ac4d-583178db5dbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1509 microversion: 2.1 time: 0.168754 Aug 31 00:23:55.274394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 253/469] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:55 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:56.296398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-05da0f16-c349-4d33-a269-fb2801600ae8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:56.297767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-05da0f16-c349-4d33-a269-fb2801600ae8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:56.304815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05da0f16-c349-4d33-a269-fb2801600ae8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:56.305568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05da0f16-c349-4d33-a269-fb2801600ae8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:56.306058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05da0f16-c349-4d33-a269-fb2801600ae8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:56.306806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05da0f16-c349-4d33-a269-fb2801600ae8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:56.307523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05da0f16-c349-4d33-a269-fb2801600ae8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:56.308187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05da0f16-c349-4d33-a269-fb2801600ae8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:56.480357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-119752670", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1651012719", "security_groups": [{"name": "tempest-secgroup-smoke-1728845074"}], "block_device_mapping_v2": [{"uuid": "ac7812ae-6383-4b12-966b-80194c59651b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21ad909f-0afd-4817-bcd2-68090ccea7ac"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:56.547381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-05da0f16-c349-4d33-a269-fb2801600ae8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:56.563050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-05da0f16-c349-4d33-a269-fb2801600ae8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1515 microversion: 2.1 time: 0.270882 Aug 31 00:23:56.564051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 217/470] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:56 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:56.661056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] validate_networks() for [('21ad909f-0afd-4817-bcd2-68090ccea7ac', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:23:56.913762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=42 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:57.165017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:23:57.165879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:23:57.166935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:23:57.167565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:23:57.168256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:23:57.179278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.179765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.180202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.180923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.181377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.181797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.199666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Getting quotas for project d201c4183dde4ac693ac92c43c02df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:23:57.203709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Getting quotas for user f9add734db2a4adc9857040166c02675 and project d201c4183dde4ac693ac92c43c02df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:23:57.274049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:23:57.276322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac7812ae-6383-4b12-966b-80194c59651b',volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:23:57.451315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8778ca03-9906-410c-ac07-7d525b984aeb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.975236 Aug 31 00:23:57.452385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 254/471] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:23:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:23:57.464020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-80193ac5-ad48-4606-821e-72f2cdba1bd9 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:57.464779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-80193ac5-ad48-4606-821e-72f2cdba1bd9 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:57.534713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-80193ac5-ad48-4606-821e-72f2cdba1bd9 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:57.544584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-80193ac5-ad48-4606-821e-72f2cdba1bd9 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1094 microversion: 2.1 time: 0.084292 Aug 31 00:23:57.546578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 218/472] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:57 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:58.042613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-51f60d15-828b-4598-9e3d-2cdec98ad023 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'create', calling method: .version_select at 0x7fa7f49ef550>, body: {"keypair": {"name": "tempest-keypair-658308212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYxgc9lW9ZEkHRTPIK9ir0CCZL+Yy9Nlt8DnAzVOIeqfxEPlmQD3EhXxxXUrRAOqcrrUf3XukG0p0ev+X4MfQMFNWzeMDM1kP39hSFlOa5c8Q0AR/thMkDOCAiB9Ugjkg=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:58.063196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-51f60d15-828b-4598-9e3d-2cdec98ad023 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Getting quotas for project 6a4d75f50b854a909607941db6debb87. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:23:58.068338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-51f60d15-828b-4598-9e3d-2cdec98ad023 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Getting quotas for user 3ff39cd0e766400f9d25e3ad465c4faf and project 6a4d75f50b854a909607941db6debb87. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:23:58.105142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-51f60d15-828b-4598-9e3d-2cdec98ad023 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065976 Aug 31 00:23:58.106185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 255/473] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 31 00:23:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:58.576205 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fe90ce3b-3600-4fde-ac83-f8dfe7daef2a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:58.577179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fe90ce3b-3600-4fde-ac83-f8dfe7daef2a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:58.674360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fe90ce3b-3600-4fde-ac83-f8dfe7daef2a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:58.689188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fe90ce3b-3600-4fde-ac83-f8dfe7daef2a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1094 microversion: 2.1 time: 0.122916 Aug 31 00:23:58.691293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 219/474] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:58 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1094 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:59.713161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5c10dd3c-a62a-425e-8ea0-e1365f77dfcd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:59.713945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5c10dd3c-a62a-425e-8ea0-e1365f77dfcd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:59.873718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5c10dd3c-a62a-425e-8ea0-e1365f77dfcd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:59.886398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5c10dd3c-a62a-425e-8ea0-e1365f77dfcd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1094 microversion: 2.1 time: 0.177989 Aug 31 00:23:59.893344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 256/475] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:59 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1094 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:59.909833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1752663519", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b02c08c3-060e-47b9-b9e9-e82b81bdce52"}], "security_groups": [{"name": "tempest-securitygroup--273975641"}], "key_name": "tempest-keypair-658308212", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:00.032676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] validate_networks() for [('b02c08c3-060e-47b9-b9e9-e82b81bdce52', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:24:00.504860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:24:00.505697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:24:00.506140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:24:00.506546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:24:00.506953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:24:00.521335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:00.522194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:00.522811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:00.523729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:00.524395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:00.527664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:00.538476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:00.553794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Getting quotas for project 6a4d75f50b854a909607941db6debb87. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:24:00.563945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Getting quotas for user 3ff39cd0e766400f9d25e3ad465c4faf and project 6a4d75f50b854a909607941db6debb87. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:24:00.577975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:24:00.585604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:24:00.653756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [5780e6ba-6100-4c87-8918-d53622a420c6] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 00:24:00.920681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0a01c05a-2e45-4888-bcfc-c96b905b5592 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:00.921298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0a01c05a-2e45-4888-bcfc-c96b905b5592 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:01.018049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0a01c05a-2e45-4888-bcfc-c96b905b5592 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:01.028373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0a01c05a-2e45-4888-bcfc-c96b905b5592 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1094 microversion: 2.1 time: 0.113487 Aug 31 00:24:01.029238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 257/476] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:00 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1094 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:01.665584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [5780e6ba-6100-4c87-8918-d53622a420c6] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 58428. Aug 31 00:24:01.682432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cc65c367-5901-489c-8f7e-d014679d96a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.777349 Aug 31 00:24:01.685976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 220/477] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:23:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:24:01.696937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9446a26e-1da6-4fac-b863-01aaa8b158e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:01.697544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9446a26e-1da6-4fac-b863-01aaa8b158e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:01.803888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9446a26e-1da6-4fac-b863-01aaa8b158e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:01.810577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9446a26e-1da6-4fac-b863-01aaa8b158e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1245 microversion: 2.1 time: 0.117398 Aug 31 00:24:01.812337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 258/478] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1245 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:02.052710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1a60097a-0dd3-4d73-8f5b-f3f840f5a56a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:02.053326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1a60097a-0dd3-4d73-8f5b-f3f840f5a56a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:02.086286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a60097a-0dd3-4d73-8f5b-f3f840f5a56a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:02.089621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a60097a-0dd3-4d73-8f5b-f3f840f5a56a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:02.090433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a60097a-0dd3-4d73-8f5b-f3f840f5a56a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:02.091373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a60097a-0dd3-4d73-8f5b-f3f840f5a56a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:02.094620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a60097a-0dd3-4d73-8f5b-f3f840f5a56a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:02.095267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a60097a-0dd3-4d73-8f5b-f3f840f5a56a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:02.197671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1a60097a-0dd3-4d73-8f5b-f3f840f5a56a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:02.207717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1a60097a-0dd3-4d73-8f5b-f3f840f5a56a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1144 microversion: 2.1 time: 0.159944 Aug 31 00:24:02.208761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 221/479] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:02 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1144 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:02.835879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d3efb502-fea4-4aad-a522-0df5a93760f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:02.837136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d3efb502-fea4-4aad-a522-0df5a93760f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:02.850298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3efb502-fea4-4aad-a522-0df5a93760f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:02.855682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3efb502-fea4-4aad-a522-0df5a93760f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:02.856376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3efb502-fea4-4aad-a522-0df5a93760f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:02.857269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3efb502-fea4-4aad-a522-0df5a93760f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:02.860184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3efb502-fea4-4aad-a522-0df5a93760f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:02.863541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3efb502-fea4-4aad-a522-0df5a93760f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:03.009520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d3efb502-fea4-4aad-a522-0df5a93760f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:03.022441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d3efb502-fea4-4aad-a522-0df5a93760f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1297 microversion: 2.1 time: 0.190553 Aug 31 00:24:03.028474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 259/480] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1297 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:03.230412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67f4f444-623e-448a-928b-fd3e33e89436 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:03.232254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-67f4f444-623e-448a-928b-fd3e33e89436 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:03.235556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:03.259014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f4f444-623e-448a-928b-fd3e33e89436 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:03.262680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f4f444-623e-448a-928b-fd3e33e89436 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:03.262680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f4f444-623e-448a-928b-fd3e33e89436 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:03.265515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f4f444-623e-448a-928b-fd3e33e89436 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:03.269010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f4f444-623e-448a-928b-fd3e33e89436 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:03.270432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f4f444-623e-448a-928b-fd3e33e89436 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:03.416668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67f4f444-623e-448a-928b-fd3e33e89436 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:03.428577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67f4f444-623e-448a-928b-fd3e33e89436 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1192 microversion: 2.1 time: 0.202329 Aug 31 00:24:03.430266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 222/481] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:03 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1192 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:04.043256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6623b45b-7757-47b9-a9db-71a614c918ce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:04.044446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6623b45b-7757-47b9-a9db-71a614c918ce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:04.052521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6623b45b-7757-47b9-a9db-71a614c918ce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:04.053592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6623b45b-7757-47b9-a9db-71a614c918ce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:04.054067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6623b45b-7757-47b9-a9db-71a614c918ce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:04.055346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6623b45b-7757-47b9-a9db-71a614c918ce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:04.058062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6623b45b-7757-47b9-a9db-71a614c918ce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:04.058648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6623b45b-7757-47b9-a9db-71a614c918ce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:04.208954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6623b45b-7757-47b9-a9db-71a614c918ce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:04.221797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6623b45b-7757-47b9-a9db-71a614c918ce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1297 microversion: 2.1 time: 0.182391 Aug 31 00:24:04.226269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 260/482] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1297 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:04.471990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ea7851e-8a68-4cee-97d7-e789f39d3b60 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:04.473310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ea7851e-8a68-4cee-97d7-e789f39d3b60 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:04.495303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea7851e-8a68-4cee-97d7-e789f39d3b60 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:04.495800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea7851e-8a68-4cee-97d7-e789f39d3b60 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:04.501111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea7851e-8a68-4cee-97d7-e789f39d3b60 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:04.501947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea7851e-8a68-4cee-97d7-e789f39d3b60 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:04.502432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea7851e-8a68-4cee-97d7-e789f39d3b60 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:04.506138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea7851e-8a68-4cee-97d7-e789f39d3b60 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:04.667082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ea7851e-8a68-4cee-97d7-e789f39d3b60 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:04.676806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ea7851e-8a68-4cee-97d7-e789f39d3b60 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1210 microversion: 2.1 time: 0.225072 Aug 31 00:24:04.677932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 223/483] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:04 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1210 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:05.271193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e8039a70-7755-47a8-a677-b9b0b01055b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:05.272045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e8039a70-7755-47a8-a677-b9b0b01055b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:05.308872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8039a70-7755-47a8-a677-b9b0b01055b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:05.309371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8039a70-7755-47a8-a677-b9b0b01055b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:05.310390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8039a70-7755-47a8-a677-b9b0b01055b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:05.312558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8039a70-7755-47a8-a677-b9b0b01055b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:05.313274 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8039a70-7755-47a8-a677-b9b0b01055b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:05.317688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8039a70-7755-47a8-a677-b9b0b01055b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:05.481648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e8039a70-7755-47a8-a677-b9b0b01055b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:05.497253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e8039a70-7755-47a8-a677-b9b0b01055b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1303 microversion: 2.1 time: 0.232804 Aug 31 00:24:05.499437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 261/484] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1303 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:05.704966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-43c6cdb9-925a-49df-a385-cb14d7800046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:05.705778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-43c6cdb9-925a-49df-a385-cb14d7800046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:05.721730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c6cdb9-925a-49df-a385-cb14d7800046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:05.729314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c6cdb9-925a-49df-a385-cb14d7800046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:05.732124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c6cdb9-925a-49df-a385-cb14d7800046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:05.735759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c6cdb9-925a-49df-a385-cb14d7800046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:05.737916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c6cdb9-925a-49df-a385-cb14d7800046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:05.738132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c6cdb9-925a-49df-a385-cb14d7800046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:06.164980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-43c6cdb9-925a-49df-a385-cb14d7800046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:06.177577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-43c6cdb9-925a-49df-a385-cb14d7800046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.481309 Aug 31 00:24:06.181941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 224/485] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:05 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:06.521174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-857e63bc-b962-4fd1-a147-862a4bb54081 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:06.521988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-857e63bc-b962-4fd1-a147-862a4bb54081 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:06.533298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-857e63bc-b962-4fd1-a147-862a4bb54081 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:06.533827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-857e63bc-b962-4fd1-a147-862a4bb54081 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:06.534759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-857e63bc-b962-4fd1-a147-862a4bb54081 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:06.536620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-857e63bc-b962-4fd1-a147-862a4bb54081 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:06.537250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-857e63bc-b962-4fd1-a147-862a4bb54081 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:06.539841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-857e63bc-b962-4fd1-a147-862a4bb54081 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:06.994632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-d3007307-2041-430c-b13e-ac6e97479806 req-cbf00fd3-f23f-4ae6-bd20-070ec63193ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488", "tag": "3d5b3ea9-0a47-4e55-8a51-95bf0b3d559c"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:07.013231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-d3007307-2041-430c-b13e-ac6e97479806 req-cbf00fd3-f23f-4ae6-bd20-070ec63193ad service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.015864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-d3007307-2041-430c-b13e-ac6e97479806 req-cbf00fd3-f23f-4ae6-bd20-070ec63193ad service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.016526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-d3007307-2041-430c-b13e-ac6e97479806 req-cbf00fd3-f23f-4ae6-bd20-070ec63193ad service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.049482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-d3007307-2041-430c-b13e-ac6e97479806 req-cbf00fd3-f23f-4ae6-bd20-070ec63193ad service nova] Creating event network-changed:3d5b3ea9-0a47-4e55-8a51-95bf0b3d559c for instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 on hv-cinder-85506 Aug 31 00:24:07.060235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-d3007307-2041-430c-b13e-ac6e97479806 req-cbf00fd3-f23f-4ae6-bd20-070ec63193ad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070516 Aug 31 00:24:07.061539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 225/486] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:07.069528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-857e63bc-b962-4fd1-a147-862a4bb54081 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:07.078966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-857e63bc-b962-4fd1-a147-862a4bb54081 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1370 microversion: 2.1 time: 0.562551 Aug 31 00:24:07.094965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 262/487] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1370 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:07.202525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cd421ee9-639d-468c-8630-aef7a2ce5eaa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:07.204098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cd421ee9-639d-468c-8630-aef7a2ce5eaa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:07.220223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd421ee9-639d-468c-8630-aef7a2ce5eaa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.223920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd421ee9-639d-468c-8630-aef7a2ce5eaa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.225354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd421ee9-639d-468c-8630-aef7a2ce5eaa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.228741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd421ee9-639d-468c-8630-aef7a2ce5eaa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.231698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd421ee9-639d-468c-8630-aef7a2ce5eaa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.232977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd421ee9-639d-468c-8630-aef7a2ce5eaa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.270569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-dc09c562-fa23-4495-93d5-f2dae2c5452e req-d73f5db5-5835-4751-858d-e3d35977f30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d43efc3-0d4e-4f0c-9242-7d5cf206ae43", "tag": "b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:07.300453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:07.349621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-dc09c562-fa23-4495-93d5-f2dae2c5452e req-d73f5db5-5835-4751-858d-e3d35977f30e service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.350287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-dc09c562-fa23-4495-93d5-f2dae2c5452e req-d73f5db5-5835-4751-858d-e3d35977f30e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.351369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-dc09c562-fa23-4495-93d5-f2dae2c5452e req-d73f5db5-5835-4751-858d-e3d35977f30e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.375375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-dc09c562-fa23-4495-93d5-f2dae2c5452e req-d73f5db5-5835-4751-858d-e3d35977f30e service nova] Creating event network-changed:b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a for instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 on hv-cinder-85506 Aug 31 00:24:07.382078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-dc09c562-fa23-4495-93d5-f2dae2c5452e req-d73f5db5-5835-4751-858d-e3d35977f30e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121814 Aug 31 00:24:07.386040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 263/488] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:24:07.635982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cd421ee9-639d-468c-8630-aef7a2ce5eaa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:07.649123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cd421ee9-639d-468c-8630-aef7a2ce5eaa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.452147 Aug 31 00:24:07.654303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 226/489] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:07 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:08.104362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6f70003c-f56e-4d25-8263-4dabf24467ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:08.106052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6f70003c-f56e-4d25-8263-4dabf24467ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:08.113663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f70003c-f56e-4d25-8263-4dabf24467ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.114961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f70003c-f56e-4d25-8263-4dabf24467ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.115438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f70003c-f56e-4d25-8263-4dabf24467ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.118083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f70003c-f56e-4d25-8263-4dabf24467ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.119200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f70003c-f56e-4d25-8263-4dabf24467ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.120801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f70003c-f56e-4d25-8263-4dabf24467ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.374995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6f70003c-f56e-4d25-8263-4dabf24467ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:08.391863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6f70003c-f56e-4d25-8263-4dabf24467ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1370 microversion: 2.1 time: 0.292903 Aug 31 00:24:08.403777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 264/490] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:08.681502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f655157d-cbb9-486d-81a2-a7f32bbf4afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:08.682193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f655157d-cbb9-486d-81a2-a7f32bbf4afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:08.686257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:24:08.686645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:24:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 (ip 10.222.0.67) !!! Aug 31 00:24:08.697486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f655157d-cbb9-486d-81a2-a7f32bbf4afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.698116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f655157d-cbb9-486d-81a2-a7f32bbf4afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.699241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f655157d-cbb9-486d-81a2-a7f32bbf4afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.699950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f655157d-cbb9-486d-81a2-a7f32bbf4afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.700413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f655157d-cbb9-486d-81a2-a7f32bbf4afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.700842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f655157d-cbb9-486d-81a2-a7f32bbf4afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.892377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f655157d-cbb9-486d-81a2-a7f32bbf4afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:08.905285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f655157d-cbb9-486d-81a2-a7f32bbf4afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.227528 Aug 31 00:24:08.919062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 227/491] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:08 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:09.434253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ca5322ac-605e-4d52-bbb7-63dc37720c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:09.437051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ca5322ac-605e-4d52-bbb7-63dc37720c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:09.450384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca5322ac-605e-4d52-bbb7-63dc37720c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.463292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca5322ac-605e-4d52-bbb7-63dc37720c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.465883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca5322ac-605e-4d52-bbb7-63dc37720c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:09.466976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca5322ac-605e-4d52-bbb7-63dc37720c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.467728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca5322ac-605e-4d52-bbb7-63dc37720c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.468933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca5322ac-605e-4d52-bbb7-63dc37720c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:09.929776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67353a7b-073e-4531-8ed5-989f0b39ddd2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:09.931398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-67353a7b-073e-4531-8ed5-989f0b39ddd2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:09.940760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67353a7b-073e-4531-8ed5-989f0b39ddd2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.941477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67353a7b-073e-4531-8ed5-989f0b39ddd2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.942116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67353a7b-073e-4531-8ed5-989f0b39ddd2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:09.943229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67353a7b-073e-4531-8ed5-989f0b39ddd2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.952573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67353a7b-073e-4531-8ed5-989f0b39ddd2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.958549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67353a7b-073e-4531-8ed5-989f0b39ddd2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:10.316005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca5322ac-605e-4d52-bbb7-63dc37720c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:10.325504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ca5322ac-605e-4d52-bbb7-63dc37720c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1370 microversion: 2.1 time: 0.896663 Aug 31 00:24:10.328956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 265/492] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1370 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:10.376464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67353a7b-073e-4531-8ed5-989f0b39ddd2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:10.387227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67353a7b-073e-4531-8ed5-989f0b39ddd2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.462146 Aug 31 00:24:10.389373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 228/493] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:09 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:11.351712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-989db0b1-6efa-4dbd-a3aa-6be0267075f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:11.353516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-989db0b1-6efa-4dbd-a3aa-6be0267075f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:11.365661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-989db0b1-6efa-4dbd-a3aa-6be0267075f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.366933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-989db0b1-6efa-4dbd-a3aa-6be0267075f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.367860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-989db0b1-6efa-4dbd-a3aa-6be0267075f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.369259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-989db0b1-6efa-4dbd-a3aa-6be0267075f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.369986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-989db0b1-6efa-4dbd-a3aa-6be0267075f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.370673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-989db0b1-6efa-4dbd-a3aa-6be0267075f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.374959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=79 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:11.424218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ccd46dd4-1f31-435e-95a9-77df4cff1d5e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:11.429000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ccd46dd4-1f31-435e-95a9-77df4cff1d5e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:11.437302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:11.438382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=10 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:11.444413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd46dd4-1f31-435e-95a9-77df4cff1d5e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.445307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd46dd4-1f31-435e-95a9-77df4cff1d5e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.445821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd46dd4-1f31-435e-95a9-77df4cff1d5e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.446589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd46dd4-1f31-435e-95a9-77df4cff1d5e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.447138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd46dd4-1f31-435e-95a9-77df4cff1d5e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.447621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd46dd4-1f31-435e-95a9-77df4cff1d5e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.640766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-989db0b1-6efa-4dbd-a3aa-6be0267075f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:11.663125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-989db0b1-6efa-4dbd-a3aa-6be0267075f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1370 microversion: 2.1 time: 0.316980 Aug 31 00:24:11.664375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 266/494] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:11.707869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ccd46dd4-1f31-435e-95a9-77df4cff1d5e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:11.716819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ccd46dd4-1f31-435e-95a9-77df4cff1d5e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.306361 Aug 31 00:24:11.718073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 229/495] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:11 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:12.697493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-360629ae-6120-49bb-9b2d-5bba08736910 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:12.698191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-360629ae-6120-49bb-9b2d-5bba08736910 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:12.704488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=16 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:12.716507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-360629ae-6120-49bb-9b2d-5bba08736910 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.717278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-360629ae-6120-49bb-9b2d-5bba08736910 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.717886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-360629ae-6120-49bb-9b2d-5bba08736910 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.718775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-360629ae-6120-49bb-9b2d-5bba08736910 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.719730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-360629ae-6120-49bb-9b2d-5bba08736910 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.719911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-360629ae-6120-49bb-9b2d-5bba08736910 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.743513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0f462af6-27b6-4186-99a9-1226d0c7d260 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:12.745409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0f462af6-27b6-4186-99a9-1226d0c7d260 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:12.755339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f462af6-27b6-4186-99a9-1226d0c7d260 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.756205 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f462af6-27b6-4186-99a9-1226d0c7d260 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.756865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f462af6-27b6-4186-99a9-1226d0c7d260 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.757811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f462af6-27b6-4186-99a9-1226d0c7d260 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.758577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f462af6-27b6-4186-99a9-1226d0c7d260 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.760016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f462af6-27b6-4186-99a9-1226d0c7d260 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.016035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-360629ae-6120-49bb-9b2d-5bba08736910 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:13.029005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-360629ae-6120-49bb-9b2d-5bba08736910 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1370 microversion: 2.1 time: 0.335289 Aug 31 00:24:13.029582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 267/496] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1370 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:13.043163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0f462af6-27b6-4186-99a9-1226d0c7d260 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:13.058198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0f462af6-27b6-4186-99a9-1226d0c7d260 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.320433 Aug 31 00:24:13.059074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 230/497] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:12 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:14.050993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-45b644ad-2cd3-47f6-bb01-17ca54a8367b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:14.051627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-45b644ad-2cd3-47f6-bb01-17ca54a8367b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:14.057622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45b644ad-2cd3-47f6-bb01-17ca54a8367b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.058103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45b644ad-2cd3-47f6-bb01-17ca54a8367b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.058538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45b644ad-2cd3-47f6-bb01-17ca54a8367b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.059265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45b644ad-2cd3-47f6-bb01-17ca54a8367b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.059719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45b644ad-2cd3-47f6-bb01-17ca54a8367b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.060139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45b644ad-2cd3-47f6-bb01-17ca54a8367b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.081772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b875f60a-f7f4-41a8-a331-03eb8d510a5b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:14.082359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b875f60a-f7f4-41a8-a331-03eb8d510a5b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:14.091180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b875f60a-f7f4-41a8-a331-03eb8d510a5b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.091667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b875f60a-f7f4-41a8-a331-03eb8d510a5b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.092095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b875f60a-f7f4-41a8-a331-03eb8d510a5b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.092794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b875f60a-f7f4-41a8-a331-03eb8d510a5b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.093238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b875f60a-f7f4-41a8-a331-03eb8d510a5b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.098704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b875f60a-f7f4-41a8-a331-03eb8d510a5b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.277067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-45b644ad-2cd3-47f6-bb01-17ca54a8367b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:14.281509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b875f60a-f7f4-41a8-a331-03eb8d510a5b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:14.286273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-45b644ad-2cd3-47f6-bb01-17ca54a8367b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1370 microversion: 2.1 time: 0.240241 Aug 31 00:24:14.286947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 268/498] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:14.289870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b875f60a-f7f4-41a8-a331-03eb8d510a5b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.211961 Aug 31 00:24:14.290889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 231/499] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:14 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:15.307191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-484df4ab-cf49-4092-b89d-475fc2442575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:15.307803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-484df4ab-cf49-4092-b89d-475fc2442575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:15.309966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2052973b-2e12-4789-b2ab-195a2d94eed8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:15.311172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2052973b-2e12-4789-b2ab-195a2d94eed8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:15.313790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-484df4ab-cf49-4092-b89d-475fc2442575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.314269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-484df4ab-cf49-4092-b89d-475fc2442575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.315639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-484df4ab-cf49-4092-b89d-475fc2442575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.316441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-484df4ab-cf49-4092-b89d-475fc2442575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.316916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-484df4ab-cf49-4092-b89d-475fc2442575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.317497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-484df4ab-cf49-4092-b89d-475fc2442575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.318367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2052973b-2e12-4789-b2ab-195a2d94eed8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.318852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2052973b-2e12-4789-b2ab-195a2d94eed8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.319314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2052973b-2e12-4789-b2ab-195a2d94eed8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.320004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2052973b-2e12-4789-b2ab-195a2d94eed8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.320458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2052973b-2e12-4789-b2ab-195a2d94eed8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.320876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2052973b-2e12-4789-b2ab-195a2d94eed8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.520836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-484df4ab-cf49-4092-b89d-475fc2442575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.533034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-484df4ab-cf49-4092-b89d-475fc2442575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1370 microversion: 2.1 time: 0.229663 Aug 31 00:24:15.543219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 269/500] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:15.543419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2052973b-2e12-4789-b2ab-195a2d94eed8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.548205 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2052973b-2e12-4789-b2ab-195a2d94eed8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.242204 Aug 31 00:24:15.548846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 232/501] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:15 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:16.047007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-e9af0d26-4f43-4c28-87de-4221b1f00660 req-63209e88-e25e-4a55-870b-125630b6b568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d43efc3-0d4e-4f0c-9242-7d5cf206ae43", "name": "network-vif-plugged", "status": "completed", "tag": "b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:16.059680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e9af0d26-4f43-4c28-87de-4221b1f00660 req-63209e88-e25e-4a55-870b-125630b6b568 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.060166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e9af0d26-4f43-4c28-87de-4221b1f00660 req-63209e88-e25e-4a55-870b-125630b6b568 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.060602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e9af0d26-4f43-4c28-87de-4221b1f00660 req-63209e88-e25e-4a55-870b-125630b6b568 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.072723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-e9af0d26-4f43-4c28-87de-4221b1f00660 req-63209e88-e25e-4a55-870b-125630b6b568 service nova] Creating event network-vif-plugged:b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a for instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 on hv-cinder-85506 Aug 31 00:24:16.077753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-e9af0d26-4f43-4c28-87de-4221b1f00660 req-63209e88-e25e-4a55-870b-125630b6b568 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034448 Aug 31 00:24:16.078335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 270/502] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:16.553977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9526b3ea-7783-41b5-a7ed-c3793c6c0ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:16.554554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9526b3ea-7783-41b5-a7ed-c3793c6c0ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:16.561951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9526b3ea-7783-41b5-a7ed-c3793c6c0ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.562478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9526b3ea-7783-41b5-a7ed-c3793c6c0ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.563101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9526b3ea-7783-41b5-a7ed-c3793c6c0ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.563948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9526b3ea-7783-41b5-a7ed-c3793c6c0ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.564485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9526b3ea-7783-41b5-a7ed-c3793c6c0ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.565034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9526b3ea-7783-41b5-a7ed-c3793c6c0ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.570696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ec543f3f-ffc4-4374-b6ba-c55ad38cde86 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:16.572052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ec543f3f-ffc4-4374-b6ba-c55ad38cde86 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:16.577979 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec543f3f-ffc4-4374-b6ba-c55ad38cde86 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.578454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec543f3f-ffc4-4374-b6ba-c55ad38cde86 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.578892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec543f3f-ffc4-4374-b6ba-c55ad38cde86 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.579617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec543f3f-ffc4-4374-b6ba-c55ad38cde86 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.580195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec543f3f-ffc4-4374-b6ba-c55ad38cde86 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.581127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec543f3f-ffc4-4374-b6ba-c55ad38cde86 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.763574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9526b3ea-7783-41b5-a7ed-c3793c6c0ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.772567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9526b3ea-7783-41b5-a7ed-c3793c6c0ea7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1370 microversion: 2.1 time: 0.222617 Aug 31 00:24:16.773138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 233/503] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:16.778292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ec543f3f-ffc4-4374-b6ba-c55ad38cde86 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.786924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ec543f3f-ffc4-4374-b6ba-c55ad38cde86 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.220642 Aug 31 00:24:16.787859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 271/504] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:16 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:17.793724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c4b192f1-916a-4b04-9a9d-83181eca6dce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:17.794314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c4b192f1-916a-4b04-9a9d-83181eca6dce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:17.801281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4b192f1-916a-4b04-9a9d-83181eca6dce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.801791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4b192f1-916a-4b04-9a9d-83181eca6dce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.802218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4b192f1-916a-4b04-9a9d-83181eca6dce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.802899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4b192f1-916a-4b04-9a9d-83181eca6dce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.803368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4b192f1-916a-4b04-9a9d-83181eca6dce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.803784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4b192f1-916a-4b04-9a9d-83181eca6dce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.816613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f3f91e06-d936-450a-bf3c-baab8eb708f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:17.817214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f3f91e06-d936-450a-bf3c-baab8eb708f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:17.823001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f91e06-d936-450a-bf3c-baab8eb708f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.823501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f91e06-d936-450a-bf3c-baab8eb708f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.823924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f91e06-d936-450a-bf3c-baab8eb708f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.824593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f91e06-d936-450a-bf3c-baab8eb708f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.825030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f91e06-d936-450a-bf3c-baab8eb708f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.825456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f91e06-d936-450a-bf3c-baab8eb708f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.011830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c4b192f1-916a-4b04-9a9d-83181eca6dce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:18.016676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3f91e06-d936-450a-bf3c-baab8eb708f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:18.025134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f3f91e06-d936-450a-bf3c-baab8eb708f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.213022 Aug 31 00:24:18.025991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 272/505] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:17 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:18.028678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c4b192f1-916a-4b04-9a9d-83181eca6dce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1370 microversion: 2.1 time: 0.238705 Aug 31 00:24:18.029251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 234/506] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:19.046427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-094cdcf7-b4eb-4194-bb71-50ac9f51219e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:19.047750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-094cdcf7-b4eb-4194-bb71-50ac9f51219e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:19.052120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-339946f2-f60c-4b17-90a6-a6c0a8824ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:19.054262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-339946f2-f60c-4b17-90a6-a6c0a8824ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:19.058867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-094cdcf7-b4eb-4194-bb71-50ac9f51219e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:19.059886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-094cdcf7-b4eb-4194-bb71-50ac9f51219e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:19.060663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-094cdcf7-b4eb-4194-bb71-50ac9f51219e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:19.061564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-094cdcf7-b4eb-4194-bb71-50ac9f51219e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:19.062214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-094cdcf7-b4eb-4194-bb71-50ac9f51219e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:19.062853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-094cdcf7-b4eb-4194-bb71-50ac9f51219e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:19.063889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-339946f2-f60c-4b17-90a6-a6c0a8824ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:19.064832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-339946f2-f60c-4b17-90a6-a6c0a8824ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:19.066329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-339946f2-f60c-4b17-90a6-a6c0a8824ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:19.067352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-339946f2-f60c-4b17-90a6-a6c0a8824ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:19.069561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-339946f2-f60c-4b17-90a6-a6c0a8824ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:19.070053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-339946f2-f60c-4b17-90a6-a6c0a8824ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:19.273125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-094cdcf7-b4eb-4194-bb71-50ac9f51219e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:19.280802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-094cdcf7-b4eb-4194-bb71-50ac9f51219e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.238725 Aug 31 00:24:19.281371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 273/507] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:19 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:19.311185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-339946f2-f60c-4b17-90a6-a6c0a8824ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:19.320475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-339946f2-f60c-4b17-90a6-a6c0a8824ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1370 microversion: 2.1 time: 0.274820 Aug 31 00:24:19.321034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 235/508] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:20.305396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3050acc-839d-4b51-af27-01e7bf5c560e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:20.307404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3050acc-839d-4b51-af27-01e7bf5c560e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:20.316899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3050acc-839d-4b51-af27-01e7bf5c560e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.318087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3050acc-839d-4b51-af27-01e7bf5c560e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.319250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3050acc-839d-4b51-af27-01e7bf5c560e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.320687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3050acc-839d-4b51-af27-01e7bf5c560e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.321583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3050acc-839d-4b51-af27-01e7bf5c560e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.322169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3050acc-839d-4b51-af27-01e7bf5c560e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.342241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ccd970cf-f9bd-44f0-aed8-62060b78a454 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:20.343029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ccd970cf-f9bd-44f0-aed8-62060b78a454 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:20.354368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd970cf-f9bd-44f0-aed8-62060b78a454 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.354990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd970cf-f9bd-44f0-aed8-62060b78a454 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.355477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd970cf-f9bd-44f0-aed8-62060b78a454 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.356192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd970cf-f9bd-44f0-aed8-62060b78a454 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.356647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd970cf-f9bd-44f0-aed8-62060b78a454 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.357081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccd970cf-f9bd-44f0-aed8-62060b78a454 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.615576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e3050acc-839d-4b51-af27-01e7bf5c560e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:20.620511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ccd970cf-f9bd-44f0-aed8-62060b78a454 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:20.623548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3050acc-839d-4b51-af27-01e7bf5c560e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.325013 Aug 31 00:24:20.629030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ccd970cf-f9bd-44f0-aed8-62060b78a454 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1564 microversion: 2.1 time: 0.291135 Aug 31 00:24:20.630870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 236/509] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1564 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:20.641511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 274/510] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:20 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:20.648065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-241ba923-3565-42f6-82a4-7301b8944d6e req-4ea2453c-2066-4785-9d69-8e2c39d38fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488", "name": "network-vif-plugged", "status": "completed", "tag": "3d5b3ea9-0a47-4e55-8a51-95bf0b3d559c"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:20.657855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a0e7088c-1465-4d9a-ae4c-7dea0ad88168 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:20.658352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a0e7088c-1465-4d9a-ae4c-7dea0ad88168 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:20.666057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0e7088c-1465-4d9a-ae4c-7dea0ad88168 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.666767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0e7088c-1465-4d9a-ae4c-7dea0ad88168 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.667411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0e7088c-1465-4d9a-ae4c-7dea0ad88168 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.668285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0e7088c-1465-4d9a-ae4c-7dea0ad88168 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.669008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0e7088c-1465-4d9a-ae4c-7dea0ad88168 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.669633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0e7088c-1465-4d9a-ae4c-7dea0ad88168 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.672727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-241ba923-3565-42f6-82a4-7301b8944d6e req-4ea2453c-2066-4785-9d69-8e2c39d38fb5 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.677603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-241ba923-3565-42f6-82a4-7301b8944d6e req-4ea2453c-2066-4785-9d69-8e2c39d38fb5 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.678128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-241ba923-3565-42f6-82a4-7301b8944d6e req-4ea2453c-2066-4785-9d69-8e2c39d38fb5 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.696538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-241ba923-3565-42f6-82a4-7301b8944d6e req-4ea2453c-2066-4785-9d69-8e2c39d38fb5 service nova] Creating event network-vif-plugged:3d5b3ea9-0a47-4e55-8a51-95bf0b3d559c for instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 on hv-cinder-85506 Aug 31 00:24:20.701433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-241ba923-3565-42f6-82a4-7301b8944d6e req-4ea2453c-2066-4785-9d69-8e2c39d38fb5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069169 Aug 31 00:24:20.702310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 237/511] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:20.792891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a0e7088c-1465-4d9a-ae4c-7dea0ad88168 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138799 Aug 31 00:24:20.793544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 275/512] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 31 00:24:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:21.650407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-638d7d13-e87a-4499-9cf7-ca4ba57a6594 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:21.651150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-638d7d13-e87a-4499-9cf7-ca4ba57a6594 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:21.657860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-638d7d13-e87a-4499-9cf7-ca4ba57a6594 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.658288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-638d7d13-e87a-4499-9cf7-ca4ba57a6594 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.658746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-638d7d13-e87a-4499-9cf7-ca4ba57a6594 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.659751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-638d7d13-e87a-4499-9cf7-ca4ba57a6594 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.660298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-638d7d13-e87a-4499-9cf7-ca4ba57a6594 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.660724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-638d7d13-e87a-4499-9cf7-ca4ba57a6594 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.808067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-638d7d13-e87a-4499-9cf7-ca4ba57a6594 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:21.810953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:21.819126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-638d7d13-e87a-4499-9cf7-ca4ba57a6594 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.173620 Aug 31 00:24:21.833727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 238/513] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:21 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:22.323231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-db88cc48-f7cf-4812-abdb-6beefa917450 req-7a606f35-338a-4cfc-9b42-311e510b8418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d43efc3-0d4e-4f0c-9242-7d5cf206ae43", "tag": "b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:22.332978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-db88cc48-f7cf-4812-abdb-6beefa917450 req-7a606f35-338a-4cfc-9b42-311e510b8418 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.333670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-db88cc48-f7cf-4812-abdb-6beefa917450 req-7a606f35-338a-4cfc-9b42-311e510b8418 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.334327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-db88cc48-f7cf-4812-abdb-6beefa917450 req-7a606f35-338a-4cfc-9b42-311e510b8418 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.346397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-db88cc48-f7cf-4812-abdb-6beefa917450 req-7a606f35-338a-4cfc-9b42-311e510b8418 service nova] Creating event network-changed:b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a for instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 on hv-cinder-85506 Aug 31 00:24:22.352878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-db88cc48-f7cf-4812-abdb-6beefa917450 req-7a606f35-338a-4cfc-9b42-311e510b8418 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033093 Aug 31 00:24:22.355625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 276/514] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:22.841296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2813e455-96ed-46d5-80e8-f05651381239 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:22.842478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2813e455-96ed-46d5-80e8-f05651381239 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:22.852440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2813e455-96ed-46d5-80e8-f05651381239 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.852991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2813e455-96ed-46d5-80e8-f05651381239 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.853433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2813e455-96ed-46d5-80e8-f05651381239 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.854355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2813e455-96ed-46d5-80e8-f05651381239 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.855388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2813e455-96ed-46d5-80e8-f05651381239 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.856234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2813e455-96ed-46d5-80e8-f05651381239 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.038467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2813e455-96ed-46d5-80e8-f05651381239 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:23.048132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2813e455-96ed-46d5-80e8-f05651381239 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1266 microversion: 2.1 time: 0.211363 Aug 31 00:24:23.050217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 239/515] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:22 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:23.477458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1814747141", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "networks": [{"uuid": "dfe32deb-d47f-4f3a-ae59-0ae1fd407876"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:23.537348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] validate_networks() for [('dfe32deb-d47f-4f3a-ae59-0ae1fd407876', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:24:23.958205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:24:23.959702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:24:23.960372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:24:23.960940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:24:23.961507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:24:23.980766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.981254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.981683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.982410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.982859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.983318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.006801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Getting quotas for project e32cbe1a05ce414fb55f1de8bf71581c. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:24:24.011131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Getting quotas for user b03932102b7541f89a60a9c535a42e76 and project e32cbe1a05ce414fb55f1de8bf71581c. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:24:24.023180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:24:24.025631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:24:24.072193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-05bab30e-676e-4dcb-990c-6b7433f8e088 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:24.074700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-05bab30e-676e-4dcb-990c-6b7433f8e088 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:24.083883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05bab30e-676e-4dcb-990c-6b7433f8e088 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.084628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05bab30e-676e-4dcb-990c-6b7433f8e088 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.085037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5e5b29ea-8597-4586-a807-53a47052bd2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611010 Aug 31 00:24:24.085164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05bab30e-676e-4dcb-990c-6b7433f8e088 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.085860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 277/516] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:24:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:24:24.092049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05bab30e-676e-4dcb-990c-6b7433f8e088 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.092827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05bab30e-676e-4dcb-990c-6b7433f8e088 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.093427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05bab30e-676e-4dcb-990c-6b7433f8e088 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.098483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-85997158-6181-4eac-983c-847af1fb29a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:24.099113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-85997158-6181-4eac-983c-847af1fb29a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:24.238544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-85997158-6181-4eac-983c-847af1fb29a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:24.249464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-85997158-6181-4eac-983c-847af1fb29a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1219 microversion: 2.1 time: 0.156034 Aug 31 00:24:24.263073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 278/517] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:24 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:24.298659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-05bab30e-676e-4dcb-990c-6b7433f8e088 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:24.307749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-05bab30e-676e-4dcb-990c-6b7433f8e088 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1453 microversion: 2.1 time: 0.239500 Aug 31 00:24:24.323091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 240/518] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:24 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1453 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:24.329136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c73eacbc-4db9-47f2-b130-1183572ebc4b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:24.329943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c73eacbc-4db9-47f2-b130-1183572ebc4b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:24.338045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73eacbc-4db9-47f2-b130-1183572ebc4b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.338548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73eacbc-4db9-47f2-b130-1183572ebc4b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.338970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73eacbc-4db9-47f2-b130-1183572ebc4b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.339739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73eacbc-4db9-47f2-b130-1183572ebc4b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.340147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73eacbc-4db9-47f2-b130-1183572ebc4b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.340571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73eacbc-4db9-47f2-b130-1183572ebc4b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.511887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c73eacbc-4db9-47f2-b130-1183572ebc4b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:24.523062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c73eacbc-4db9-47f2-b130-1183572ebc4b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1453 microversion: 2.1 time: 0.197457 Aug 31 00:24:24.524940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 279/519] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:24 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:25.275057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f0fee193-d2b4-430a-9615-fe9fb98e23a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:25.275803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f0fee193-d2b4-430a-9615-fe9fb98e23a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:25.282909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0fee193-d2b4-430a-9615-fe9fb98e23a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:25.283577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0fee193-d2b4-430a-9615-fe9fb98e23a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:25.284944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0fee193-d2b4-430a-9615-fe9fb98e23a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:25.285862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0fee193-d2b4-430a-9615-fe9fb98e23a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:25.287249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0fee193-d2b4-430a-9615-fe9fb98e23a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:25.287791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0fee193-d2b4-430a-9615-fe9fb98e23a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:25.352940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f0fee193-d2b4-430a-9615-fe9fb98e23a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:25.360793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f0fee193-d2b4-430a-9615-fe9fb98e23a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1271 microversion: 2.1 time: 0.090690 Aug 31 00:24:25.362348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 241/520] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:25 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:26.382621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-51055fb8-327f-4eae-8213-ae3519ad0a1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:26.383262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-51055fb8-327f-4eae-8213-ae3519ad0a1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:26.389237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51055fb8-327f-4eae-8213-ae3519ad0a1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.389720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51055fb8-327f-4eae-8213-ae3519ad0a1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.390153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51055fb8-327f-4eae-8213-ae3519ad0a1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.390843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51055fb8-327f-4eae-8213-ae3519ad0a1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.391319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51055fb8-327f-4eae-8213-ae3519ad0a1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.391743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51055fb8-327f-4eae-8213-ae3519ad0a1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.460140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-51055fb8-327f-4eae-8213-ae3519ad0a1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:26.470238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-51055fb8-327f-4eae-8213-ae3519ad0a1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1277 microversion: 2.1 time: 0.091695 Aug 31 00:24:26.470826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 280/521] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:26 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:27.226212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-2b84ae40-2cd4-4447-b766-da92e79b0999 req-9793cd63-6b74-47d5-9aa2-4c0a17b1a6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488", "tag": "3d5b3ea9-0a47-4e55-8a51-95bf0b3d559c"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:27.238620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-2b84ae40-2cd4-4447-b766-da92e79b0999 req-9793cd63-6b74-47d5-9aa2-4c0a17b1a6b5 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.239236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-2b84ae40-2cd4-4447-b766-da92e79b0999 req-9793cd63-6b74-47d5-9aa2-4c0a17b1a6b5 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.239731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-2b84ae40-2cd4-4447-b766-da92e79b0999 req-9793cd63-6b74-47d5-9aa2-4c0a17b1a6b5 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.252231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-2b84ae40-2cd4-4447-b766-da92e79b0999 req-9793cd63-6b74-47d5-9aa2-4c0a17b1a6b5 service nova] Creating event network-changed:3d5b3ea9-0a47-4e55-8a51-95bf0b3d559c for instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 on hv-cinder-85506 Aug 31 00:24:27.258994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-2b84ae40-2cd4-4447-b766-da92e79b0999 req-9793cd63-6b74-47d5-9aa2-4c0a17b1a6b5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036333 Aug 31 00:24:27.260458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 242/522] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:27.493780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ce0513c2-c9fe-4872-8121-3c05e69626c3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:27.495718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ce0513c2-c9fe-4872-8121-3c05e69626c3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:27.498825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:27.510333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce0513c2-c9fe-4872-8121-3c05e69626c3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.511228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce0513c2-c9fe-4872-8121-3c05e69626c3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.511866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce0513c2-c9fe-4872-8121-3c05e69626c3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.513079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce0513c2-c9fe-4872-8121-3c05e69626c3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.513769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce0513c2-c9fe-4872-8121-3c05e69626c3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.514415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce0513c2-c9fe-4872-8121-3c05e69626c3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.772242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ce0513c2-c9fe-4872-8121-3c05e69626c3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:27.785526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ce0513c2-c9fe-4872-8121-3c05e69626c3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1319 microversion: 2.1 time: 0.296939 Aug 31 00:24:27.788276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 281/523] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:27 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:28.808627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c838f6ff-ed5f-4517-9559-4b86c8f01e76 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:28.809326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c838f6ff-ed5f-4517-9559-4b86c8f01e76 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:28.816301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c838f6ff-ed5f-4517-9559-4b86c8f01e76 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:28.816909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c838f6ff-ed5f-4517-9559-4b86c8f01e76 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:28.817337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c838f6ff-ed5f-4517-9559-4b86c8f01e76 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:28.818030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c838f6ff-ed5f-4517-9559-4b86c8f01e76 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:28.818474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c838f6ff-ed5f-4517-9559-4b86c8f01e76 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:28.818939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c838f6ff-ed5f-4517-9559-4b86c8f01e76 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:28.954054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c838f6ff-ed5f-4517-9559-4b86c8f01e76 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:28.962426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c838f6ff-ed5f-4517-9559-4b86c8f01e76 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1319 microversion: 2.1 time: 0.158675 Aug 31 00:24:28.962994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 243/524] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:28 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:29.275151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-6d127bce-2046-4b93-8024-da51d68b408d req-f05a84ac-aeab-429b-9cc6-de88377d1875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779ab581-0d74-4e77-846a-0ec6cb0dc5d6", "tag": "b5a4cf62-1e23-4a14-be0a-80f138088cec"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:29.284967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-6d127bce-2046-4b93-8024-da51d68b408d req-f05a84ac-aeab-429b-9cc6-de88377d1875 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.285511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-6d127bce-2046-4b93-8024-da51d68b408d req-f05a84ac-aeab-429b-9cc6-de88377d1875 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.286031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-6d127bce-2046-4b93-8024-da51d68b408d req-f05a84ac-aeab-429b-9cc6-de88377d1875 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:29.298664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-6d127bce-2046-4b93-8024-da51d68b408d req-f05a84ac-aeab-429b-9cc6-de88377d1875 service nova] Creating event network-changed:b5a4cf62-1e23-4a14-be0a-80f138088cec for instance 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 on hv-cinder-85506 Aug 31 00:24:29.305848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-6d127bce-2046-4b93-8024-da51d68b408d req-f05a84ac-aeab-429b-9cc6-de88377d1875 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034436 Aug 31 00:24:29.306454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 282/525] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:29.983528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d179f250-8c84-4331-bc8f-36a478648bc2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:29.984197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d179f250-8c84-4331-bc8f-36a478648bc2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:29.991626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179f250-8c84-4331-bc8f-36a478648bc2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.992113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179f250-8c84-4331-bc8f-36a478648bc2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.992556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179f250-8c84-4331-bc8f-36a478648bc2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:29.993256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179f250-8c84-4331-bc8f-36a478648bc2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.993715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179f250-8c84-4331-bc8f-36a478648bc2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.994142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179f250-8c84-4331-bc8f-36a478648bc2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:30.134160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d179f250-8c84-4331-bc8f-36a478648bc2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:30.142144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d179f250-8c84-4331-bc8f-36a478648bc2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1319 microversion: 2.1 time: 0.162899 Aug 31 00:24:30.142729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 244/526] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:29 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:31.164936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fc16b109-160b-4dab-9e6d-89177c726274 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:31.165620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fc16b109-160b-4dab-9e6d-89177c726274 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:31.171984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc16b109-160b-4dab-9e6d-89177c726274 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.172462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc16b109-160b-4dab-9e6d-89177c726274 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.173112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc16b109-160b-4dab-9e6d-89177c726274 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.173796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc16b109-160b-4dab-9e6d-89177c726274 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.174238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc16b109-160b-4dab-9e6d-89177c726274 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.174710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc16b109-160b-4dab-9e6d-89177c726274 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.317994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fc16b109-160b-4dab-9e6d-89177c726274 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:31.328945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fc16b109-160b-4dab-9e6d-89177c726274 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1319 microversion: 2.1 time: 0.168139 Aug 31 00:24:31.329566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 283/527] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:31 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:32.353756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2eb2679d-5115-4062-944c-1d54d5a49a77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:32.355567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2eb2679d-5115-4062-944c-1d54d5a49a77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:32.362801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2eb2679d-5115-4062-944c-1d54d5a49a77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:32.363566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2eb2679d-5115-4062-944c-1d54d5a49a77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:32.364152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2eb2679d-5115-4062-944c-1d54d5a49a77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:32.365318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2eb2679d-5115-4062-944c-1d54d5a49a77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:32.365823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2eb2679d-5115-4062-944c-1d54d5a49a77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:32.366404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2eb2679d-5115-4062-944c-1d54d5a49a77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:32.626750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2eb2679d-5115-4062-944c-1d54d5a49a77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:32.635307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2eb2679d-5115-4062-944c-1d54d5a49a77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1319 microversion: 2.1 time: 0.288831 Aug 31 00:24:32.635979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 245/528] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:32 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:33.657524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-116c0158-a04b-4563-a738-81166cebd489 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:33.658129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-116c0158-a04b-4563-a738-81166cebd489 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:33.664034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-116c0158-a04b-4563-a738-81166cebd489 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:33.664500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-116c0158-a04b-4563-a738-81166cebd489 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.664921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-116c0158-a04b-4563-a738-81166cebd489 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.665586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-116c0158-a04b-4563-a738-81166cebd489 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:33.666030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-116c0158-a04b-4563-a738-81166cebd489 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.666436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-116c0158-a04b-4563-a738-81166cebd489 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.803575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-116c0158-a04b-4563-a738-81166cebd489 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:33.811438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-116c0158-a04b-4563-a738-81166cebd489 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1319 microversion: 2.1 time: 0.157946 Aug 31 00:24:33.812034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 284/529] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:33 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:34.681910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-3bc9e285-e3f3-4188-8df5-9025986a1fa6 req-a5997f25-fa6c-40b3-87e9-16904fd07cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779ab581-0d74-4e77-846a-0ec6cb0dc5d6", "name": "network-vif-plugged", "status": "completed", "tag": "b5a4cf62-1e23-4a14-be0a-80f138088cec"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:34.687770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=48 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:34.695556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-3bc9e285-e3f3-4188-8df5-9025986a1fa6 req-a5997f25-fa6c-40b3-87e9-16904fd07cad service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.696039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-3bc9e285-e3f3-4188-8df5-9025986a1fa6 req-a5997f25-fa6c-40b3-87e9-16904fd07cad service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.696729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-3bc9e285-e3f3-4188-8df5-9025986a1fa6 req-a5997f25-fa6c-40b3-87e9-16904fd07cad service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:34.709393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-3bc9e285-e3f3-4188-8df5-9025986a1fa6 req-a5997f25-fa6c-40b3-87e9-16904fd07cad service nova] Creating event network-vif-plugged:b5a4cf62-1e23-4a14-be0a-80f138088cec for instance 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 on hv-cinder-85506 Aug 31 00:24:34.714414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-3bc9e285-e3f3-4188-8df5-9025986a1fa6 req-a5997f25-fa6c-40b3-87e9-16904fd07cad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036571 Aug 31 00:24:34.715255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 246/530] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:34.833567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cf98824f-dad5-4ba9-b5b0-37ee6d11a03b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:34.834192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cf98824f-dad5-4ba9-b5b0-37ee6d11a03b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:34.836502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:34.837753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=8 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:34.844457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf98824f-dad5-4ba9-b5b0-37ee6d11a03b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.845174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf98824f-dad5-4ba9-b5b0-37ee6d11a03b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.845604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf98824f-dad5-4ba9-b5b0-37ee6d11a03b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:34.847053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf98824f-dad5-4ba9-b5b0-37ee6d11a03b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.847898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf98824f-dad5-4ba9-b5b0-37ee6d11a03b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.848515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf98824f-dad5-4ba9-b5b0-37ee6d11a03b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:35.022061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cf98824f-dad5-4ba9-b5b0-37ee6d11a03b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:35.030055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cf98824f-dad5-4ba9-b5b0-37ee6d11a03b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1319 microversion: 2.1 time: 0.200505 Aug 31 00:24:35.030631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 285/531] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:34 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:36.050642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-02c7bf82-5d8d-4bb2-af96-5c08fbe8821c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:36.051437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-02c7bf82-5d8d-4bb2-af96-5c08fbe8821c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:36.058188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02c7bf82-5d8d-4bb2-af96-5c08fbe8821c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:36.058671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02c7bf82-5d8d-4bb2-af96-5c08fbe8821c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:36.059138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02c7bf82-5d8d-4bb2-af96-5c08fbe8821c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:36.059834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02c7bf82-5d8d-4bb2-af96-5c08fbe8821c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:36.060376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02c7bf82-5d8d-4bb2-af96-5c08fbe8821c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:36.060766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02c7bf82-5d8d-4bb2-af96-5c08fbe8821c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:36.201647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-02c7bf82-5d8d-4bb2-af96-5c08fbe8821c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:36.210870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-02c7bf82-5d8d-4bb2-af96-5c08fbe8821c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1319 microversion: 2.1 time: 0.164514 Aug 31 00:24:36.211506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 247/532] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:36 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:37.231743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3365790f-2c87-4602-b0ba-5091fbb93697 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:37.232281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3365790f-2c87-4602-b0ba-5091fbb93697 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:37.238524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3365790f-2c87-4602-b0ba-5091fbb93697 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:37.239000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3365790f-2c87-4602-b0ba-5091fbb93697 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:37.239455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3365790f-2c87-4602-b0ba-5091fbb93697 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:37.240135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3365790f-2c87-4602-b0ba-5091fbb93697 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:37.240613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3365790f-2c87-4602-b0ba-5091fbb93697 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:37.241031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3365790f-2c87-4602-b0ba-5091fbb93697 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:37.375501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3365790f-2c87-4602-b0ba-5091fbb93697 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:37.377672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:37.385671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3365790f-2c87-4602-b0ba-5091fbb93697 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1319 microversion: 2.1 time: 0.157801 Aug 31 00:24:37.386251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 286/533] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:37 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:38.407395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fcb5e95e-45a8-4e2a-9cb4-8676f05e6ca3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:38.408002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fcb5e95e-45a8-4e2a-9cb4-8676f05e6ca3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:38.416106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fcb5e95e-45a8-4e2a-9cb4-8676f05e6ca3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:38.416106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fcb5e95e-45a8-4e2a-9cb4-8676f05e6ca3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:38.416402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fcb5e95e-45a8-4e2a-9cb4-8676f05e6ca3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:38.417098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fcb5e95e-45a8-4e2a-9cb4-8676f05e6ca3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:38.417650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fcb5e95e-45a8-4e2a-9cb4-8676f05e6ca3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:38.418054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fcb5e95e-45a8-4e2a-9cb4-8676f05e6ca3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:38.546454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fcb5e95e-45a8-4e2a-9cb4-8676f05e6ca3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:38.554946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fcb5e95e-45a8-4e2a-9cb4-8676f05e6ca3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1509 microversion: 2.1 time: 0.151493 Aug 31 00:24:38.555542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 248/534] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:38 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:59.002818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fab54d7c-0d6d-465d-83a6-e88363f18a52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:59.003457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fab54d7c-0d6d-465d-83a6-e88363f18a52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:59.011018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=11 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:59.011018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:59.013143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fab54d7c-0d6d-465d-83a6-e88363f18a52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:59.013627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fab54d7c-0d6d-465d-83a6-e88363f18a52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:59.014091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fab54d7c-0d6d-465d-83a6-e88363f18a52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:59.014849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fab54d7c-0d6d-465d-83a6-e88363f18a52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:59.015272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fab54d7c-0d6d-465d-83a6-e88363f18a52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:59.015702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fab54d7c-0d6d-465d-83a6-e88363f18a52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:59.040567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fab54d7c-0d6d-465d-83a6-e88363f18a52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/ips" status: 200 len: 153 microversion: 2.20 time: 0.041806 Aug 31 00:24:59.041143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 287/535] 10.222.0.67 () {60 vars in 1289 bytes} [Wed Aug 31 00:24:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:25:01.931592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d6f29c4d-552c-4cf7-a431-dbffb2080011 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:01.932161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d6f29c4d-552c-4cf7-a431-dbffb2080011 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:01.934443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=5 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:01.935102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=53 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:01.940913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6f29c4d-552c-4cf7-a431-dbffb2080011 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:01.941403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6f29c4d-552c-4cf7-a431-dbffb2080011 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:01.941851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6f29c4d-552c-4cf7-a431-dbffb2080011 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:01.943248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6f29c4d-552c-4cf7-a431-dbffb2080011 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:01.943882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6f29c4d-552c-4cf7-a431-dbffb2080011 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:01.945328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6f29c4d-552c-4cf7-a431-dbffb2080011 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:01.969545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-d6f29c4d-552c-4cf7-a431-dbffb2080011 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'flavor' on Instance uuid 02e4497e-f74f-4b4e-aac6-88c39ead5f38 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:02.170459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d6f29c4d-552c-4cf7-a431-dbffb2080011 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/action" status: 202 len: 0 microversion: 2.20 time: 0.242873 Aug 31 00:25:02.171415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 249/536] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 31 00:25:01 2022] POST /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:25:02.180366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:02.180846 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:02.189045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:02.189444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:02.189868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:02.190555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:02.190991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:02.191597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:02.326238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:02.334817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:02.336281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:02.337426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-566686d7-b39f-47eb-b9ee-e532fc710993 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1725 microversion: 2.20 time: 0.161791 Aug 31 00:25:02.337973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 288/537] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:03.360866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:03.361561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:03.369113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:03.369602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:03.370034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:03.370725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:03.371225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:03.372558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:03.510355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:03.520265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:03.523020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:03.524572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-211b039a-9129-46dd-9d96-232981c6daab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1725 microversion: 2.20 time: 0.168432 Aug 31 00:25:03.525226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 250/538] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:04.548367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:04.548916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:04.554950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:04.555701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:04.556117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:04.556798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:04.557380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:04.557813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:04.688563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:04.697794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:04.699265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:04.700421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9d680ba4-fcb9-495b-8d37-cc23211a69d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1725 microversion: 2.20 time: 0.156732 Aug 31 00:25:04.700978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 289/539] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:05.386694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3b2d66e5-dd93-4ca9-b0d4-f76d5083fad6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:05.387358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3b2d66e5-dd93-4ca9-b0d4-f76d5083fad6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:05.393601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b2d66e5-dd93-4ca9-b0d4-f76d5083fad6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.394080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b2d66e5-dd93-4ca9-b0d4-f76d5083fad6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.394511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b2d66e5-dd93-4ca9-b0d4-f76d5083fad6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.395239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b2d66e5-dd93-4ca9-b0d4-f76d5083fad6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.395994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b2d66e5-dd93-4ca9-b0d4-f76d5083fad6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.396402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b2d66e5-dd93-4ca9-b0d4-f76d5083fad6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.420721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3b2d66e5-dd93-4ca9-b0d4-f76d5083fad6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/ips" status: 200 len: 147 microversion: 2.1 time: 0.037898 Aug 31 00:25:05.421286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 251/540] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 31 00:25:05 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:05.724797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:05.725505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:05.731441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.731962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.732465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.733160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.733607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.734025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.867026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:05.875103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:05.876555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:05.877700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cc4f8033-38cb-4a86-aa54-c61c56f6ce46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1725 microversion: 2.20 time: 0.157676 Aug 31 00:25:05.878250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 290/541] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:06.901406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:06.901994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:06.908357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:06.908828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:06.909250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:06.909918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:06.910359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:06.910787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.042732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:07.051153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:07.052888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:07.054045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-38b1a769-e822-4469-acec-16c7bea7a2fc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1725 microversion: 2.20 time: 0.156828 Aug 31 00:25:07.054603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 252/542] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:08.077706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:08.078328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:08.084387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.084860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.085291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.085971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.086415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.086830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.221530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:08.230090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:08.231681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:08.232835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3e258785-1349-4586-b590-81e05b833588 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1725 microversion: 2.20 time: 0.159056 Aug 31 00:25:08.233724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 291/543] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:08.673257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0a25a121-2e14-4051-858a-5588f548e73c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a11198d-7e6d-4373-b4d0-47dc530dc59c"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:08.675678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0a25a121-2e14-4051-858a-5588f548e73c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:08.683716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a25a121-2e14-4051-858a-5588f548e73c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.684201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a25a121-2e14-4051-858a-5588f548e73c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.684641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a25a121-2e14-4051-858a-5588f548e73c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.685332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a25a121-2e14-4051-858a-5588f548e73c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.685801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a25a121-2e14-4051-858a-5588f548e73c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.686215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a25a121-2e14-4051-858a-5588f548e73c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.969364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0a25a121-2e14-4051-858a-5588f548e73c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "POST /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299469 Aug 31 00:25:08.970538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 253/544] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 00:25:08 2022] POST /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:09.257134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:09.257742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:09.263845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.264324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.264822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.265506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.265952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.266369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.394244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:09.403213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:09.404697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:09.406096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7992c0fd-000f-4996-bea6-7da8a77c4845 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1725 microversion: 2.20 time: 0.153675 Aug 31 00:25:09.406648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 292/545] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:09.656627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-775403f8-b0f5-4200-9406-de319c17e480 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "727ff178-46de-46c6-959d-cb83539980aa", "device": "/dev/sdb"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:09.659717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-775403f8-b0f5-4200-9406-de319c17e480 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:09.666760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-775403f8-b0f5-4200-9406-de319c17e480 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.667302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-775403f8-b0f5-4200-9406-de319c17e480 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.667732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-775403f8-b0f5-4200-9406-de319c17e480 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.668452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-775403f8-b0f5-4200-9406-de319c17e480 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.668901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-775403f8-b0f5-4200-9406-de319c17e480 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.669319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-775403f8-b0f5-4200-9406-de319c17e480 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.969834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-775403f8-b0f5-4200-9406-de319c17e480 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "POST /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317404 Aug 31 00:25:09.977437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 254/546] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 00:25:09 2022] POST /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:10.430795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:10.431593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:10.437809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:10.438340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:10.438822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.439540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:10.439992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:10.440409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.611942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:10.620809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:10.622287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:10.623470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f9c6107c-3930-4335-84aa-27103f050c8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1725 microversion: 2.20 time: 0.197372 Aug 31 00:25:10.624021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 293/547] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:11.647529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:11.648220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:11.654254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.654733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.655195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:11.655882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.656330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.656750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:12.104971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:12.115852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:12.117594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:12.118768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3b90218b-f176-466d-a8d5-a0be0c9f30ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1725 microversion: 2.20 time: 0.476310 Aug 31 00:25:12.119346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 255/548] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1725 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:13.149607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:13.150299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:13.161340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.161974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.162482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.164621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.165174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.165642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.407130 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:13.420527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:13.422121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:13.423474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c4d60f3e-bfae-4a9b-b699-9a9b0a5eceb4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1725 microversion: 2.20 time: 0.279201 Aug 31 00:25:13.424032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 294/549] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:14.445850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:14.446586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:14.453950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:14.454690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:14.455277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:14.456145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:14.456702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:14.457193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:14.588379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:14.596434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:14.597873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:14.599548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d4884250-f9d7-4f04-9fcc-c107c0b42723 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1746 microversion: 2.20 time: 0.157095 Aug 31 00:25:14.600186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 256/550] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:15.623157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:15.623717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:15.629847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:15.630327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:15.631430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:15.632371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:15.632969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:15.633619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:15.766415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:15.774796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:15.776245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:15.777383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c7df78f7-e9eb-4817-a370-bf82b33f952a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1746 microversion: 2.20 time: 0.158205 Aug 31 00:25:15.777968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 295/551] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:16.604325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1ad2d289-2a0c-471d-95bd-3c3fb5ebf1ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:16.610717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ad2d289-2a0c-471d-95bd-3c3fb5ebf1ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.611232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ad2d289-2a0c-471d-95bd-3c3fb5ebf1ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.611854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ad2d289-2a0c-471d-95bd-3c3fb5ebf1ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.676677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1ad2d289-2a0c-471d-95bd-3c3fb5ebf1ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Going to try to stop instance {{(pid=126975) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 00:25:16.725613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1ad2d289-2a0c-471d-95bd-3c3fb5ebf1ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "POST /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/action" status: 202 len: 0 microversion: 2.1 time: 0.124662 Aug 31 00:25:16.726175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 257/552] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 00:25:16 2022] POST /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:25:16.738366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4d0fa101-ad22-47d9-b41e-1f5a80d7ff0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:16.739543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4d0fa101-ad22-47d9-b41e-1f5a80d7ff0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:16.752082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d0fa101-ad22-47d9-b41e-1f5a80d7ff0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.753181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d0fa101-ad22-47d9-b41e-1f5a80d7ff0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.754014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d0fa101-ad22-47d9-b41e-1f5a80d7ff0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.754739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d0fa101-ad22-47d9-b41e-1f5a80d7ff0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.755289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d0fa101-ad22-47d9-b41e-1f5a80d7ff0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.755813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d0fa101-ad22-47d9-b41e-1f5a80d7ff0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.806895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:16.808623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:16.817305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.819007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.819834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.820778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.822104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.822759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.962922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4d0fa101-ad22-47d9-b41e-1f5a80d7ff0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:16.980986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4d0fa101-ad22-47d9-b41e-1f5a80d7ff0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.249234 Aug 31 00:25:16.982544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 296/553] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:16 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:17.016490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:17.025747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:17.027577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:17.029026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3461ece3-a4bb-4529-a736-f3069b9e0f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1746 microversion: 2.20 time: 0.230767 Aug 31 00:25:17.030042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 258/554] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1746 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:18.005325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5a35bea3-898f-4be8-9dab-9bd451e30414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:18.006530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5a35bea3-898f-4be8-9dab-9bd451e30414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:18.012473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a35bea3-898f-4be8-9dab-9bd451e30414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:18.012945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a35bea3-898f-4be8-9dab-9bd451e30414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:18.013368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a35bea3-898f-4be8-9dab-9bd451e30414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:18.014033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a35bea3-898f-4be8-9dab-9bd451e30414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:18.014473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a35bea3-898f-4be8-9dab-9bd451e30414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:18.014883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a35bea3-898f-4be8-9dab-9bd451e30414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:18.054316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:18.055028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:18.061664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:18.062148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:18.062581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:18.063304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:18.063760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:18.064188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:18.196644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5a35bea3-898f-4be8-9dab-9bd451e30414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:18.207773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5a35bea3-898f-4be8-9dab-9bd451e30414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.206064 Aug 31 00:25:18.208421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 297/555] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:18 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:18.230920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:18.239251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:18.240741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:18.242492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cb556ebd-38b5-4da7-91b4-5074b5d045eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1746 microversion: 2.20 time: 0.192010 Aug 31 00:25:18.243103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 259/556] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1746 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:18.769689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-1983ba1f-a02f-43f4-847a-ad2ba3ae8851 req-39441e26-46eb-40a5-bfea-d235f8dd8feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e4497e-f74f-4b4e-aac6-88c39ead5f38", "name": "network-vif-plugged", "status": "completed", "tag": "8dddb3be-7ff7-4bfa-aebb-406f077a2133"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:18.782877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1983ba1f-a02f-43f4-847a-ad2ba3ae8851 req-39441e26-46eb-40a5-bfea-d235f8dd8feb service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:18.783387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1983ba1f-a02f-43f4-847a-ad2ba3ae8851 req-39441e26-46eb-40a5-bfea-d235f8dd8feb service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:18.783809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1983ba1f-a02f-43f4-847a-ad2ba3ae8851 req-39441e26-46eb-40a5-bfea-d235f8dd8feb service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:18.796310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-1983ba1f-a02f-43f4-847a-ad2ba3ae8851 req-39441e26-46eb-40a5-bfea-d235f8dd8feb service nova] Creating event network-vif-plugged:8dddb3be-7ff7-4bfa-aebb-406f077a2133 for instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 on hv-cinder-85506 Aug 31 00:25:18.801613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-1983ba1f-a02f-43f4-847a-ad2ba3ae8851 req-39441e26-46eb-40a5-bfea-d235f8dd8feb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039580 Aug 31 00:25:18.802204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 298/557] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:19.229248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-51f7ae69-f95d-4c9d-b93f-07a397135025 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:19.229830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-51f7ae69-f95d-4c9d-b93f-07a397135025 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:19.236652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f7ae69-f95d-4c9d-b93f-07a397135025 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:19.237168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f7ae69-f95d-4c9d-b93f-07a397135025 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:19.237604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f7ae69-f95d-4c9d-b93f-07a397135025 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:19.238295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f7ae69-f95d-4c9d-b93f-07a397135025 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:19.238749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f7ae69-f95d-4c9d-b93f-07a397135025 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:19.239208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f7ae69-f95d-4c9d-b93f-07a397135025 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:19.244312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:19.266708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:19.267458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:19.273883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:19.274360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:19.274779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:19.275491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:19.275935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:19.276343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:19.427016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-51f7ae69-f95d-4c9d-b93f-07a397135025 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:19.436030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-51f7ae69-f95d-4c9d-b93f-07a397135025 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.210607 Aug 31 00:25:19.436872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 260/558] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:19 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:19.458302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:19.466807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:19.468278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:19.469427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-95641350-b37e-4b38-ade7-bd5a366c2790 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1746 microversion: 2.20 time: 0.207374 Aug 31 00:25:19.469981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 299/559] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1746 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:20.458437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9675672e-da21-4850-9aca-530d230f0388 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:20.459788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9675672e-da21-4850-9aca-530d230f0388 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:20.466054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9675672e-da21-4850-9aca-530d230f0388 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:20.466527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9675672e-da21-4850-9aca-530d230f0388 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:20.466951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9675672e-da21-4850-9aca-530d230f0388 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:20.467651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9675672e-da21-4850-9aca-530d230f0388 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:20.468092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9675672e-da21-4850-9aca-530d230f0388 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:20.468506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9675672e-da21-4850-9aca-530d230f0388 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:20.492269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:20.492872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:20.498780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:20.499289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:20.499742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:20.500405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:20.500861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:20.501280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:20.674751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9675672e-da21-4850-9aca-530d230f0388 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:20.679641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:20.684871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9675672e-da21-4850-9aca-530d230f0388 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.230133 Aug 31 00:25:20.685619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 261/560] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:20 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:20.695894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:20.697800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:20.699085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-01cfcff4-346d-4186-82e2-236418aaf158 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1746 microversion: 2.20 time: 0.210999 Aug 31 00:25:20.699771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 300/561] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1746 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:21.707313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-95b4850e-d33a-458f-bf81-432d473324ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:21.708267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-95b4850e-d33a-458f-bf81-432d473324ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:21.716119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95b4850e-d33a-458f-bf81-432d473324ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.716609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95b4850e-d33a-458f-bf81-432d473324ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.717037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95b4850e-d33a-458f-bf81-432d473324ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.717817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95b4850e-d33a-458f-bf81-432d473324ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.718366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95b4850e-d33a-458f-bf81-432d473324ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.718815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95b4850e-d33a-458f-bf81-432d473324ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.723953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:21.725394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:21.731622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.732105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.732538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.733237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.733688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.734110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.925458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-95b4850e-d33a-458f-bf81-432d473324ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:21.928694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:21.934029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-95b4850e-d33a-458f-bf81-432d473324ef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.230780 Aug 31 00:25:21.934610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 262/562] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:21 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:21.936668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:21.938117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:21.939294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b359b534-9126-46ca-9525-8f0897ea0226 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1746 microversion: 2.20 time: 0.219464 Aug 31 00:25:21.939829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 301/563] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:22.956587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8e2c8136-d67d-4b69-be44-3d33d955440f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:22.957605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8e2c8136-d67d-4b69-be44-3d33d955440f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:22.961878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:22.962485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:22.964841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e2c8136-d67d-4b69-be44-3d33d955440f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.965432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e2c8136-d67d-4b69-be44-3d33d955440f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.965962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e2c8136-d67d-4b69-be44-3d33d955440f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.966750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e2c8136-d67d-4b69-be44-3d33d955440f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.967339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e2c8136-d67d-4b69-be44-3d33d955440f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.968192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e2c8136-d67d-4b69-be44-3d33d955440f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.968449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.968931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.969362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.970046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.970494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.970908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.227181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:23.235913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8e2c8136-d67d-4b69-be44-3d33d955440f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:23.236660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:23.238457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:23.240060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-271a0a82-726c-41b9-9086-cb76b7a684b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1746 microversion: 2.20 time: 0.282114 Aug 31 00:25:23.241592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 302/564] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1746 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:23.282870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8e2c8136-d67d-4b69-be44-3d33d955440f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.330143 Aug 31 00:25:23.283496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 263/565] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:22 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:24.268519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:24.270097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:24.277374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.277870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.278309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.278992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.279462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.280141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.309360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bb30d642-2de8-467b-96b6-f86aef6a6454 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:24.311279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bb30d642-2de8-467b-96b6-f86aef6a6454 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:24.319975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb30d642-2de8-467b-96b6-f86aef6a6454 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.320472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb30d642-2de8-467b-96b6-f86aef6a6454 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.320907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb30d642-2de8-467b-96b6-f86aef6a6454 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.322228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb30d642-2de8-467b-96b6-f86aef6a6454 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.322744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb30d642-2de8-467b-96b6-f86aef6a6454 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.323383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb30d642-2de8-467b-96b6-f86aef6a6454 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.518488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:24.539814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:24.541722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:24.543835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-30a88c2a-901d-4715-9ccc-6bfc1e361f49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1741 microversion: 2.20 time: 0.280465 Aug 31 00:25:24.545427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 303/566] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1741 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:24.561314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bb30d642-2de8-467b-96b6-f86aef6a6454 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:24.572397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bb30d642-2de8-467b-96b6-f86aef6a6454 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.270098 Aug 31 00:25:24.575387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 264/567] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:24 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:25.571376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:25.572052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:25.579075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.579583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.580033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.580711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.581157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.581573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.597664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d070e09-459c-4f64-8792-143801b7c7f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:25.598256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d070e09-459c-4f64-8792-143801b7c7f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:25.605859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d070e09-459c-4f64-8792-143801b7c7f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.606788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d070e09-459c-4f64-8792-143801b7c7f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.607486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d070e09-459c-4f64-8792-143801b7c7f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.608550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d070e09-459c-4f64-8792-143801b7c7f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.609922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d070e09-459c-4f64-8792-143801b7c7f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.610822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d070e09-459c-4f64-8792-143801b7c7f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.613002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:25.809589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:25.818887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:25.821083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:25.822637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-45faf491-afd6-4f31-bfb5-fb8b92894019 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1741 microversion: 2.20 time: 0.256984 Aug 31 00:25:25.823418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 304/568] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1741 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:25.848134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8d070e09-459c-4f64-8792-143801b7c7f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:25.864542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d070e09-459c-4f64-8792-143801b7c7f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.270577 Aug 31 00:25:25.865431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 265/569] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:25 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:26.846918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:26.847903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:26.855302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.855875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.856311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:26.857030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.857548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.858152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:26.887615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5f2a9659-10e5-441b-9b0c-927a0f2e6fb0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:26.888347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5f2a9659-10e5-441b-9b0c-927a0f2e6fb0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:26.895375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f2a9659-10e5-441b-9b0c-927a0f2e6fb0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.895859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f2a9659-10e5-441b-9b0c-927a0f2e6fb0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.896292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f2a9659-10e5-441b-9b0c-927a0f2e6fb0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:26.897805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f2a9659-10e5-441b-9b0c-927a0f2e6fb0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.898375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f2a9659-10e5-441b-9b0c-927a0f2e6fb0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.898796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f2a9659-10e5-441b-9b0c-927a0f2e6fb0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:27.141313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:27.151622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:27.154144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:27.155507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7dec5efc-da90-4948-98e8-fba6d0ca51ff tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1741 microversion: 2.20 time: 0.312645 Aug 31 00:25:27.156645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 305/570] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1741 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:27.183582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f2a9659-10e5-441b-9b0c-927a0f2e6fb0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:27.193283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5f2a9659-10e5-441b-9b0c-927a0f2e6fb0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.309432 Aug 31 00:25:27.193850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 266/571] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:26 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:28.206182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:28.207946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:28.215439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5253b710-8de7-4a5f-b5e8-b89f7d481aa2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:28.216190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5253b710-8de7-4a5f-b5e8-b89f7d481aa2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:28.218314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.218861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.219986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.221094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.221704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.221983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.223322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5253b710-8de7-4a5f-b5e8-b89f7d481aa2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.224075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5253b710-8de7-4a5f-b5e8-b89f7d481aa2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.225245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5253b710-8de7-4a5f-b5e8-b89f7d481aa2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.226116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5253b710-8de7-4a5f-b5e8-b89f7d481aa2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.226659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5253b710-8de7-4a5f-b5e8-b89f7d481aa2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.227320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5253b710-8de7-4a5f-b5e8-b89f7d481aa2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.454158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:28.471814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:28.473480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5253b710-8de7-4a5f-b5e8-b89f7d481aa2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:28.473654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:28.475008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-937d94d1-bf72-4acf-b347-9ae159487143 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1741 microversion: 2.20 time: 0.298649 Aug 31 00:25:28.480462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 306/572] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1741 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:28.502092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5253b710-8de7-4a5f-b5e8-b89f7d481aa2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.290899 Aug 31 00:25:28.503646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 267/573] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:28 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:29.499853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:29.501085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:29.503436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=41 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:29.510410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:29.511153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:29.511782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:29.512667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:29.513323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:29.513770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:29.525419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7d7c5385-b10d-44a1-b11c-0089169d5f5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:29.526776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7d7c5385-b10d-44a1-b11c-0089169d5f5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:29.534077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d7c5385-b10d-44a1-b11c-0089169d5f5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:29.534812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d7c5385-b10d-44a1-b11c-0089169d5f5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:29.535277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d7c5385-b10d-44a1-b11c-0089169d5f5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:29.535984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d7c5385-b10d-44a1-b11c-0089169d5f5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:29.536434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d7c5385-b10d-44a1-b11c-0089169d5f5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:29.537042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d7c5385-b10d-44a1-b11c-0089169d5f5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:30.030725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7d7c5385-b10d-44a1-b11c-0089169d5f5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:30.034717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:30.042828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7d7c5385-b10d-44a1-b11c-0089169d5f5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.521416 Aug 31 00:25:30.044472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 268/574] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:29 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:30.048764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:30.050610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:30.051819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4dbb016c-0483-4005-95e1-88ce6ce33bcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1741 microversion: 2.20 time: 0.556152 Aug 31 00:25:30.052374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 307/575] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1741 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:31.075577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:31.076225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:31.081321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5574286a-9474-43f6-ac86-e2758ff4490c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:31.082526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5574286a-9474-43f6-ac86-e2758ff4490c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:31.088592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:31.089080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:31.089511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:31.090239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:31.090694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:31.091143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:31.098345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5574286a-9474-43f6-ac86-e2758ff4490c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:31.098855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5574286a-9474-43f6-ac86-e2758ff4490c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:31.099331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5574286a-9474-43f6-ac86-e2758ff4490c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:31.100670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5574286a-9474-43f6-ac86-e2758ff4490c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:31.101341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5574286a-9474-43f6-ac86-e2758ff4490c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:31.101769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5574286a-9474-43f6-ac86-e2758ff4490c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:31.324747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:31.329818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5574286a-9474-43f6-ac86-e2758ff4490c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:31.343370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5574286a-9474-43f6-ac86-e2758ff4490c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.275610 Aug 31 00:25:31.346437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:31.348699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:31.349468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 269/576] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:31 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:31.351156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4f1ae17c-ac6e-4141-b760-eb7ea583a8f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1741 microversion: 2.20 time: 0.279568 Aug 31 00:25:31.367159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 308/577] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1741 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:32.375148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-91c0a903-a893-4915-b1fe-daff7b01cbc3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:32.375735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:32.376095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:32.376932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-91c0a903-a893-4915-b1fe-daff7b01cbc3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:32.379632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=43 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:32.384696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.385588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.386191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.386330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91c0a903-a893-4915-b1fe-daff7b01cbc3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.386930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91c0a903-a893-4915-b1fe-daff7b01cbc3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.387480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91c0a903-a893-4915-b1fe-daff7b01cbc3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.387661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.388376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91c0a903-a893-4915-b1fe-daff7b01cbc3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.388498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.388987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91c0a903-a893-4915-b1fe-daff7b01cbc3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.389164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.389519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91c0a903-a893-4915-b1fe-daff7b01cbc3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.636240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:32.641575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91c0a903-a893-4915-b1fe-daff7b01cbc3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:32.656396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-91c0a903-a893-4915-b1fe-daff7b01cbc3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.285334 Aug 31 00:25:32.662883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 270/578] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:32 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:32.663141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:32.664550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:32.666024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7ff365f6-32fd-44bd-a29d-af2d4dc6ea8e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1741 microversion: 2.20 time: 0.295334 Aug 31 00:25:32.688016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 309/579] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1741 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:33.695522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:33.699171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:33.700114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9b786914-c8b9-4878-8a09-6ba4d03d8b2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:33.700836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9b786914-c8b9-4878-8a09-6ba4d03d8b2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:33.708498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b786914-c8b9-4878-8a09-6ba4d03d8b2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.708996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b786914-c8b9-4878-8a09-6ba4d03d8b2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.709982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b786914-c8b9-4878-8a09-6ba4d03d8b2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.710243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.710697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b786914-c8b9-4878-8a09-6ba4d03d8b2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.711185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b786914-c8b9-4878-8a09-6ba4d03d8b2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.711304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.711611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b786914-c8b9-4878-8a09-6ba4d03d8b2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.711713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.712433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.713069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.713502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.932980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.936088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9b786914-c8b9-4878-8a09-6ba4d03d8b2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.941336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.942753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.944784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-34952c53-bbf8-46f7-b597-94d271119e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1741 microversion: 2.20 time: 0.253247 Aug 31 00:25:33.944948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9b786914-c8b9-4878-8a09-6ba4d03d8b2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.248907 Aug 31 00:25:33.945516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 310/580] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:33 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:33.945733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 271/581] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:33 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:34.967461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5433e49d-e8e1-46c9-bbbb-4dfb9901df5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:34.968736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:34.969349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:34.973569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5433e49d-e8e1-46c9-bbbb-4dfb9901df5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:34.976904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.977420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.977859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.978554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.979002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.979445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.981098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5433e49d-e8e1-46c9-bbbb-4dfb9901df5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.981581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5433e49d-e8e1-46c9-bbbb-4dfb9901df5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.982019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5433e49d-e8e1-46c9-bbbb-4dfb9901df5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.982714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5433e49d-e8e1-46c9-bbbb-4dfb9901df5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.983207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5433e49d-e8e1-46c9-bbbb-4dfb9901df5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.983633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5433e49d-e8e1-46c9-bbbb-4dfb9901df5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.189707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.193340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5433e49d-e8e1-46c9-bbbb-4dfb9901df5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.198158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.199746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.201170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-492abfd1-24d0-48de-9d79-c90fe0fdb888 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1741 microversion: 2.20 time: 0.236582 Aug 31 00:25:35.201713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5433e49d-e8e1-46c9-bbbb-4dfb9901df5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.238906 Aug 31 00:25:35.201835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 272/582] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:35.202268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 311/583] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:36.224211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-30dc251c-7818-4154-916a-cb634a47108d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:36.225454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:36.225851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-30dc251c-7818-4154-916a-cb634a47108d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:36.225945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:36.231463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.231614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30dc251c-7818-4154-916a-cb634a47108d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.231948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.232076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30dc251c-7818-4154-916a-cb634a47108d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.232379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.232498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30dc251c-7818-4154-916a-cb634a47108d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.233063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.233161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30dc251c-7818-4154-916a-cb634a47108d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.233518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.233628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30dc251c-7818-4154-916a-cb634a47108d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.233966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.234069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30dc251c-7818-4154-916a-cb634a47108d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.433304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:36.437253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-30dc251c-7818-4154-916a-cb634a47108d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:36.441514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:36.442934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:36.444611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-807394a9-6881-4180-a774-142821e56908 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1741 microversion: 2.20 time: 0.224165 Aug 31 00:25:36.445177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 312/584] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:36.446443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-30dc251c-7818-4154-916a-cb634a47108d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.226134 Aug 31 00:25:36.447012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 273/585] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:36 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:37.468043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:37.468648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:37.468861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-395b44fa-f3fe-4dce-828d-1a9689666caf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:37.469468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-395b44fa-f3fe-4dce-828d-1a9689666caf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:37.475990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.476715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.478056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395b44fa-f3fe-4dce-828d-1a9689666caf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.478184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.478788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395b44fa-f3fe-4dce-828d-1a9689666caf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.478788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395b44fa-f3fe-4dce-828d-1a9689666caf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.479358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.479358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.480390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395b44fa-f3fe-4dce-828d-1a9689666caf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.480488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.480585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395b44fa-f3fe-4dce-828d-1a9689666caf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.480585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395b44fa-f3fe-4dce-828d-1a9689666caf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.679179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.683620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-395b44fa-f3fe-4dce-828d-1a9689666caf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.688340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.689813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.690994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-baefd413-e698-4106-82a4-cd091de6e94a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1723 microversion: 2.20 time: 0.226840 Aug 31 00:25:37.691766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 313/586] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:37.692605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-395b44fa-f3fe-4dce-828d-1a9689666caf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.227516 Aug 31 00:25:37.693343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 274/587] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:37 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:38.714418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-224baf28-378c-494e-947d-87d7b189d97c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:38.715004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-224baf28-378c-494e-947d-87d7b189d97c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:38.715125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:38.715680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:38.721155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-224baf28-378c-494e-947d-87d7b189d97c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.721639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-224baf28-378c-494e-947d-87d7b189d97c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.721965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.722081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-224baf28-378c-494e-947d-87d7b189d97c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.722441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.722742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-224baf28-378c-494e-947d-87d7b189d97c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.722870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.723220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-224baf28-378c-494e-947d-87d7b189d97c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.723573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.723670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-224baf28-378c-494e-947d-87d7b189d97c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.724021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.724438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.919960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.923123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-224baf28-378c-494e-947d-87d7b189d97c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.928082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.929525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.930669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e13ed010-d5fa-4a9a-bbd4-5bcdd3f193ed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1723 microversion: 2.20 time: 0.219474 Aug 31 00:25:38.931203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-224baf28-378c-494e-947d-87d7b189d97c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.220650 Aug 31 00:25:38.931315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 275/588] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:38.931753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 314/589] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:38 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:39.952649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-83f7bd15-546b-4608-a6b9-f4daabbe8c1a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:39.953256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-83f7bd15-546b-4608-a6b9-f4daabbe8c1a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:39.953364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:39.953918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:39.959910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.960143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83f7bd15-546b-4608-a6b9-f4daabbe8c1a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.960451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83f7bd15-546b-4608-a6b9-f4daabbe8c1a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.960562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.960890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83f7bd15-546b-4608-a6b9-f4daabbe8c1a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:39.961017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:39.961585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83f7bd15-546b-4608-a6b9-f4daabbe8c1a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.961697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.962035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83f7bd15-546b-4608-a6b9-f4daabbe8c1a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.962148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.962447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:39.962551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83f7bd15-546b-4608-a6b9-f4daabbe8c1a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.153820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:40.162066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:40.164101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:40.165261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ec407745-a436-4034-82ec-7edd30a5a72f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1723 microversion: 2.20 time: 0.215749 Aug 31 00:25:40.165821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 315/590] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:40.165978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-83f7bd15-546b-4608-a6b9-f4daabbe8c1a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:40.169292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:40.175112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-83f7bd15-546b-4608-a6b9-f4daabbe8c1a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.226543 Aug 31 00:25:40.175699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 276/591] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:39 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:40.466708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-d0b78d26-4579-4cf5-8141-bd48a07a8902 req-ff831c7e-3a1f-4d9b-9e94-75c8cb6e4840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e4497e-f74f-4b4e-aac6-88c39ead5f38", "name": "network-vif-unplugged", "status": "completed", "tag": "8dddb3be-7ff7-4bfa-aebb-406f077a2133"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:40.477374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d0b78d26-4579-4cf5-8141-bd48a07a8902 req-ff831c7e-3a1f-4d9b-9e94-75c8cb6e4840 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:40.477844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d0b78d26-4579-4cf5-8141-bd48a07a8902 req-ff831c7e-3a1f-4d9b-9e94-75c8cb6e4840 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:40.478719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d0b78d26-4579-4cf5-8141-bd48a07a8902 req-ff831c7e-3a1f-4d9b-9e94-75c8cb6e4840 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.490023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-d0b78d26-4579-4cf5-8141-bd48a07a8902 req-ff831c7e-3a1f-4d9b-9e94-75c8cb6e4840 service nova] Creating event network-vif-unplugged:8dddb3be-7ff7-4bfa-aebb-406f077a2133 for instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 on hv-cinder-85506 Aug 31 00:25:40.495860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-d0b78d26-4579-4cf5-8141-bd48a07a8902 req-ff831c7e-3a1f-4d9b-9e94-75c8cb6e4840 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032716 Aug 31 00:25:40.496457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 316/592] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:41.187787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:41.188385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:41.195553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:41.196032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:41.196466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:41.197147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:41.197596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:41.198012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:41.198108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d232e156-cea9-4596-8c2a-d7412f0df82d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:41.198803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d232e156-cea9-4596-8c2a-d7412f0df82d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:41.205079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d232e156-cea9-4596-8c2a-d7412f0df82d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:41.205554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d232e156-cea9-4596-8c2a-d7412f0df82d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:41.205983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d232e156-cea9-4596-8c2a-d7412f0df82d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:41.206667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d232e156-cea9-4596-8c2a-d7412f0df82d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:41.207154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d232e156-cea9-4596-8c2a-d7412f0df82d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:41.207560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d232e156-cea9-4596-8c2a-d7412f0df82d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:41.397883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:41.401289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d232e156-cea9-4596-8c2a-d7412f0df82d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:41.406215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:41.407688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:41.408836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b88f3fa2-026c-44e1-befd-9556a44cc7ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1723 microversion: 2.20 time: 0.225350 Aug 31 00:25:41.409388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 277/593] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:41.410766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d232e156-cea9-4596-8c2a-d7412f0df82d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.217314 Aug 31 00:25:41.411359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 317/594] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:41 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:42.433543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5075efe3-cd74-4bbd-b93e-71d160c9d08e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:42.434112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:42.434469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5075efe3-cd74-4bbd-b93e-71d160c9d08e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:42.434586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:42.440480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:42.440969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:42.441402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:42.441512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5075efe3-cd74-4bbd-b93e-71d160c9d08e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:42.441895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5075efe3-cd74-4bbd-b93e-71d160c9d08e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:42.442092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:42.442322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5075efe3-cd74-4bbd-b93e-71d160c9d08e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:42.442540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:42.442960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:42.443089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5075efe3-cd74-4bbd-b93e-71d160c9d08e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:42.443454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5075efe3-cd74-4bbd-b93e-71d160c9d08e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:42.444413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5075efe3-cd74-4bbd-b93e-71d160c9d08e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:42.637934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:42.641651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5075efe3-cd74-4bbd-b93e-71d160c9d08e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:42.646267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:42.648017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:42.649175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-337a35ff-542d-42c0-a7b5-4dc81605477c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1723 microversion: 2.20 time: 0.219251 Aug 31 00:25:42.649736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 318/595] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:42.650633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5075efe3-cd74-4bbd-b93e-71d160c9d08e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1724 microversion: 2.1 time: 0.220674 Aug 31 00:25:42.650750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 278/596] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:42 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:43.672340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:43.673021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:43.679864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:43.680341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:43.680768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.681450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:43.681896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:43.682306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.789696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-35e8d465-3b9b-4d80-890e-2642e0e46df2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:43.790291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-35e8d465-3b9b-4d80-890e-2642e0e46df2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:43.796308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35e8d465-3b9b-4d80-890e-2642e0e46df2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:43.796788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35e8d465-3b9b-4d80-890e-2642e0e46df2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:43.797211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35e8d465-3b9b-4d80-890e-2642e0e46df2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.797888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35e8d465-3b9b-4d80-890e-2642e0e46df2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:43.798332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35e8d465-3b9b-4d80-890e-2642e0e46df2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:43.798746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35e8d465-3b9b-4d80-890e-2642e0e46df2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.821381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.829635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.831105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.832264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-47ae1682-287a-47de-83ca-1c230b96f5ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1723 microversion: 2.20 time: 0.163774 Aug 31 00:25:43.832833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 279/597] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:43.932693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-35e8d465-3b9b-4d80-890e-2642e0e46df2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.940799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-35e8d465-3b9b-4d80-890e-2642e0e46df2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1701 microversion: 2.1 time: 0.272980 Aug 31 00:25:43.941365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 319/598] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:43 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1701 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:43.962876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e79e306e-75c6-4ccc-a7dd-17bfe68a0204 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:43.968924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e79e306e-75c6-4ccc-a7dd-17bfe68a0204 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:43.969407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e79e306e-75c6-4ccc-a7dd-17bfe68a0204 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:43.969838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e79e306e-75c6-4ccc-a7dd-17bfe68a0204 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.992859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e79e306e-75c6-4ccc-a7dd-17bfe68a0204 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Going to try to start instance {{(pid=126975) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 00:25:44.036505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e79e306e-75c6-4ccc-a7dd-17bfe68a0204 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "POST /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/action" status: 202 len: 0 microversion: 2.1 time: 0.077908 Aug 31 00:25:44.037103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 280/599] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 00:25:43 2022] POST /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:25:44.045185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-425507c9-9c25-4d27-992a-7d20636abde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:44.045785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-425507c9-9c25-4d27-992a-7d20636abde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:44.051684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-425507c9-9c25-4d27-992a-7d20636abde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.052152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-425507c9-9c25-4d27-992a-7d20636abde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.052577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-425507c9-9c25-4d27-992a-7d20636abde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.053773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-425507c9-9c25-4d27-992a-7d20636abde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.054221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-425507c9-9c25-4d27-992a-7d20636abde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.054630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-425507c9-9c25-4d27-992a-7d20636abde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.191218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-425507c9-9c25-4d27-992a-7d20636abde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:44.200424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-425507c9-9c25-4d27-992a-7d20636abde0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1710 microversion: 2.1 time: 0.159031 Aug 31 00:25:44.200982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 320/600] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:44 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:44.858555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:44.859305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:44.866950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.867473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.867901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.868771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.869378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.870073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:45.221793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-631ed30e-d3f7-49d6-921b-e50484661e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:45.222394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-631ed30e-d3f7-49d6-921b-e50484661e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:45.229872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-631ed30e-d3f7-49d6-921b-e50484661e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:45.231618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-631ed30e-d3f7-49d6-921b-e50484661e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:45.232313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-631ed30e-d3f7-49d6-921b-e50484661e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:45.233231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-631ed30e-d3f7-49d6-921b-e50484661e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:45.234101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-631ed30e-d3f7-49d6-921b-e50484661e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:45.234987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-631ed30e-d3f7-49d6-921b-e50484661e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:45.377020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:45.386968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:45.389239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:45.390839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eb3d69b8-0b83-48d7-af45-c194d49f0dec tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1723 microversion: 2.20 time: 0.538273 Aug 31 00:25:45.391988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 281/601] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1723 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:45.507632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-631ed30e-d3f7-49d6-921b-e50484661e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:45.511472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:45.517316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-631ed30e-d3f7-49d6-921b-e50484661e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1710 microversion: 2.1 time: 0.299457 Aug 31 00:25:45.517885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 321/602] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:45 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1710 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:46.417834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:46.418506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:46.425082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.425563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.425993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.426700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.427180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.427667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.542300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3f00895-b5a8-4760-b715-026623edbf8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:46.543636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3f00895-b5a8-4760-b715-026623edbf8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:46.550062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3f00895-b5a8-4760-b715-026623edbf8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.550543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3f00895-b5a8-4760-b715-026623edbf8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.551289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3f00895-b5a8-4760-b715-026623edbf8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.551978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3f00895-b5a8-4760-b715-026623edbf8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.552600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3f00895-b5a8-4760-b715-026623edbf8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.553015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3f00895-b5a8-4760-b715-026623edbf8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.566017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.578900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.580692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.581968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ddac49b-2786-4911-ab69-bcb9961031cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1666 microversion: 2.20 time: 0.168217 Aug 31 00:25:46.582633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 282/603] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1666 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:46.588522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e1e81da1-bfa4-4946-9540-1e5abad50c77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:46.589264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e1e81da1-bfa4-4946-9540-1e5abad50c77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:46.595621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e81da1-bfa4-4946-9540-1e5abad50c77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.596375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e81da1-bfa4-4946-9540-1e5abad50c77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.596989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e81da1-bfa4-4946-9540-1e5abad50c77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.597695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e81da1-bfa4-4946-9540-1e5abad50c77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.598148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e81da1-bfa4-4946-9540-1e5abad50c77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.598600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e81da1-bfa4-4946-9540-1e5abad50c77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.685346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e3f00895-b5a8-4760-b715-026623edbf8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.693427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3f00895-b5a8-4760-b715-026623edbf8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1710 microversion: 2.1 time: 0.157570 Aug 31 00:25:46.694023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 322/604] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:46 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:46.699205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b1a740c7-0b4d-40b3-82ca-87d2e2d0c79a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bff329ef-5896-4a6e-94ab-1f26ac09a59d"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:46.701826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b1a740c7-0b4d-40b3-82ca-87d2e2d0c79a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:46.707574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1a740c7-0b4d-40b3-82ca-87d2e2d0c79a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.708064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1a740c7-0b4d-40b3-82ca-87d2e2d0c79a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.708499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1a740c7-0b4d-40b3-82ca-87d2e2d0c79a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.709193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1a740c7-0b4d-40b3-82ca-87d2e2d0c79a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.709684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1a740c7-0b4d-40b3-82ca-87d2e2d0c79a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.710299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1a740c7-0b4d-40b3-82ca-87d2e2d0c79a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.731272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-e1e81da1-bfa4-4946-9540-1e5abad50c77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'services' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:46.859708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e1e81da1-bfa4-4946-9540-1e5abad50c77 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "DELETE /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6/os-volume_attachments/727ff178-46de-46c6-959d-cb83539980aa" status: 202 len: 0 microversion: 2.1 time: 0.275390 Aug 31 00:25:46.860333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 283/605] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:25:46 2022] DELETE /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6/os-volume_attachments/727ff178-46de-46c6-959d-cb83539980aa => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:25:47.004335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b1a740c7-0b4d-40b3-82ca-87d2e2d0c79a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308947 Aug 31 00:25:47.004939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 323/606] 10.222.0.67 () {62 vars in 1364 bytes} [Wed Aug 31 00:25:46 2022] POST /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:25:47.148269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e9b95fe3-d4f3-4389-826f-4afaa8076d38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:47.149071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e9b95fe3-d4f3-4389-826f-4afaa8076d38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:47.155556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b95fe3-d4f3-4389-826f-4afaa8076d38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.156110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b95fe3-d4f3-4389-826f-4afaa8076d38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.156606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b95fe3-d4f3-4389-826f-4afaa8076d38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.157388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b95fe3-d4f3-4389-826f-4afaa8076d38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.157843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b95fe3-d4f3-4389-826f-4afaa8076d38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.158280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b95fe3-d4f3-4389-826f-4afaa8076d38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.245398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e9b95fe3-d4f3-4389-826f-4afaa8076d38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126975) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:25:47.311909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e9b95fe3-d4f3-4389-826f-4afaa8076d38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/action" status: 202 len: 0 microversion: 2.20 time: 0.169266 Aug 31 00:25:47.312708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 284/607] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 31 00:25:47 2022] POST /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:25:47.320964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:47.321565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:47.327612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.328080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.328505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.329183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.329629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.330047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.564832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.577057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.578730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.579990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f98f832a-177a-4717-80fa-553f96744a4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1752 microversion: 2.20 time: 0.262994 Aug 31 00:25:47.580532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 324/608] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1752 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:47.715874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-61df9977-1fda-4a7c-9bfc-325d07838ef8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:47.716454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-61df9977-1fda-4a7c-9bfc-325d07838ef8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:47.722395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61df9977-1fda-4a7c-9bfc-325d07838ef8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.722871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61df9977-1fda-4a7c-9bfc-325d07838ef8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.723335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61df9977-1fda-4a7c-9bfc-325d07838ef8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.724029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61df9977-1fda-4a7c-9bfc-325d07838ef8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.724639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61df9977-1fda-4a7c-9bfc-325d07838ef8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.725053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61df9977-1fda-4a7c-9bfc-325d07838ef8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.862450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-61df9977-1fda-4a7c-9bfc-325d07838ef8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.872044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-61df9977-1fda-4a7c-9bfc-325d07838ef8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1714 microversion: 2.1 time: 0.160518 Aug 31 00:25:47.872605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 285/609] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:47 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:48.603920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:48.604524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:48.610361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:48.610844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.611317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.612003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:48.612451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.612867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.744121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.752663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.754109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.755288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6f78de4f-e6c4-4497-9fc4-0c334d263890 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1754 microversion: 2.20 time: 0.155941 Aug 31 00:25:48.755846 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 325/610] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:49.048944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aa61e47c-b575-44f7-8c45-13afe43d659c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:49.049537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aa61e47c-b575-44f7-8c45-13afe43d659c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:49.056296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa61e47c-b575-44f7-8c45-13afe43d659c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.056778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa61e47c-b575-44f7-8c45-13afe43d659c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.057206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa61e47c-b575-44f7-8c45-13afe43d659c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.057896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa61e47c-b575-44f7-8c45-13afe43d659c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.058344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa61e47c-b575-44f7-8c45-13afe43d659c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.058778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa61e47c-b575-44f7-8c45-13afe43d659c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.084276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aa61e47c-b575-44f7-8c45-13afe43d659c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:25:49.163346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aa61e47c-b575-44f7-8c45-13afe43d659c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "DELETE /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 204 len: 0 microversion: 2.1 time: 0.117935 Aug 31 00:25:49.164350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 286/611] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:25:49 2022] DELETE /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:25:49.173340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-833dc0a2-b7ff-4c65-95ea-1d350f94f6d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:49.173937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-833dc0a2-b7ff-4c65-95ea-1d350f94f6d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:49.180139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-833dc0a2-b7ff-4c65-95ea-1d350f94f6d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.180718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-833dc0a2-b7ff-4c65-95ea-1d350f94f6d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.181081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-833dc0a2-b7ff-4c65-95ea-1d350f94f6d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.181789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-833dc0a2-b7ff-4c65-95ea-1d350f94f6d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.182231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-833dc0a2-b7ff-4c65-95ea-1d350f94f6d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.182645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-833dc0a2-b7ff-4c65-95ea-1d350f94f6d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.315535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-833dc0a2-b7ff-4c65-95ea-1d350f94f6d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:49.324311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-833dc0a2-b7ff-4c65-95ea-1d350f94f6d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1515 microversion: 2.1 time: 0.155201 Aug 31 00:25:49.324871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 326/612] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:49 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:49.785628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:49.786387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:49.795231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.795717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.796184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.796873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.797328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.797747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.932931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:49.941480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:49.942909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:49.944098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dae2f3f5-25be-4c91-a840-57229773eddb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1754 microversion: 2.20 time: 0.162965 Aug 31 00:25:49.944705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 287/613] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:50.345627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e97aa4f5-d10e-4b62-9a92-c169a0d557f2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:50.346206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e97aa4f5-d10e-4b62-9a92-c169a0d557f2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:50.353020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e97aa4f5-d10e-4b62-9a92-c169a0d557f2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.353484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e97aa4f5-d10e-4b62-9a92-c169a0d557f2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.353906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e97aa4f5-d10e-4b62-9a92-c169a0d557f2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.354573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e97aa4f5-d10e-4b62-9a92-c169a0d557f2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.355011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e97aa4f5-d10e-4b62-9a92-c169a0d557f2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.355450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e97aa4f5-d10e-4b62-9a92-c169a0d557f2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.482407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e97aa4f5-d10e-4b62-9a92-c169a0d557f2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:50.490160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e97aa4f5-d10e-4b62-9a92-c169a0d557f2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1515 microversion: 2.1 time: 0.148320 Aug 31 00:25:50.490719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 327/614] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:50 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:50.967377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:50.972690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:50.979402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.979882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.980310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.981028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.981477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.981895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.118185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.126671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.128135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.129272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e0c013cd-9e20-4b68-8cc1-7d9e9fd1e475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.165983 Aug 31 00:25:51.129820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 288/615] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:51.513094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f364a767-6d74-4d67-9dcd-a7ea10ee25a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:51.513678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f364a767-6d74-4d67-9dcd-a7ea10ee25a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:51.519850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f364a767-6d74-4d67-9dcd-a7ea10ee25a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.520323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f364a767-6d74-4d67-9dcd-a7ea10ee25a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.520751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f364a767-6d74-4d67-9dcd-a7ea10ee25a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.521426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f364a767-6d74-4d67-9dcd-a7ea10ee25a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.521874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f364a767-6d74-4d67-9dcd-a7ea10ee25a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.522390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f364a767-6d74-4d67-9dcd-a7ea10ee25a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.650659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f364a767-6d74-4d67-9dcd-a7ea10ee25a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.658377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f364a767-6d74-4d67-9dcd-a7ea10ee25a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1515 microversion: 2.1 time: 0.149145 Aug 31 00:25:51.658937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 328/616] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:51 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:52.156873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:52.157512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:52.165197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.165715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.166148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.167069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.167536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.168019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.172351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:52.396839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.407071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.408632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.410174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dc35f345-4bb6-4fb4-9fde-8d3c63e8e895 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.257222 Aug 31 00:25:52.410822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 289/617] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:52.428918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-73a192c9-13ca-4a6e-8f32-d040b4c425b7 req-394232b1-8d49-4e26-ad46-427ec81f6f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779ab581-0d74-4e77-846a-0ec6cb0dc5d6", "name": "network-vif-deleted", "tag": "b5a4cf62-1e23-4a14-be0a-80f138088cec"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:52.440317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-73a192c9-13ca-4a6e-8f32-d040b4c425b7 req-394232b1-8d49-4e26-ad46-427ec81f6f92 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.441140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-73a192c9-13ca-4a6e-8f32-d040b4c425b7 req-394232b1-8d49-4e26-ad46-427ec81f6f92 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.441567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-73a192c9-13ca-4a6e-8f32-d040b4c425b7 req-394232b1-8d49-4e26-ad46-427ec81f6f92 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.453096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-73a192c9-13ca-4a6e-8f32-d040b4c425b7 req-394232b1-8d49-4e26-ad46-427ec81f6f92 service nova] Creating event network-vif-deleted:b5a4cf62-1e23-4a14-be0a-80f138088cec for instance 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 on hv-cinder-85506 Aug 31 00:25:52.458036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-73a192c9-13ca-4a6e-8f32-d040b4c425b7 req-394232b1-8d49-4e26-ad46-427ec81f6f92 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032972 Aug 31 00:25:52.458598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 329/618] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:52.680012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:52.680530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:52.686478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.686957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.687418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.688095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.688543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.688958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.720975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.721370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.721826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.722249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:52.767434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.776734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-433f20b8-94c9-4918-be82-655499b329ed tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.100705 Aug 31 00:25:52.777492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 290/619] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:52 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:53.435827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:53.436515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:53.443207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.443938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.444578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.445602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.446231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.446808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.601688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.610419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.611882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.613034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-67b2e6c0-3572-420d-aec8-3ac74abb682f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.181470 Aug 31 00:25:53.613592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 330/620] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:53 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:53.798409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:53.798944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:53.805565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.806045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.806476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.807185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.807652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.808046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.846172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.847141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.847732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.848340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:53.893631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.902544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4d8b340e-c173-4119-86c8-8a61a0db0a86 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.108102 Aug 31 00:25:53.903136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 291/621] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:53 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:54.637920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:54.638568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:54.644628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.645113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.645547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.646224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.646673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.647116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.774980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:54.784136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:54.785727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:54.787002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f057cc97-2217-4983-98fc-0e359ce0096a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.153140 Aug 31 00:25:54.787942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 331/622] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:54.924285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:54.924806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:54.932310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.932784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.933214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.933895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.934344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.934760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.965243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.965735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.966144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.966583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:55.015607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:55.023673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bd36b0cf-2901-44ae-a285-39d9756aaeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.102914 Aug 31 00:25:55.024257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 292/623] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:54 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:55.810707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:55.811345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:55.817305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.817784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.818342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.819029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.819594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.820041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.947653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:55.956105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:55.957547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:55.958682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a12e477a-ed9e-4241-a74e-1da1b46a9735 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.151833 Aug 31 00:25:55.959276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 332/624] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:56.045060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:56.045666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:56.058245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.058746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.059193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.059894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.064578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.065061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.107974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.108452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.108886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.109325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:56.153568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:56.161376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-865663ee-7fc2-47df-9a33-48c4b1ecffb3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.120113 Aug 31 00:25:56.161948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 293/625] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:56 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:56.980666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:56.981272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:56.987311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.987790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.988228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.988906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.989362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.989781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:57.149364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:57.158669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:57.160463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:57.161627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ad4668e3-24b5-4142-bf2d-85ca8849c00e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.184871 Aug 31 00:25:57.162169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 333/626] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:57.189020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:57.189624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:57.195546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:57.196021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:57.196450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:57.197217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:57.197663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:57.198080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:57.228307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:57.228785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:57.229211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:57.229646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:57.274258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:57.283712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-346bc31f-014d-4f02-bcd2-c78bf597f7aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.103586 Aug 31 00:25:57.299204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 294/627] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:57 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:58.189733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:58.190622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:58.197896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.198529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.199020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.199947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.200452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.200822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.306395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:58.307118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:58.313729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.314478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.315017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.315798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.316337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.316769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.351731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:58.353521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.354001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.354430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.354871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:58.360324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:58.361838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:58.363248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b0304226-5c63-47a9-b9d0-ce2730b3047c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.181122 Aug 31 00:25:58.363882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 334/628] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:58.400113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:58.408326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-044e3f74-f1f1-4a07-95bb-e25a219f339e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.106354 Aug 31 00:25:58.408899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 295/629] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:58 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:59.388172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:59.388798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:59.402184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.402678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.403157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.403866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.404321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.404749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.429068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:59.429935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:59.436366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.437139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.437760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.438458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.438909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.439353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.476727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.477226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.477667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.478123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:59.526230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:59.534461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2a588532-36a6-48fb-9f0c-60e60ba5809c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.109274 Aug 31 00:25:59.535691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 296/630] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:59 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:59.568404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:59.577938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:59.579465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:59.580788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-438f1be7-04bc-45fd-977c-cdd34b033150 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.196809 Aug 31 00:25:59.581353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 335/631] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:00.556766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:00.557668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:00.565004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.565484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.566110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.566805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.567294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.567747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.608470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:00.609158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:00.611427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=58 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:00.613695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.614240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.614681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.615168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:00.620173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.620658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.621289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.622165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.622775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.623495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.643581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:00.669107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:00.680160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6c8ee412-7a19-472e-ab9c-39f62520679a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.127541 Aug 31 00:26:00.680749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 297/632] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:00 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:00.769593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:00.779061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:00.780501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:00.781661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ad559c37-15d0-4d3e-8861-1a4b3cc81f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.177427 Aug 31 00:26:00.782217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 336/633] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:01.701850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:01.702568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:01.709321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:01.709798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:01.710220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:01.710990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:01.711468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:01.711879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:01.747694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:01.748174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:01.748591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:01.749026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:01.797634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:01.807644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:01.809800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:01.814791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8fd69477-eaf9-4bfa-8507-2bfd36875b2f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.117248 Aug 31 00:26:01.816044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 298/634] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:01 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:01.830264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:01.831085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:01.831690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:01.832633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:01.833233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:01.833789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:01.996664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:02.006938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:02.008496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:02.009661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2d1dad70-5a2b-4611-b4e9-21c2a289ca84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.207723 Aug 31 00:26:02.010225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 337/635] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:02.836992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:02.837604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:02.840064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:02.846162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.847003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.847003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.847755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.848199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.848578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.886226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.887166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.887868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.888620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:02.946347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:02.954928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9cf5ac78-84df-4926-a0b5-04d91328a1a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.122505 Aug 31 00:26:02.955551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 299/636] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:02 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:03.033583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:03.034191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:03.041094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:03.041573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:03.042012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:03.042694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:03.043172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:03.043596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:03.193956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:03.207416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:03.209341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:03.211431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cfa23d8f-4c9a-42bb-84bc-6db4ef2c1e49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.181716 Aug 31 00:26:03.212520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 338/637] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:03.977947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:03.978534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:03.985509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:03.986026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:03.986455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:03.987185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:03.987639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:03.988060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:04.019898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:04.020379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:04.020809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:04.021250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:04.062069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:04.069893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-418ff8ca-6d0f-4a8a-a405-0fdf843dfa9e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.096443 Aug 31 00:26:04.070468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 300/638] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:03 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:04.234613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:04.235296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:04.241198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:04.242443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:04.242949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:04.243694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:04.244150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:04.244573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:04.379601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:04.389678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:04.391568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:04.392834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1dd864c8-a788-4a71-b059-4a0d974b7a85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.162285 Aug 31 00:26:04.393593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 339/639] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:05.090018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:05.090626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:05.097091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:05.097583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:05.098015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:05.098700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:05.099174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:05.099600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:05.133307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:05.133704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:05.134128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:05.134562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:05.175195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:05.178495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:05.184103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4d0a13c2-6a14-41ff-837a-18fea979e27e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.098263 Aug 31 00:26:05.184670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 301/640] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:05 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:05.424244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:05.424785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:05.431855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:05.432339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:05.432770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:05.433456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:05.433905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:05.434327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:05.561063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:05.569564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:05.571686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:05.572822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-df1ca1d3-d3fc-4c4a-bfb9-44823881bdba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.152888 Aug 31 00:26:05.573368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 340/641] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:06.205764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:06.206363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:06.212820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:06.213295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:06.213725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:06.214403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:06.214846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:06.215284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:06.246032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:06.246432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:06.246858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:06.247316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:06.290883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:06.298499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4f8a67f1-e1dc-47fc-ad45-9b9f0d3b1e27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.097037 Aug 31 00:26:06.299081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 302/642] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:06 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:06.597791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:06.598400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:06.605191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:06.605673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:06.606103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:06.606778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:06.607260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:06.607682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:06.737978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:06.746588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:06.748050 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:06.749200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-879e1942-c12d-4818-8f65-f4b487dfd558 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.155305 Aug 31 00:26:06.749754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 341/643] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:07.321479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:07.322022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:07.328494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:07.329071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:07.329500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.330187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:07.330661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:07.331112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.361539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:07.362013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:07.362444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.362885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:07.403775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:07.411720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-06d891c9-9b45-4538-847a-ad1c88ea2127 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.095095 Aug 31 00:26:07.412281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 303/644] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:07 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:07.772658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:07.773884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:07.780058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:07.780531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:07.780963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.781634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:07.782080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:07.782496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.913060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:07.922127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:07.923581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:07.924727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8772a242-2d9c-40ef-aa6b-2144c78ecc94 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.156102 Aug 31 00:26:07.925311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 342/645] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:08.432740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:08.433280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:08.439702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.440178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.440630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:08.441302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.441763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.442161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:08.474454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.474928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.475391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:08.475827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:08.515875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:08.524461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-48efd809-9538-43b4-bcf4-0d1efdb49965 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.095396 Aug 31 00:26:08.525018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 304/646] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:08 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:08.952273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:08.955437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:08.962050 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.962534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.962972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:08.963693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.964144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.964558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.096579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:09.105369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:09.106792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:09.108054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4e26a123-8c1d-4ed6-9c96-c2a146108556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.161842 Aug 31 00:26:09.108608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 343/647] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:09.545336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:09.545939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:09.552361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.552838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.553268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.554289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.556042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.556384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.587055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.587520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.587946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.588379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:09.632586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:09.640350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7d33de7a-3d3c-4827-9eea-7d6374041129 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.098881 Aug 31 00:26:09.640922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 305/648] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:09 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:10.131847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:10.133348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:10.139463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.139960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.140379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.141058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.141510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.141933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.270219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:10.279129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:10.280552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:10.281702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cd32108c-66e1-405a-96df-9a10d840ab40 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.153835 Aug 31 00:26:10.282256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 344/649] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:10.662329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:10.662917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:10.670964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.671497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.671933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.672733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.673190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.673903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.711377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.712093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.712736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.713256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'fault' on Instance uuid 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:10.754103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:10.761282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-588ae036-73f9-4042-8cd6-3c4073539808 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 200 len: 1309 microversion: 2.1 time: 0.102835 Aug 31 00:26:10.761839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 306/650] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:10 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:11.304304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:11.305571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:11.314031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.314509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.314961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.315739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.316182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.316598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.452197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:11.460747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:11.462171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:11.463326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-974e281e-66a5-4a2a-9f6f-c21a6222f3cd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.162992 Aug 31 00:26:11.463877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 345/651] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:11.782769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:11.783374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 779ab581-0d74-4e77-846a-0ec6cb0dc5d6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:11.790514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.790996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.791451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.792129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.792575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.792991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.806367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] HTTP exception thrown: Instance 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 could not be found. Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Request method failure captured: Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 HTTP/1.1 Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqo0_3iVwfjjLYuwm66bn9iUjIPRZQjdAACsZuY6c8f-U7IwC-mp2VVMa8EsoaF2rmL34SF87V7NUN2GRNZlnkKcHrIPWz40tybjHMsI9s_Yjiqshls4RcEZWEMbCMil6stLTQenRorGhM9iftq6svlxUdWvamJ78eidStRmkko5WSg Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: e32cbe1a05ce414fb55f1de8bf71581c Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:26:11.808033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e32cbe1a05ce414fb55f1de8bf71581c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: e32cbe1a05ce414fb55f1de8bf71581c Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesSnapshotTestJSON-187862735-project Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: b03932102b7541f89a60a9c535a42e76 Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesSnapshotTestJSON-187862735-project Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 could not be found. Aug 31 00:26:11.809688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': '779ab581-0d74-4e77-846a-0ec6cb0dc5d6'} Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 could not be found. Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:11.810664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 could not be found. Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 could not be found. Aug 31 00:26:11.812291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:26:11.813639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Returning 404 to user: Instance 779ab581-0d74-4e77-846a-0ec6cb0dc5d6 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:11.813639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-77891a6a-dacb-4736-bc38-be706cad8f20 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6" status: 404 len: 111 microversion: 2.1 time: 0.030536 Aug 31 00:26:11.813639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 307/652] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:11 2022] GET /compute/v2.1/servers/779ab581-0d74-4e77-846a-0ec6cb0dc5d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:12.486639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:12.487259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:12.494158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:12.494642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:12.495098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:12.495812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:12.496263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:12.496687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:12.625406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:12.634705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:12.636192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:12.637354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e5934b06-c990-432c-866d-bddfc378a516 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.154745 Aug 31 00:26:12.637909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 346/653] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:13.660789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:13.661500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:13.668904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.669387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.669819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.670506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.670960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.671438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.815588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:13.824098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:13.825514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:13.826650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-001a94fd-f7a8-49af-bd9c-9a724e59be2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.169785 Aug 31 00:26:13.827224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 308/654] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:14.849672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:14.850309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:14.857247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:14.857728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:14.858159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:14.858842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:14.859326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:14.859755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:14.998582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:15.007243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:15.009129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:15.010282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2b74d354-cf1f-4c58-b669-c297a2eaf944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.164545 Aug 31 00:26:15.010832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 347/655] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:16.034011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:16.034618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:16.042024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:16.042508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:16.042943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:16.043662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:16.044117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:16.044540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:16.173379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:16.182536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:16.184033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:16.185332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cd3cb6fd-3e95-423c-86d3-b1aa431aeb22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.155143 Aug 31 00:26:16.185893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 309/656] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:17.208186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:17.208795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:17.215792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:17.216285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:17.216724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:17.217415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:17.217958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:17.218285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:17.359309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:17.365316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:17.366732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:17.369159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-65268425-849d-458d-8085-965eba008466 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.164639 Aug 31 00:26:17.370120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 348/657] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:18.395120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:18.395734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:18.402535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:18.403024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:18.403497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:18.404189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:18.404639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:18.405060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:18.551438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:18.560479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:18.561987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:18.563247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5890f3de-2215-49f2-99ef-6ca0645195f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.172033 Aug 31 00:26:18.563945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 310/658] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:19.585597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:19.586309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:19.592252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:19.592764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:19.593461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:19.594364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:19.594817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:19.595272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:19.736006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:19.745653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:19.747114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:19.748267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-be3b0035-25e4-46a0-bdbe-b2dd9684c7cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.166543 Aug 31 00:26:19.748817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 349/659] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:20.771229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:20.771864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:20.778425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:20.778904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:20.779375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:20.780067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:20.780521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:20.780940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:20.910643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:20.920057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:20.921500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:20.922650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3831977c-a2a0-473a-b483-6a72d2895673 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.155360 Aug 31 00:26:20.923236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 311/660] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:21.945467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:21.946092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:21.952933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:21.952933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:21.953524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:21.953849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:21.954291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:21.954702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:22.081805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:22.090831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:22.092398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:22.093576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d489cac5-a6f2-430f-b5d8-76093280fe38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.152015 Aug 31 00:26:22.094122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 350/661] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:23.117537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:23.118136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:23.125116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:23.125593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:23.126022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:23.126700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:23.127199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:23.127598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:23.262675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:23.271269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:23.272693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:23.273830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aa170582-4dbf-44a4-987a-d7f48d0b0ad9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.160345 Aug 31 00:26:23.274386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 312/662] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:23.792872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-330772576", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "networks": [{"uuid": "dfe32deb-d47f-4f3a-ae59-0ae1fd407876"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:23.845480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] validate_networks() for [('dfe32deb-d47f-4f3a-ae59-0ae1fd407876', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:26:24.236990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:26:24.237404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:26:24.237863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:26:24.238257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:26:24.238659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:26:24.247338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:24.247812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:24.248240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:24.248945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:24.249388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:24.249806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:24.266835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Getting quotas for project e32cbe1a05ce414fb55f1de8bf71581c. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:26:24.270974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Getting quotas for user b03932102b7541f89a60a9c535a42e76 and project e32cbe1a05ce414fb55f1de8bf71581c. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:26:24.282567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:26:24.284819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:26:24.299227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:24.301143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:24.309198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:24.309860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:24.310398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:24.311119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:24.311572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:24.311998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:24.333925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-04f1b7a9-6075-45e6-9704-a74338448a36 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545725 Aug 31 00:26:24.334799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 351/663] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:26:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:26:24.348626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2fc99eca-80e1-4f9e-a207-c731a05d4a39 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:24.349263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2fc99eca-80e1-4f9e-a207-c731a05d4a39 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:24.425096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2fc99eca-80e1-4f9e-a207-c731a05d4a39 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:24.434596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2fc99eca-80e1-4f9e-a207-c731a05d4a39 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1218 microversion: 2.1 time: 0.089957 Aug 31 00:26:24.435195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 352/664] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:24 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:24.489429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:24.498982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:24.500726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:24.502182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cbf38afb-ce57-4917-9b25-0afc50a0ed70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.208826 Aug 31 00:26:24.502737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 313/665] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:25.076298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-7360be3d-0eff-4526-95b1-e12cb0f018c5 req-888a7dbe-3185-44d5-81ed-2d67518ec92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e4497e-f74f-4b4e-aac6-88c39ead5f38", "name": "network-vif-plugged", "status": "completed", "tag": "8dddb3be-7ff7-4bfa-aebb-406f077a2133"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:25.086366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7360be3d-0eff-4526-95b1-e12cb0f018c5 req-888a7dbe-3185-44d5-81ed-2d67518ec92a service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:25.086849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7360be3d-0eff-4526-95b1-e12cb0f018c5 req-888a7dbe-3185-44d5-81ed-2d67518ec92a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:25.087341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7360be3d-0eff-4526-95b1-e12cb0f018c5 req-888a7dbe-3185-44d5-81ed-2d67518ec92a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:25.098605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-7360be3d-0eff-4526-95b1-e12cb0f018c5 req-888a7dbe-3185-44d5-81ed-2d67518ec92a service nova] Creating event network-vif-plugged:8dddb3be-7ff7-4bfa-aebb-406f077a2133 for instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 on hv-cinder-85506 Aug 31 00:26:25.104519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-7360be3d-0eff-4526-95b1-e12cb0f018c5 req-888a7dbe-3185-44d5-81ed-2d67518ec92a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099095 Aug 31 00:26:25.105108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 353/666] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:26:25.456176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-45f0b5e2-e51f-4ee1-8eb2-138c6431d5cd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:25.456753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-45f0b5e2-e51f-4ee1-8eb2-138c6431d5cd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:25.463804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f0b5e2-e51f-4ee1-8eb2-138c6431d5cd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:25.464278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f0b5e2-e51f-4ee1-8eb2-138c6431d5cd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:25.464700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f0b5e2-e51f-4ee1-8eb2-138c6431d5cd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:25.465373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f0b5e2-e51f-4ee1-8eb2-138c6431d5cd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:25.465819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f0b5e2-e51f-4ee1-8eb2-138c6431d5cd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:25.466233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f0b5e2-e51f-4ee1-8eb2-138c6431d5cd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:25.526910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:25.527580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-45f0b5e2-e51f-4ee1-8eb2-138c6431d5cd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:25.527778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:25.534037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:25.534590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:25.535123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:25.535244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-45f0b5e2-e51f-4ee1-8eb2-138c6431d5cd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1270 microversion: 2.1 time: 0.082788 Aug 31 00:26:25.535738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 314/667] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:25 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:25.536020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:25.536628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:25.537062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:25.673289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:25.682946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:25.684545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:25.685636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9b0bf92f-9594-470f-9301-457f31ed4587 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.164564 Aug 31 00:26:25.686182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 354/668] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:26.555906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f206ed66-d869-4691-a8d2-20c822a9bb6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:26.556600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f206ed66-d869-4691-a8d2-20c822a9bb6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:26.563096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f206ed66-d869-4691-a8d2-20c822a9bb6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:26.563583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f206ed66-d869-4691-a8d2-20c822a9bb6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:26.564006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f206ed66-d869-4691-a8d2-20c822a9bb6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:26.564686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f206ed66-d869-4691-a8d2-20c822a9bb6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:26.565136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f206ed66-d869-4691-a8d2-20c822a9bb6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:26.565555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f206ed66-d869-4691-a8d2-20c822a9bb6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:26.627432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f206ed66-d869-4691-a8d2-20c822a9bb6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:26.635616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f206ed66-d869-4691-a8d2-20c822a9bb6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1288 microversion: 2.1 time: 0.083601 Aug 31 00:26:26.636180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 315/669] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:26 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:26.709632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:26.710229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:26.716890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:26.717361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:26.717786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:26.718461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:26.718903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:26.719338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:26.736996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:26.849405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:26.858548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:26.860008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:26.861194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-368c28e7-2bb8-4ca0-92e1-9fbc0a8eae3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.155374 Aug 31 00:26:26.861741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 355/670] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:27.656718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9003d61e-2454-410a-98b5-ff225eb6c667 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:27.657322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9003d61e-2454-410a-98b5-ff225eb6c667 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:27.663668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9003d61e-2454-410a-98b5-ff225eb6c667 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:27.664151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9003d61e-2454-410a-98b5-ff225eb6c667 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:27.664582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9003d61e-2454-410a-98b5-ff225eb6c667 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:27.665370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9003d61e-2454-410a-98b5-ff225eb6c667 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:27.666331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9003d61e-2454-410a-98b5-ff225eb6c667 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:27.666749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9003d61e-2454-410a-98b5-ff225eb6c667 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:27.797362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9003d61e-2454-410a-98b5-ff225eb6c667 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:27.804885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9003d61e-2454-410a-98b5-ff225eb6c667 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1318 microversion: 2.1 time: 0.152100 Aug 31 00:26:27.805463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 316/671] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:27 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:27.884664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:27.885268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:27.891258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:27.891738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:27.892173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:27.892848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:27.893690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:27.893807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:28.024375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:28.033917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:28.035382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:28.036536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ba2059ac-742c-44ff-ab3c-b322719e1b0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.156228 Aug 31 00:26:28.037096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 356/672] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:28.740504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-f7e0c678-308d-48c6-a601-6bd3b7d40370 req-c6617b13-97bf-40f1-b185-c95fb7090f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503c21ab-7fcf-41a4-b1b6-58109d0217f3", "tag": "43e4584a-4643-4ff9-9dac-df3280e4a165"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:28.750415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f7e0c678-308d-48c6-a601-6bd3b7d40370 req-c6617b13-97bf-40f1-b185-c95fb7090f30 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:28.750883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f7e0c678-308d-48c6-a601-6bd3b7d40370 req-c6617b13-97bf-40f1-b185-c95fb7090f30 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:28.751333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f7e0c678-308d-48c6-a601-6bd3b7d40370 req-c6617b13-97bf-40f1-b185-c95fb7090f30 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:28.761933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-f7e0c678-308d-48c6-a601-6bd3b7d40370 req-c6617b13-97bf-40f1-b185-c95fb7090f30 service nova] Creating event network-changed:43e4584a-4643-4ff9-9dac-df3280e4a165 for instance 503c21ab-7fcf-41a4-b1b6-58109d0217f3 on hv-cinder-85506 Aug 31 00:26:28.766937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-f7e0c678-308d-48c6-a601-6bd3b7d40370 req-c6617b13-97bf-40f1-b185-c95fb7090f30 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093111 Aug 31 00:26:28.767559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 317/673] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:28.825715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-39620dda-97a9-44ec-85b9-90ec47d1dfab tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:28.826345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-39620dda-97a9-44ec-85b9-90ec47d1dfab tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:28.832216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39620dda-97a9-44ec-85b9-90ec47d1dfab tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:28.832693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39620dda-97a9-44ec-85b9-90ec47d1dfab tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:28.833119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39620dda-97a9-44ec-85b9-90ec47d1dfab tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:28.833792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39620dda-97a9-44ec-85b9-90ec47d1dfab tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:28.834236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39620dda-97a9-44ec-85b9-90ec47d1dfab tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:28.834654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39620dda-97a9-44ec-85b9-90ec47d1dfab tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:28.994931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-39620dda-97a9-44ec-85b9-90ec47d1dfab tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:29.003540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-39620dda-97a9-44ec-85b9-90ec47d1dfab tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1318 microversion: 2.1 time: 0.181618 Aug 31 00:26:29.004224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 357/674] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:28 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:29.060084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:29.060777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:29.068629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:29.068902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:29.069344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:29.070094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:29.070663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:29.071128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:29.076231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:29.210453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:29.221568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:29.223275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:29.224584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-be66f199-6594-40df-ac62-2ad8655de917 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1810 microversion: 2.20 time: 0.169206 Aug 31 00:26:29.225251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 318/675] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:30.025657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6a9a0e5e-dfb2-45cb-a689-e9270c785f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:30.026470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6a9a0e5e-dfb2-45cb-a689-e9270c785f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:30.032555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e5e-dfb2-45cb-a689-e9270c785f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:30.033033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e5e-dfb2-45cb-a689-e9270c785f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:30.033460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e5e-dfb2-45cb-a689-e9270c785f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:30.034144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e5e-dfb2-45cb-a689-e9270c785f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:30.034593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e5e-dfb2-45cb-a689-e9270c785f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:30.035014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a9a0e5e-dfb2-45cb-a689-e9270c785f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:30.163238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6a9a0e5e-dfb2-45cb-a689-e9270c785f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:30.171340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6a9a0e5e-dfb2-45cb-a689-e9270c785f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1318 microversion: 2.1 time: 0.150187 Aug 31 00:26:30.171910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 358/676] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:30 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:30.248731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:30.249330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:30.255867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:30.256342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:30.256772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:30.257454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:30.257900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:30.258316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:30.391594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:30.401020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:30.402491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:30.403740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-710ee4a6-1c5a-4dae-934b-dc4bd28d3ada tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1797 microversion: 2.20 time: 0.158993 Aug 31 00:26:30.404294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 319/677] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1797 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:31.192002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3a949615-7cc0-4ef5-b285-b06279f5e675 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:31.192609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3a949615-7cc0-4ef5-b285-b06279f5e675 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:31.194438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:31.200182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a949615-7cc0-4ef5-b285-b06279f5e675 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:31.200657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a949615-7cc0-4ef5-b285-b06279f5e675 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:31.201088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a949615-7cc0-4ef5-b285-b06279f5e675 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:31.201783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a949615-7cc0-4ef5-b285-b06279f5e675 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:31.202236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a949615-7cc0-4ef5-b285-b06279f5e675 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:31.202658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a949615-7cc0-4ef5-b285-b06279f5e675 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:31.333837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3a949615-7cc0-4ef5-b285-b06279f5e675 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:31.342150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3a949615-7cc0-4ef5-b285-b06279f5e675 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1318 microversion: 2.1 time: 0.154007 Aug 31 00:26:31.342708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 359/678] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:31 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:32.363521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9bd3de43-323b-4ee3-820f-89ecc605e40f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:32.364119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9bd3de43-323b-4ee3-820f-89ecc605e40f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:32.370533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bd3de43-323b-4ee3-820f-89ecc605e40f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:32.371000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bd3de43-323b-4ee3-820f-89ecc605e40f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:32.371482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bd3de43-323b-4ee3-820f-89ecc605e40f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:32.372167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bd3de43-323b-4ee3-820f-89ecc605e40f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:32.372611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bd3de43-323b-4ee3-820f-89ecc605e40f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:32.373021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bd3de43-323b-4ee3-820f-89ecc605e40f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:32.507868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9bd3de43-323b-4ee3-820f-89ecc605e40f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:32.516283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9bd3de43-323b-4ee3-820f-89ecc605e40f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1318 microversion: 2.1 time: 0.156552 Aug 31 00:26:32.516948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 320/679] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:32 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:33.539853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7f9c092e-954b-483f-a2c6-036845f39608 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:33.541989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7f9c092e-954b-483f-a2c6-036845f39608 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:33.548278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f9c092e-954b-483f-a2c6-036845f39608 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:33.548962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f9c092e-954b-483f-a2c6-036845f39608 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:33.549679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f9c092e-954b-483f-a2c6-036845f39608 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:33.550629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f9c092e-954b-483f-a2c6-036845f39608 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:33.551449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f9c092e-954b-483f-a2c6-036845f39608 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:33.552038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f9c092e-954b-483f-a2c6-036845f39608 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:33.709360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7f9c092e-954b-483f-a2c6-036845f39608 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:33.717984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7f9c092e-954b-483f-a2c6-036845f39608 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1318 microversion: 2.1 time: 0.182649 Aug 31 00:26:33.718568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 360/680] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:33 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:34.744719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f114c6cf-c0e3-4089-8577-a3ec01387119 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:34.745326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f114c6cf-c0e3-4089-8577-a3ec01387119 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:34.747823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=60 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:34.754367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f114c6cf-c0e3-4089-8577-a3ec01387119 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:34.754900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f114c6cf-c0e3-4089-8577-a3ec01387119 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:34.755387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f114c6cf-c0e3-4089-8577-a3ec01387119 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:34.756281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f114c6cf-c0e3-4089-8577-a3ec01387119 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:34.756949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f114c6cf-c0e3-4089-8577-a3ec01387119 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:34.757427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f114c6cf-c0e3-4089-8577-a3ec01387119 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:34.894153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f114c6cf-c0e3-4089-8577-a3ec01387119 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:34.903224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f114c6cf-c0e3-4089-8577-a3ec01387119 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1318 microversion: 2.1 time: 0.162405 Aug 31 00:26:34.903789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 321/681] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:34 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:35.171782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-54fa7ce2-ca2c-44b2-a420-6891749cf5eb req-86615bdf-9c22-4d10-a483-a7cfbde90702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503c21ab-7fcf-41a4-b1b6-58109d0217f3", "name": "network-vif-plugged", "status": "completed", "tag": "43e4584a-4643-4ff9-9dac-df3280e4a165"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:35.176732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.177530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=8 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.185412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-54fa7ce2-ca2c-44b2-a420-6891749cf5eb req-86615bdf-9c22-4d10-a483-a7cfbde90702 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.185886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-54fa7ce2-ca2c-44b2-a420-6891749cf5eb req-86615bdf-9c22-4d10-a483-a7cfbde90702 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.186306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-54fa7ce2-ca2c-44b2-a420-6891749cf5eb req-86615bdf-9c22-4d10-a483-a7cfbde90702 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.197635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-54fa7ce2-ca2c-44b2-a420-6891749cf5eb req-86615bdf-9c22-4d10-a483-a7cfbde90702 service nova] Creating event network-vif-plugged:43e4584a-4643-4ff9-9dac-df3280e4a165 for instance 503c21ab-7fcf-41a4-b1b6-58109d0217f3 on hv-cinder-85506 Aug 31 00:26:35.204014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-54fa7ce2-ca2c-44b2-a420-6891749cf5eb req-86615bdf-9c22-4d10-a483-a7cfbde90702 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036099 Aug 31 00:26:35.204656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 361/682] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:35.923934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-818f519b-9a80-4748-875d-b1d110168a1a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:35.924527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-818f519b-9a80-4748-875d-b1d110168a1a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:35.930921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-818f519b-9a80-4748-875d-b1d110168a1a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.931430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-818f519b-9a80-4748-875d-b1d110168a1a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.931855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-818f519b-9a80-4748-875d-b1d110168a1a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.932531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-818f519b-9a80-4748-875d-b1d110168a1a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.933553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-818f519b-9a80-4748-875d-b1d110168a1a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.933976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-818f519b-9a80-4748-875d-b1d110168a1a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:36.067995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-818f519b-9a80-4748-875d-b1d110168a1a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:36.077314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-818f519b-9a80-4748-875d-b1d110168a1a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1318 microversion: 2.1 time: 0.157116 Aug 31 00:26:36.078193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 322/683] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:35 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:37.098541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c9750a32-60e7-4f0d-a014-b768333532f3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:37.099275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c9750a32-60e7-4f0d-a014-b768333532f3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:37.106332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9750a32-60e7-4f0d-a014-b768333532f3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.106814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9750a32-60e7-4f0d-a014-b768333532f3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.107288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9750a32-60e7-4f0d-a014-b768333532f3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.107973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9750a32-60e7-4f0d-a014-b768333532f3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.108431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9750a32-60e7-4f0d-a014-b768333532f3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.108853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9750a32-60e7-4f0d-a014-b768333532f3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.239421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c9750a32-60e7-4f0d-a014-b768333532f3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:37.247950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c9750a32-60e7-4f0d-a014-b768333532f3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1318 microversion: 2.1 time: 0.153595 Aug 31 00:26:37.248513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 362/684] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:37 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:38.269795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fb6a3d56-23b6-4368-b31b-2766aeedcb96 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:38.270405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fb6a3d56-23b6-4368-b31b-2766aeedcb96 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:38.277118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb6a3d56-23b6-4368-b31b-2766aeedcb96 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:38.277589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb6a3d56-23b6-4368-b31b-2766aeedcb96 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:38.278016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb6a3d56-23b6-4368-b31b-2766aeedcb96 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:38.278695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb6a3d56-23b6-4368-b31b-2766aeedcb96 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:38.279168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb6a3d56-23b6-4368-b31b-2766aeedcb96 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:38.279571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb6a3d56-23b6-4368-b31b-2766aeedcb96 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:38.409706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fb6a3d56-23b6-4368-b31b-2766aeedcb96 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:38.417300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fb6a3d56-23b6-4368-b31b-2766aeedcb96 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1507 microversion: 2.1 time: 0.151522 Aug 31 00:26:38.418406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 323/685] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:38 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:38.438680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bd00c643-2f2c-4249-9d68-9c079e0b4657 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f55ad42f-ca35-4b42-a8bc-3410cddfde6f", "device": "/dev/sdb"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:38.441500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bd00c643-2f2c-4249-9d68-9c079e0b4657 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:38.447366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd00c643-2f2c-4249-9d68-9c079e0b4657 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:38.447843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd00c643-2f2c-4249-9d68-9c079e0b4657 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:38.448273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd00c643-2f2c-4249-9d68-9c079e0b4657 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:38.449599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd00c643-2f2c-4249-9d68-9c079e0b4657 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:38.450287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd00c643-2f2c-4249-9d68-9c079e0b4657 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:38.450709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd00c643-2f2c-4249-9d68-9c079e0b4657 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:38.825066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bd00c643-2f2c-4249-9d68-9c079e0b4657 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "POST /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389208 Aug 31 00:26:38.826185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 363/686] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 00:26:38 2022] POST /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:51.312125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=5 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:51.312870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=34 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:51.411414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c76436de-93af-4c46-8350-39d707bea30d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a816307-3a33-4d13-9fad-a03edaa2c34a"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:51.413820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c76436de-93af-4c46-8350-39d707bea30d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:51.419722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c76436de-93af-4c46-8350-39d707bea30d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:51.420200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c76436de-93af-4c46-8350-39d707bea30d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:51.420630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c76436de-93af-4c46-8350-39d707bea30d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:51.421308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c76436de-93af-4c46-8350-39d707bea30d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:51.421819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c76436de-93af-4c46-8350-39d707bea30d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:51.422243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c76436de-93af-4c46-8350-39d707bea30d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:52.550394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c76436de-93af-4c46-8350-39d707bea30d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.242890 Aug 31 00:26:52.551104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 324/687] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 00:26:51 2022] POST /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 194 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:36.798356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=9 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:36.799185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:36.803957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6b502fc1-247a-4526-9894-41aabc3dae0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:36.804533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6b502fc1-247a-4526-9894-41aabc3dae0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:36.811935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b502fc1-247a-4526-9894-41aabc3dae0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:36.812404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b502fc1-247a-4526-9894-41aabc3dae0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:36.812827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b502fc1-247a-4526-9894-41aabc3dae0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:36.813499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b502fc1-247a-4526-9894-41aabc3dae0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:36.813938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b502fc1-247a-4526-9894-41aabc3dae0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:36.814348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b502fc1-247a-4526-9894-41aabc3dae0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:36.939949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-6b502fc1-247a-4526-9894-41aabc3dae0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lazy-loading 'services' on Instance uuid e7854a5f-0fae-40f3-a7d2-a2bdb829e851 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:27:37.057413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6b502fc1-247a-4526-9894-41aabc3dae0b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments/1a11198d-7e6d-4373-b4d0-47dc530dc59c" status: 202 len: 0 microversion: 2.1 time: 0.259791 Aug 31 00:27:37.057947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 364/688] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:27:36 2022] DELETE /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments/1a11198d-7e6d-4373-b4d0-47dc530dc59c => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:27:37.929753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:37.930544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:37.931658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:27:37.931854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:27:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 (ip 10.222.0.67) !!! Aug 31 00:27:37.936673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fc880df4-dc89-4a86-8ef5-17008ffd1b7e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:37.937250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fc880df4-dc89-4a86-8ef5-17008ffd1b7e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:37.945944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc880df4-dc89-4a86-8ef5-17008ffd1b7e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.946423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc880df4-dc89-4a86-8ef5-17008ffd1b7e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.946851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc880df4-dc89-4a86-8ef5-17008ffd1b7e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.947572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc880df4-dc89-4a86-8ef5-17008ffd1b7e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.948128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc880df4-dc89-4a86-8ef5-17008ffd1b7e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.948546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc880df4-dc89-4a86-8ef5-17008ffd1b7e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.975925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fc880df4-dc89-4a86-8ef5-17008ffd1b7e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:27:38.053702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fc880df4-dc89-4a86-8ef5-17008ffd1b7e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 204 len: 0 microversion: 2.1 time: 0.124907 Aug 31 00:27:38.054367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 325/689] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:27:37 2022] DELETE /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:27:38.063478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a9042799-9dcb-4879-9be1-5e8b67ec9c61 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:38.064175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a9042799-9dcb-4879-9be1-5e8b67ec9c61 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:38.070178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9042799-9dcb-4879-9be1-5e8b67ec9c61 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:38.070660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9042799-9dcb-4879-9be1-5e8b67ec9c61 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:38.071120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9042799-9dcb-4879-9be1-5e8b67ec9c61 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:38.071837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9042799-9dcb-4879-9be1-5e8b67ec9c61 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:38.072293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9042799-9dcb-4879-9be1-5e8b67ec9c61 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:38.073413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9042799-9dcb-4879-9be1-5e8b67ec9c61 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:38.207311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a9042799-9dcb-4879-9be1-5e8b67ec9c61 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:38.216090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a9042799-9dcb-4879-9be1-5e8b67ec9c61 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.157108 Aug 31 00:27:38.217043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 365/690] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:38 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:39.238269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f3c52b6c-81a1-44b1-8ff0-c4d1de24f255 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:39.238992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f3c52b6c-81a1-44b1-8ff0-c4d1de24f255 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:39.245418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c52b6c-81a1-44b1-8ff0-c4d1de24f255 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.246565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c52b6c-81a1-44b1-8ff0-c4d1de24f255 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.246995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c52b6c-81a1-44b1-8ff0-c4d1de24f255 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.247698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c52b6c-81a1-44b1-8ff0-c4d1de24f255 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.248146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c52b6c-81a1-44b1-8ff0-c4d1de24f255 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.248563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c52b6c-81a1-44b1-8ff0-c4d1de24f255 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.382728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f3c52b6c-81a1-44b1-8ff0-c4d1de24f255 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:39.390614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f3c52b6c-81a1-44b1-8ff0-c4d1de24f255 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.156574 Aug 31 00:27:39.391214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 326/691] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:39 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:40.412021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b44603df-2c12-47a3-985c-1ad61d1f13d1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:40.412584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b44603df-2c12-47a3-985c-1ad61d1f13d1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:40.418472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b44603df-2c12-47a3-985c-1ad61d1f13d1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:40.418968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b44603df-2c12-47a3-985c-1ad61d1f13d1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:40.419422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b44603df-2c12-47a3-985c-1ad61d1f13d1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:40.420098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b44603df-2c12-47a3-985c-1ad61d1f13d1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:40.420534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b44603df-2c12-47a3-985c-1ad61d1f13d1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:40.420947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b44603df-2c12-47a3-985c-1ad61d1f13d1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:40.549243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b44603df-2c12-47a3-985c-1ad61d1f13d1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:40.556867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b44603df-2c12-47a3-985c-1ad61d1f13d1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.148927 Aug 31 00:27:40.557431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 366/692] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:40 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:41.579191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f10c2255-d0b7-45ec-9b8e-2f5e9b2ffaab tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:41.579801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f10c2255-d0b7-45ec-9b8e-2f5e9b2ffaab tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:41.586145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f10c2255-d0b7-45ec-9b8e-2f5e9b2ffaab tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:41.586622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f10c2255-d0b7-45ec-9b8e-2f5e9b2ffaab tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:41.587075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f10c2255-d0b7-45ec-9b8e-2f5e9b2ffaab tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:41.587755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f10c2255-d0b7-45ec-9b8e-2f5e9b2ffaab tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:41.588237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f10c2255-d0b7-45ec-9b8e-2f5e9b2ffaab tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:41.588681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f10c2255-d0b7-45ec-9b8e-2f5e9b2ffaab tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:41.717796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f10c2255-d0b7-45ec-9b8e-2f5e9b2ffaab tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:41.725527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f10c2255-d0b7-45ec-9b8e-2f5e9b2ffaab tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.150812 Aug 31 00:27:41.726092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 327/693] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:41 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:42.746492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6bc35e02-9ecf-4c31-a035-b74cda0713ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:42.747169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6bc35e02-9ecf-4c31-a035-b74cda0713ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:42.753869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bc35e02-9ecf-4c31-a035-b74cda0713ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:42.754345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bc35e02-9ecf-4c31-a035-b74cda0713ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:42.754775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bc35e02-9ecf-4c31-a035-b74cda0713ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:42.755488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bc35e02-9ecf-4c31-a035-b74cda0713ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:42.755934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bc35e02-9ecf-4c31-a035-b74cda0713ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:42.756352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bc35e02-9ecf-4c31-a035-b74cda0713ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:42.888806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6bc35e02-9ecf-4c31-a035-b74cda0713ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:42.896824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6bc35e02-9ecf-4c31-a035-b74cda0713ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.154193 Aug 31 00:27:42.897375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 367/694] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:42 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:43.919543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5b6ef093-3c5b-4bbe-9e45-f28ab463b7bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:43.920149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5b6ef093-3c5b-4bbe-9e45-f28ab463b7bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:43.926614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b6ef093-3c5b-4bbe-9e45-f28ab463b7bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:43.927125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b6ef093-3c5b-4bbe-9e45-f28ab463b7bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:43.927558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b6ef093-3c5b-4bbe-9e45-f28ab463b7bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:43.928246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b6ef093-3c5b-4bbe-9e45-f28ab463b7bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:43.928699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b6ef093-3c5b-4bbe-9e45-f28ab463b7bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:43.929117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b6ef093-3c5b-4bbe-9e45-f28ab463b7bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:44.062083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5b6ef093-3c5b-4bbe-9e45-f28ab463b7bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:44.069693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5b6ef093-3c5b-4bbe-9e45-f28ab463b7bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.154527 Aug 31 00:27:44.070251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 328/695] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:43 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:45.089706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9c3ed3a4-2d61-47e3-aa3a-b881d8dc9c78 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:45.090235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9c3ed3a4-2d61-47e3-aa3a-b881d8dc9c78 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:45.097129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3ed3a4-2d61-47e3-aa3a-b881d8dc9c78 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:45.097602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3ed3a4-2d61-47e3-aa3a-b881d8dc9c78 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:45.098023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3ed3a4-2d61-47e3-aa3a-b881d8dc9c78 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:45.098695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3ed3a4-2d61-47e3-aa3a-b881d8dc9c78 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:45.099162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3ed3a4-2d61-47e3-aa3a-b881d8dc9c78 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:45.099578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3ed3a4-2d61-47e3-aa3a-b881d8dc9c78 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:45.233025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9c3ed3a4-2d61-47e3-aa3a-b881d8dc9c78 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:45.241240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9c3ed3a4-2d61-47e3-aa3a-b881d8dc9c78 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.155427 Aug 31 00:27:45.241800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 368/696] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:45 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:46.263061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cebde012-3a97-41b9-be9c-fc7ba51dcdba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:46.263785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cebde012-3a97-41b9-be9c-fc7ba51dcdba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:46.270274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cebde012-3a97-41b9-be9c-fc7ba51dcdba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:46.270757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cebde012-3a97-41b9-be9c-fc7ba51dcdba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:46.271220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cebde012-3a97-41b9-be9c-fc7ba51dcdba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:46.271909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cebde012-3a97-41b9-be9c-fc7ba51dcdba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:46.272362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cebde012-3a97-41b9-be9c-fc7ba51dcdba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:46.272782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cebde012-3a97-41b9-be9c-fc7ba51dcdba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:46.408209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cebde012-3a97-41b9-be9c-fc7ba51dcdba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:46.416005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cebde012-3a97-41b9-be9c-fc7ba51dcdba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.156993 Aug 31 00:27:46.416570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 329/697] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:46 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:47.438649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0cbd37ea-9276-4648-b761-bcfb70a89a09 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:47.439311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0cbd37ea-9276-4648-b761-bcfb70a89a09 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:47.445811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cbd37ea-9276-4648-b761-bcfb70a89a09 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:47.446292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cbd37ea-9276-4648-b761-bcfb70a89a09 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:47.446752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cbd37ea-9276-4648-b761-bcfb70a89a09 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:47.447471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cbd37ea-9276-4648-b761-bcfb70a89a09 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:47.447919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cbd37ea-9276-4648-b761-bcfb70a89a09 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:47.448337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cbd37ea-9276-4648-b761-bcfb70a89a09 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:47.578567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0cbd37ea-9276-4648-b761-bcfb70a89a09 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:47.586511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0cbd37ea-9276-4648-b761-bcfb70a89a09 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.152925 Aug 31 00:27:47.587113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 369/698] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:47 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:48.608422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-32ef2338-d3ec-4b40-ae7f-04f350188e8b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:48.609021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-32ef2338-d3ec-4b40-ae7f-04f350188e8b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:48.615681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32ef2338-d3ec-4b40-ae7f-04f350188e8b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:48.616157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32ef2338-d3ec-4b40-ae7f-04f350188e8b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:48.616578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32ef2338-d3ec-4b40-ae7f-04f350188e8b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:48.617259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32ef2338-d3ec-4b40-ae7f-04f350188e8b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:48.617703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32ef2338-d3ec-4b40-ae7f-04f350188e8b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:48.618113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32ef2338-d3ec-4b40-ae7f-04f350188e8b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:48.751959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-32ef2338-d3ec-4b40-ae7f-04f350188e8b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:48.759814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-32ef2338-d3ec-4b40-ae7f-04f350188e8b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.156114 Aug 31 00:27:48.760376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 330/699] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:48 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:49.784593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4a469885-fa1d-423d-b3e5-4288b25f1659 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:49.785175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4a469885-fa1d-423d-b3e5-4288b25f1659 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:49.791767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a469885-fa1d-423d-b3e5-4288b25f1659 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:49.792243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a469885-fa1d-423d-b3e5-4288b25f1659 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:49.792666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a469885-fa1d-423d-b3e5-4288b25f1659 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:49.793332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a469885-fa1d-423d-b3e5-4288b25f1659 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:49.793773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a469885-fa1d-423d-b3e5-4288b25f1659 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:49.794213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a469885-fa1d-423d-b3e5-4288b25f1659 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:49.925152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4a469885-fa1d-423d-b3e5-4288b25f1659 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:49.932785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4a469885-fa1d-423d-b3e5-4288b25f1659 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.151887 Aug 31 00:27:49.933283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 370/700] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:49 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:50.953894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4fc504b-0d15-461a-ad4b-f1e4e2bfc713 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:50.954495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4fc504b-0d15-461a-ad4b-f1e4e2bfc713 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:50.960704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fc504b-0d15-461a-ad4b-f1e4e2bfc713 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:50.961121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fc504b-0d15-461a-ad4b-f1e4e2bfc713 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:50.961549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fc504b-0d15-461a-ad4b-f1e4e2bfc713 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:50.962229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fc504b-0d15-461a-ad4b-f1e4e2bfc713 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:50.962676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fc504b-0d15-461a-ad4b-f1e4e2bfc713 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:50.963115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fc504b-0d15-461a-ad4b-f1e4e2bfc713 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:51.330635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f4fc504b-0d15-461a-ad4b-f1e4e2bfc713 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:51.346291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4fc504b-0d15-461a-ad4b-f1e4e2bfc713 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.396307 Aug 31 00:27:51.346870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 331/701] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:50 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:52.368182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-797a7a80-1e45-438d-87ad-d4f03c03c629 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:52.368790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-797a7a80-1e45-438d-87ad-d4f03c03c629 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:52.376216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-797a7a80-1e45-438d-87ad-d4f03c03c629 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:52.376701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-797a7a80-1e45-438d-87ad-d4f03c03c629 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:52.377135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-797a7a80-1e45-438d-87ad-d4f03c03c629 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:52.377821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-797a7a80-1e45-438d-87ad-d4f03c03c629 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:52.378274 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-797a7a80-1e45-438d-87ad-d4f03c03c629 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:52.378727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-797a7a80-1e45-438d-87ad-d4f03c03c629 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:52.510081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-797a7a80-1e45-438d-87ad-d4f03c03c629 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:52.518789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-797a7a80-1e45-438d-87ad-d4f03c03c629 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.154421 Aug 31 00:27:52.519382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 371/702] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:52 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:53.540555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-55b88647-c2b1-489c-aad2-0be2b155484c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:53.541234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-55b88647-c2b1-489c-aad2-0be2b155484c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:53.547729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b88647-c2b1-489c-aad2-0be2b155484c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:53.548211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b88647-c2b1-489c-aad2-0be2b155484c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:53.548640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b88647-c2b1-489c-aad2-0be2b155484c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:53.549325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b88647-c2b1-489c-aad2-0be2b155484c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:53.549959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b88647-c2b1-489c-aad2-0be2b155484c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:53.550381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b88647-c2b1-489c-aad2-0be2b155484c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:53.684503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-55b88647-c2b1-489c-aad2-0be2b155484c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:53.692481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-55b88647-c2b1-489c-aad2-0be2b155484c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.155792 Aug 31 00:27:53.693059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 332/703] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:53 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:54.715465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a9cc572a-3867-4c78-a116-f20483a522bd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:54.716072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a9cc572a-3867-4c78-a116-f20483a522bd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:54.724382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9cc572a-3867-4c78-a116-f20483a522bd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:54.724382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9cc572a-3867-4c78-a116-f20483a522bd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:54.724799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9cc572a-3867-4c78-a116-f20483a522bd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:54.725499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9cc572a-3867-4c78-a116-f20483a522bd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:54.725944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9cc572a-3867-4c78-a116-f20483a522bd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:54.726362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9cc572a-3867-4c78-a116-f20483a522bd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:54.854897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a9cc572a-3867-4c78-a116-f20483a522bd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:54.862829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a9cc572a-3867-4c78-a116-f20483a522bd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.151226 Aug 31 00:27:54.863424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 372/704] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:54 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:55.885046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-49ad6429-a33e-4506-b179-4e26c28c5575 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:55.885600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-49ad6429-a33e-4506-b179-4e26c28c5575 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:55.892670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49ad6429-a33e-4506-b179-4e26c28c5575 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:55.893167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49ad6429-a33e-4506-b179-4e26c28c5575 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:55.893623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49ad6429-a33e-4506-b179-4e26c28c5575 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:55.894375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49ad6429-a33e-4506-b179-4e26c28c5575 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:55.894819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49ad6429-a33e-4506-b179-4e26c28c5575 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:55.895261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49ad6429-a33e-4506-b179-4e26c28c5575 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:56.031679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-49ad6429-a33e-4506-b179-4e26c28c5575 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:56.039730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-49ad6429-a33e-4506-b179-4e26c28c5575 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.158579 Aug 31 00:27:56.040308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 333/705] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:55 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:57.061201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-aa635870-850c-4a14-9a90-cd438af0ef97 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:57.061997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-aa635870-850c-4a14-9a90-cd438af0ef97 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:57.069588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa635870-850c-4a14-9a90-cd438af0ef97 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.070088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa635870-850c-4a14-9a90-cd438af0ef97 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.070530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa635870-850c-4a14-9a90-cd438af0ef97 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.071264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa635870-850c-4a14-9a90-cd438af0ef97 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.071721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa635870-850c-4a14-9a90-cd438af0ef97 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.072150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa635870-850c-4a14-9a90-cd438af0ef97 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.229342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-da47582f-b930-4eab-a9f8-49e98a575e5e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:57.234204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-da47582f-b930-4eab-a9f8-49e98a575e5e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:57.241088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da47582f-b930-4eab-a9f8-49e98a575e5e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.242402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da47582f-b930-4eab-a9f8-49e98a575e5e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.243107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da47582f-b930-4eab-a9f8-49e98a575e5e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.244034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da47582f-b930-4eab-a9f8-49e98a575e5e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.244695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da47582f-b930-4eab-a9f8-49e98a575e5e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.245426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da47582f-b930-4eab-a9f8-49e98a575e5e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.275373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-da47582f-b930-4eab-a9f8-49e98a575e5e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'flavor' on Instance uuid 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:27:57.337638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-aa635870-850c-4a14-9a90-cd438af0ef97 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:57.347323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-aa635870-850c-4a14-9a90-cd438af0ef97 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1578 microversion: 2.1 time: 0.290574 Aug 31 00:27:57.349945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 373/706] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:57 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1578 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:57.438022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-da47582f-b930-4eab-a9f8-49e98a575e5e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/action" status: 200 len: 32 microversion: 2.1 time: 0.212535 Aug 31 00:27:57.438933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 334/707] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 00:27:57 2022] POST /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 00:27:57.448425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9736774e-e02f-458f-ba77-c75e89660afd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:57.449564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9736774e-e02f-458f-ba77-c75e89660afd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:57.456024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9736774e-e02f-458f-ba77-c75e89660afd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.456714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9736774e-e02f-458f-ba77-c75e89660afd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.457395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9736774e-e02f-458f-ba77-c75e89660afd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.458316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9736774e-e02f-458f-ba77-c75e89660afd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.459019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9736774e-e02f-458f-ba77-c75e89660afd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.459817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9736774e-e02f-458f-ba77-c75e89660afd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.775543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9736774e-e02f-458f-ba77-c75e89660afd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:57.789100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9736774e-e02f-458f-ba77-c75e89660afd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.344291 Aug 31 00:27:57.790272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 374/708] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:58.330831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-b4159ae9-126a-4099-aca2-f11cf3ac1d51 req-65bba9d9-23db-4f8a-857c-0714d114ba4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488", "name": "network-vif-deleted", "tag": "3d5b3ea9-0a47-4e55-8a51-95bf0b3d559c"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:58.341125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-b4159ae9-126a-4099-aca2-f11cf3ac1d51 req-65bba9d9-23db-4f8a-857c-0714d114ba4a service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.341837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-b4159ae9-126a-4099-aca2-f11cf3ac1d51 req-65bba9d9-23db-4f8a-857c-0714d114ba4a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.342461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-b4159ae9-126a-4099-aca2-f11cf3ac1d51 req-65bba9d9-23db-4f8a-857c-0714d114ba4a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.356844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-b4159ae9-126a-4099-aca2-f11cf3ac1d51 req-65bba9d9-23db-4f8a-857c-0714d114ba4a service nova] Creating event network-vif-deleted:3d5b3ea9-0a47-4e55-8a51-95bf0b3d559c for instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 on hv-cinder-85506 Aug 31 00:27:58.368663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-b4159ae9-126a-4099-aca2-f11cf3ac1d51 req-65bba9d9-23db-4f8a-857c-0714d114ba4a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041650 Aug 31 00:27:58.369512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 335/709] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:58.376122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1700dc68-7b27-4dac-bf81-17040c768a70 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:58.376741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1700dc68-7b27-4dac-bf81-17040c768a70 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:58.383641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1700dc68-7b27-4dac-bf81-17040c768a70 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.384379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1700dc68-7b27-4dac-bf81-17040c768a70 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.385155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1700dc68-7b27-4dac-bf81-17040c768a70 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.386038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1700dc68-7b27-4dac-bf81-17040c768a70 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.386661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1700dc68-7b27-4dac-bf81-17040c768a70 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.387279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1700dc68-7b27-4dac-bf81-17040c768a70 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.461378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1700dc68-7b27-4dac-bf81-17040c768a70 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:58.472787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1700dc68-7b27-4dac-bf81-17040c768a70 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1510 microversion: 2.1 time: 0.105087 Aug 31 00:27:58.473645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 375/710] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:58 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1510 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:58.813700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0cf0dc16-3b6f-4ec9-bff0-6aca44afb6d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:58.814416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0cf0dc16-3b6f-4ec9-bff0-6aca44afb6d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:58.821493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cf0dc16-3b6f-4ec9-bff0-6aca44afb6d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.822287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cf0dc16-3b6f-4ec9-bff0-6aca44afb6d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.822899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cf0dc16-3b6f-4ec9-bff0-6aca44afb6d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.823790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cf0dc16-3b6f-4ec9-bff0-6aca44afb6d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.825389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cf0dc16-3b6f-4ec9-bff0-6aca44afb6d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.826557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cf0dc16-3b6f-4ec9-bff0-6aca44afb6d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.984108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0cf0dc16-3b6f-4ec9-bff0-6aca44afb6d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:58.993242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0cf0dc16-3b6f-4ec9-bff0-6aca44afb6d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.184784 Aug 31 00:27:58.993826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 336/711] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:59.493897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f8a9b3a3-d8ee-403a-b854-0fca305c6000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:59.494619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f8a9b3a3-d8ee-403a-b854-0fca305c6000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:59.502067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8a9b3a3-d8ee-403a-b854-0fca305c6000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:59.502558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8a9b3a3-d8ee-403a-b854-0fca305c6000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:59.503212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8a9b3a3-d8ee-403a-b854-0fca305c6000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:59.504002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8a9b3a3-d8ee-403a-b854-0fca305c6000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:59.504542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8a9b3a3-d8ee-403a-b854-0fca305c6000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:59.504948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8a9b3a3-d8ee-403a-b854-0fca305c6000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:59.572978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f8a9b3a3-d8ee-403a-b854-0fca305c6000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:59.581988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f8a9b3a3-d8ee-403a-b854-0fca305c6000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.091915 Aug 31 00:27:59.582597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 376/712] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:59 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:00.016451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-232bd0f5-0858-4dd9-aee7-f1c61dd92b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:00.017073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-232bd0f5-0858-4dd9-aee7-f1c61dd92b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:00.023393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-232bd0f5-0858-4dd9-aee7-f1c61dd92b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:00.023863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-232bd0f5-0858-4dd9-aee7-f1c61dd92b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:00.024286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-232bd0f5-0858-4dd9-aee7-f1c61dd92b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:00.024958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-232bd0f5-0858-4dd9-aee7-f1c61dd92b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:00.025401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-232bd0f5-0858-4dd9-aee7-f1c61dd92b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:00.025815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-232bd0f5-0858-4dd9-aee7-f1c61dd92b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:00.162179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-232bd0f5-0858-4dd9-aee7-f1c61dd92b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:00.170545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-232bd0f5-0858-4dd9-aee7-f1c61dd92b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.158516 Aug 31 00:28:00.171147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 337/713] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:00.704509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e059ee24-40fa-4324-8e14-b5dc3f4ac80d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:00.705118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e059ee24-40fa-4324-8e14-b5dc3f4ac80d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:00.710891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e059ee24-40fa-4324-8e14-b5dc3f4ac80d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:00.711409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e059ee24-40fa-4324-8e14-b5dc3f4ac80d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:00.711831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e059ee24-40fa-4324-8e14-b5dc3f4ac80d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:00.712499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e059ee24-40fa-4324-8e14-b5dc3f4ac80d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:00.712939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e059ee24-40fa-4324-8e14-b5dc3f4ac80d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:00.713351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e059ee24-40fa-4324-8e14-b5dc3f4ac80d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:00.773786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e059ee24-40fa-4324-8e14-b5dc3f4ac80d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:00.782053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e059ee24-40fa-4324-8e14-b5dc3f4ac80d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.181374 Aug 31 00:28:00.782646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 377/714] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:00 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:01.191734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0e289175-a223-4919-a502-51e455adb7a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:01.192380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0e289175-a223-4919-a502-51e455adb7a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:01.198689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e289175-a223-4919-a502-51e455adb7a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:01.199211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e289175-a223-4919-a502-51e455adb7a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:01.199646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e289175-a223-4919-a502-51e455adb7a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:01.200335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e289175-a223-4919-a502-51e455adb7a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:01.200794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e289175-a223-4919-a502-51e455adb7a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:01.201397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e289175-a223-4919-a502-51e455adb7a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:01.220678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:01.332931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0e289175-a223-4919-a502-51e455adb7a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:01.341115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0e289175-a223-4919-a502-51e455adb7a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153217 Aug 31 00:28:01.342410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 338/715] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:01.803540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-40f61a72-cbfe-4bec-8a2f-31eba4dcf824 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:01.804149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-40f61a72-cbfe-4bec-8a2f-31eba4dcf824 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:01.810624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f61a72-cbfe-4bec-8a2f-31eba4dcf824 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:01.811648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f61a72-cbfe-4bec-8a2f-31eba4dcf824 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:01.812081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f61a72-cbfe-4bec-8a2f-31eba4dcf824 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:01.812764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f61a72-cbfe-4bec-8a2f-31eba4dcf824 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:01.813219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f61a72-cbfe-4bec-8a2f-31eba4dcf824 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:01.813636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f61a72-cbfe-4bec-8a2f-31eba4dcf824 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:01.877682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-40f61a72-cbfe-4bec-8a2f-31eba4dcf824 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:01.885401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-40f61a72-cbfe-4bec-8a2f-31eba4dcf824 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085712 Aug 31 00:28:01.885960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 378/716] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:01 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:02.364147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ab0d802b-abee-4ea0-a5ca-9063659d8075 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:02.364743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ab0d802b-abee-4ea0-a5ca-9063659d8075 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:02.371374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab0d802b-abee-4ea0-a5ca-9063659d8075 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:02.371852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab0d802b-abee-4ea0-a5ca-9063659d8075 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:02.372278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab0d802b-abee-4ea0-a5ca-9063659d8075 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:02.372956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab0d802b-abee-4ea0-a5ca-9063659d8075 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:02.374044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab0d802b-abee-4ea0-a5ca-9063659d8075 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:02.374469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ab0d802b-abee-4ea0-a5ca-9063659d8075 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:02.511508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ab0d802b-abee-4ea0-a5ca-9063659d8075 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:02.521174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ab0d802b-abee-4ea0-a5ca-9063659d8075 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.160846 Aug 31 00:28:02.521760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 339/717] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:02.906882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-afb81cc1-1790-4007-8606-2a566f21539a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:02.907510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-afb81cc1-1790-4007-8606-2a566f21539a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:02.914035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb81cc1-1790-4007-8606-2a566f21539a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:02.914545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb81cc1-1790-4007-8606-2a566f21539a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:02.915005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb81cc1-1790-4007-8606-2a566f21539a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:02.915710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb81cc1-1790-4007-8606-2a566f21539a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:02.916156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb81cc1-1790-4007-8606-2a566f21539a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:02.916603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb81cc1-1790-4007-8606-2a566f21539a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:02.977516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-afb81cc1-1790-4007-8606-2a566f21539a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:02.981040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:02.986212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-afb81cc1-1790-4007-8606-2a566f21539a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084327 Aug 31 00:28:02.986773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 379/718] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:02 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:03.544086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-905d5e82-43c8-4f9c-85e8-4db8f9cfbcbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:03.544691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-905d5e82-43c8-4f9c-85e8-4db8f9cfbcbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:03.551326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-905d5e82-43c8-4f9c-85e8-4db8f9cfbcbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:03.551804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-905d5e82-43c8-4f9c-85e8-4db8f9cfbcbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:03.552230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-905d5e82-43c8-4f9c-85e8-4db8f9cfbcbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:03.552906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-905d5e82-43c8-4f9c-85e8-4db8f9cfbcbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:03.553349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-905d5e82-43c8-4f9c-85e8-4db8f9cfbcbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:03.553761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-905d5e82-43c8-4f9c-85e8-4db8f9cfbcbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:03.689775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-905d5e82-43c8-4f9c-85e8-4db8f9cfbcbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:03.697835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-905d5e82-43c8-4f9c-85e8-4db8f9cfbcbb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.158758 Aug 31 00:28:03.698396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 340/719] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:04.007504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-578d0c31-3356-40e5-9b8e-abda33529877 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:04.008112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-578d0c31-3356-40e5-9b8e-abda33529877 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:04.014925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-578d0c31-3356-40e5-9b8e-abda33529877 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:04.015339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-578d0c31-3356-40e5-9b8e-abda33529877 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:04.015775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-578d0c31-3356-40e5-9b8e-abda33529877 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:04.016494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-578d0c31-3356-40e5-9b8e-abda33529877 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:04.016948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-578d0c31-3356-40e5-9b8e-abda33529877 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:04.017368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-578d0c31-3356-40e5-9b8e-abda33529877 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:04.078399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-578d0c31-3356-40e5-9b8e-abda33529877 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:04.086141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-578d0c31-3356-40e5-9b8e-abda33529877 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083383 Aug 31 00:28:04.086712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 380/720] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:04 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:04.719675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3e565ccf-95e1-4e76-8adb-3649eb1a7fab tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:04.720480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3e565ccf-95e1-4e76-8adb-3649eb1a7fab tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:04.727479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e565ccf-95e1-4e76-8adb-3649eb1a7fab tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:04.727963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e565ccf-95e1-4e76-8adb-3649eb1a7fab tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:04.728387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e565ccf-95e1-4e76-8adb-3649eb1a7fab tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:04.729269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e565ccf-95e1-4e76-8adb-3649eb1a7fab tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:04.729721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e565ccf-95e1-4e76-8adb-3649eb1a7fab tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:04.730137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e565ccf-95e1-4e76-8adb-3649eb1a7fab tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:04.881683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3e565ccf-95e1-4e76-8adb-3649eb1a7fab tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:04.891507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3e565ccf-95e1-4e76-8adb-3649eb1a7fab tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.175709 Aug 31 00:28:04.892089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 341/721] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:05.107419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-012502ca-b1e3-41d2-8216-9b1bb04f64c8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:05.108632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-012502ca-b1e3-41d2-8216-9b1bb04f64c8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:05.115321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-012502ca-b1e3-41d2-8216-9b1bb04f64c8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:05.115808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-012502ca-b1e3-41d2-8216-9b1bb04f64c8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:05.116267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-012502ca-b1e3-41d2-8216-9b1bb04f64c8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:05.116987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-012502ca-b1e3-41d2-8216-9b1bb04f64c8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:05.117438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-012502ca-b1e3-41d2-8216-9b1bb04f64c8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:05.117859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-012502ca-b1e3-41d2-8216-9b1bb04f64c8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:05.183529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-012502ca-b1e3-41d2-8216-9b1bb04f64c8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:05.191881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-012502ca-b1e3-41d2-8216-9b1bb04f64c8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.088282 Aug 31 00:28:05.192443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 381/722] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:05 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:05.914412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f80d1876-5dee-4d87-a6e9-f5901e19a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:05.914997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f80d1876-5dee-4d87-a6e9-f5901e19a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:05.921902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f80d1876-5dee-4d87-a6e9-f5901e19a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:05.922368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f80d1876-5dee-4d87-a6e9-f5901e19a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:05.922791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f80d1876-5dee-4d87-a6e9-f5901e19a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:05.923488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f80d1876-5dee-4d87-a6e9-f5901e19a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:05.923942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f80d1876-5dee-4d87-a6e9-f5901e19a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:05.924357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f80d1876-5dee-4d87-a6e9-f5901e19a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:06.054216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f80d1876-5dee-4d87-a6e9-f5901e19a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:06.064952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f80d1876-5dee-4d87-a6e9-f5901e19a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154300 Aug 31 00:28:06.065530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 342/723] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:06.212659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-321d6c6f-4774-405d-8645-bf63ff0dab0f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:06.213180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-321d6c6f-4774-405d-8645-bf63ff0dab0f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:06.220124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-321d6c6f-4774-405d-8645-bf63ff0dab0f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:06.220592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-321d6c6f-4774-405d-8645-bf63ff0dab0f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:06.221017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-321d6c6f-4774-405d-8645-bf63ff0dab0f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:06.221684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-321d6c6f-4774-405d-8645-bf63ff0dab0f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:06.222127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-321d6c6f-4774-405d-8645-bf63ff0dab0f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:06.222537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-321d6c6f-4774-405d-8645-bf63ff0dab0f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:06.283210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-321d6c6f-4774-405d-8645-bf63ff0dab0f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:06.290962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-321d6c6f-4774-405d-8645-bf63ff0dab0f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.082235 Aug 31 00:28:06.291555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 382/724] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:06 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:07.088946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7c5b22f3-e6dc-4356-8ec7-a558a494a5bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:07.089545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7c5b22f3-e6dc-4356-8ec7-a558a494a5bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:07.096469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5b22f3-e6dc-4356-8ec7-a558a494a5bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.096886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5b22f3-e6dc-4356-8ec7-a558a494a5bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.097314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5b22f3-e6dc-4356-8ec7-a558a494a5bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.098336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5b22f3-e6dc-4356-8ec7-a558a494a5bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.099103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5b22f3-e6dc-4356-8ec7-a558a494a5bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.099524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5b22f3-e6dc-4356-8ec7-a558a494a5bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.235861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7c5b22f3-e6dc-4356-8ec7-a558a494a5bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:07.244040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7c5b22f3-e6dc-4356-8ec7-a558a494a5bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.159213 Aug 31 00:28:07.244604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 343/725] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:07.313220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7514c46c-e7d8-4767-932f-90c7bd9db03b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:07.313832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7514c46c-e7d8-4767-932f-90c7bd9db03b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:07.316189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=39 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:07.321341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7514c46c-e7d8-4767-932f-90c7bd9db03b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.321855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7514c46c-e7d8-4767-932f-90c7bd9db03b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.322566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7514c46c-e7d8-4767-932f-90c7bd9db03b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.322967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7514c46c-e7d8-4767-932f-90c7bd9db03b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.323449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7514c46c-e7d8-4767-932f-90c7bd9db03b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.323870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7514c46c-e7d8-4767-932f-90c7bd9db03b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.384711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7514c46c-e7d8-4767-932f-90c7bd9db03b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:07.392916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7514c46c-e7d8-4767-932f-90c7bd9db03b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084372 Aug 31 00:28:07.393483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 383/726] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:07 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:08.267258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5136b264-6bc5-492e-9c5a-605dc4798087 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:08.267804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5136b264-6bc5-492e-9c5a-605dc4798087 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:08.270099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:08.275448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5136b264-6bc5-492e-9c5a-605dc4798087 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:08.275918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5136b264-6bc5-492e-9c5a-605dc4798087 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:08.276343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5136b264-6bc5-492e-9c5a-605dc4798087 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:08.277027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5136b264-6bc5-492e-9c5a-605dc4798087 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:08.277466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5136b264-6bc5-492e-9c5a-605dc4798087 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:08.277879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5136b264-6bc5-492e-9c5a-605dc4798087 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:08.408968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5136b264-6bc5-492e-9c5a-605dc4798087 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:08.413640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-52d572b6-c018-4af8-b998-ee8462d0d80e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:08.414336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-52d572b6-c018-4af8-b998-ee8462d0d80e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:08.417250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5136b264-6bc5-492e-9c5a-605dc4798087 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154567 Aug 31 00:28:08.417826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 344/727] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:08.421132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52d572b6-c018-4af8-b998-ee8462d0d80e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:08.421634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52d572b6-c018-4af8-b998-ee8462d0d80e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:08.422060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52d572b6-c018-4af8-b998-ee8462d0d80e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:08.422773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52d572b6-c018-4af8-b998-ee8462d0d80e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:08.423252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52d572b6-c018-4af8-b998-ee8462d0d80e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:08.423700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52d572b6-c018-4af8-b998-ee8462d0d80e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:08.487840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-52d572b6-c018-4af8-b998-ee8462d0d80e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:08.495890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-52d572b6-c018-4af8-b998-ee8462d0d80e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086085 Aug 31 00:28:08.496445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 384/728] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:08 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:09.438541 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-65ca97b0-8ee3-46b8-90d9-fd40f9a14bf0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:09.439557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-65ca97b0-8ee3-46b8-90d9-fd40f9a14bf0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:09.446337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65ca97b0-8ee3-46b8-90d9-fd40f9a14bf0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:09.446816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65ca97b0-8ee3-46b8-90d9-fd40f9a14bf0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:09.447291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65ca97b0-8ee3-46b8-90d9-fd40f9a14bf0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.447980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65ca97b0-8ee3-46b8-90d9-fd40f9a14bf0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:09.448430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65ca97b0-8ee3-46b8-90d9-fd40f9a14bf0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:09.448851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65ca97b0-8ee3-46b8-90d9-fd40f9a14bf0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.516902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-66ee85a9-93d9-4ff7-8f17-b47e89c1512b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:09.517633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-66ee85a9-93d9-4ff7-8f17-b47e89c1512b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:09.523682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66ee85a9-93d9-4ff7-8f17-b47e89c1512b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:09.524174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66ee85a9-93d9-4ff7-8f17-b47e89c1512b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:09.524609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66ee85a9-93d9-4ff7-8f17-b47e89c1512b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.525330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66ee85a9-93d9-4ff7-8f17-b47e89c1512b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:09.525870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66ee85a9-93d9-4ff7-8f17-b47e89c1512b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:09.526195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66ee85a9-93d9-4ff7-8f17-b47e89c1512b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.598508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-66ee85a9-93d9-4ff7-8f17-b47e89c1512b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:09.602982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-65ca97b0-8ee3-46b8-90d9-fd40f9a14bf0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:09.606237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-66ee85a9-93d9-4ff7-8f17-b47e89c1512b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.094087 Aug 31 00:28:09.606812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 385/729] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:09 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:09.611280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-65ca97b0-8ee3-46b8-90d9-fd40f9a14bf0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.176989 Aug 31 00:28:09.611937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 345/730] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:10.627863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cd9119e0-72f9-44be-aab3-30bb41fc68d7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:10.628464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cd9119e0-72f9-44be-aab3-30bb41fc68d7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:10.633143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5208a817-8b04-44f4-95ec-34ff9f19dcc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:10.633870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5208a817-8b04-44f4-95ec-34ff9f19dcc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:10.634929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd9119e0-72f9-44be-aab3-30bb41fc68d7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.635449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd9119e0-72f9-44be-aab3-30bb41fc68d7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.635884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd9119e0-72f9-44be-aab3-30bb41fc68d7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.636578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd9119e0-72f9-44be-aab3-30bb41fc68d7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.637030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd9119e0-72f9-44be-aab3-30bb41fc68d7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.637458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cd9119e0-72f9-44be-aab3-30bb41fc68d7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.640339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5208a817-8b04-44f4-95ec-34ff9f19dcc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.640820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5208a817-8b04-44f4-95ec-34ff9f19dcc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.641252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5208a817-8b04-44f4-95ec-34ff9f19dcc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.641936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5208a817-8b04-44f4-95ec-34ff9f19dcc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.642386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5208a817-8b04-44f4-95ec-34ff9f19dcc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.642805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5208a817-8b04-44f4-95ec-34ff9f19dcc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.725523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cd9119e0-72f9-44be-aab3-30bb41fc68d7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:10.733221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cd9119e0-72f9-44be-aab3-30bb41fc68d7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.109919 Aug 31 00:28:10.734927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 386/731] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:10 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:10.793103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5208a817-8b04-44f4-95ec-34ff9f19dcc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:10.801973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5208a817-8b04-44f4-95ec-34ff9f19dcc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.173426 Aug 31 00:28:10.802547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 346/732] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:11.754976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cacc8180-5afc-4592-b007-e20e9650765e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:11.755684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cacc8180-5afc-4592-b007-e20e9650765e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:11.762029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cacc8180-5afc-4592-b007-e20e9650765e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.762509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cacc8180-5afc-4592-b007-e20e9650765e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.762941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cacc8180-5afc-4592-b007-e20e9650765e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.763649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cacc8180-5afc-4592-b007-e20e9650765e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.764099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cacc8180-5afc-4592-b007-e20e9650765e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.764517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cacc8180-5afc-4592-b007-e20e9650765e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.822629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f3fa3cd0-fd16-4a8c-9c78-19323de632e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:11.823242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f3fa3cd0-fd16-4a8c-9c78-19323de632e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:11.826565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cacc8180-5afc-4592-b007-e20e9650765e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:11.833817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3fa3cd0-fd16-4a8c-9c78-19323de632e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.834309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3fa3cd0-fd16-4a8c-9c78-19323de632e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.834742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3fa3cd0-fd16-4a8c-9c78-19323de632e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.835489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3fa3cd0-fd16-4a8c-9c78-19323de632e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.835946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3fa3cd0-fd16-4a8c-9c78-19323de632e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.836365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3fa3cd0-fd16-4a8c-9c78-19323de632e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.838329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cacc8180-5afc-4592-b007-e20e9650765e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.087220 Aug 31 00:28:11.839024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 387/733] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:11 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:11.975139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f3fa3cd0-fd16-4a8c-9c78-19323de632e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:11.983997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f3fa3cd0-fd16-4a8c-9c78-19323de632e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.164688 Aug 31 00:28:11.984549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 347/734] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:12.859519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-41cdb69c-3cf2-438f-8270-761306c7efae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:12.860123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-41cdb69c-3cf2-438f-8270-761306c7efae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:12.866583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41cdb69c-3cf2-438f-8270-761306c7efae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:12.867085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41cdb69c-3cf2-438f-8270-761306c7efae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:12.867521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41cdb69c-3cf2-438f-8270-761306c7efae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:12.868202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41cdb69c-3cf2-438f-8270-761306c7efae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:12.868650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41cdb69c-3cf2-438f-8270-761306c7efae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:12.869070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41cdb69c-3cf2-438f-8270-761306c7efae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:12.932059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-41cdb69c-3cf2-438f-8270-761306c7efae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:12.940248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-41cdb69c-3cf2-438f-8270-761306c7efae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084687 Aug 31 00:28:12.940804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 388/735] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:12 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:13.005898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9f9f35dd-96cb-42dc-9829-ded72994d122 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:13.006504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9f9f35dd-96cb-42dc-9829-ded72994d122 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:13.012906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f9f35dd-96cb-42dc-9829-ded72994d122 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.013382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f9f35dd-96cb-42dc-9829-ded72994d122 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.013822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f9f35dd-96cb-42dc-9829-ded72994d122 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.014499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f9f35dd-96cb-42dc-9829-ded72994d122 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.015658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f9f35dd-96cb-42dc-9829-ded72994d122 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.016151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f9f35dd-96cb-42dc-9829-ded72994d122 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.031444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-112e91a5-d930-4f9a-a2b0-9a54eee3ead0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:13.031958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-112e91a5-d930-4f9a-a2b0-9a54eee3ead0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:13.037848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-112e91a5-d930-4f9a-a2b0-9a54eee3ead0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.038332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-112e91a5-d930-4f9a-a2b0-9a54eee3ead0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.038791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-112e91a5-d930-4f9a-a2b0-9a54eee3ead0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.039517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-112e91a5-d930-4f9a-a2b0-9a54eee3ead0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.039969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-112e91a5-d930-4f9a-a2b0-9a54eee3ead0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.040393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-112e91a5-d930-4f9a-a2b0-9a54eee3ead0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.071573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-112e91a5-d930-4f9a-a2b0-9a54eee3ead0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d" status: 200 len: 194 microversion: 2.20 time: 0.044563 Aug 31 00:28:13.072168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 389/736] 10.222.0.67 () {60 vars in 1454 bytes} [Wed Aug 31 00:28:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:28:13.151008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9f9f35dd-96cb-42dc-9829-ded72994d122 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:13.159483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9f9f35dd-96cb-42dc-9829-ded72994d122 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157809 Aug 31 00:28:13.160050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 348/737] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:13.966266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b7c6bf9e-c448-42a0-8205-cc78ca605a56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:13.966847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b7c6bf9e-c448-42a0-8205-cc78ca605a56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:13.973808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7c6bf9e-c448-42a0-8205-cc78ca605a56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.974284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7c6bf9e-c448-42a0-8205-cc78ca605a56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.974711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7c6bf9e-c448-42a0-8205-cc78ca605a56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.975428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7c6bf9e-c448-42a0-8205-cc78ca605a56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.975870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7c6bf9e-c448-42a0-8205-cc78ca605a56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.976281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7c6bf9e-c448-42a0-8205-cc78ca605a56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:14.038955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b7c6bf9e-c448-42a0-8205-cc78ca605a56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:14.048747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b7c6bf9e-c448-42a0-8205-cc78ca605a56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086267 Aug 31 00:28:14.049323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 390/738] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:13 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:14.180834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0c30f3be-fba0-4086-927c-7c2a852f71aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:14.181455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0c30f3be-fba0-4086-927c-7c2a852f71aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:14.187927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c30f3be-fba0-4086-927c-7c2a852f71aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:14.188406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c30f3be-fba0-4086-927c-7c2a852f71aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:14.188836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c30f3be-fba0-4086-927c-7c2a852f71aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:14.189518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c30f3be-fba0-4086-927c-7c2a852f71aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:14.190048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c30f3be-fba0-4086-927c-7c2a852f71aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:14.190379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c30f3be-fba0-4086-927c-7c2a852f71aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:14.323713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0c30f3be-fba0-4086-927c-7c2a852f71aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:14.332693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0c30f3be-fba0-4086-927c-7c2a852f71aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1715 microversion: 2.1 time: 0.155735 Aug 31 00:28:14.333267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 349/739] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:14.394753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:14.395280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:14.401856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:14.402334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:14.402774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:14.403492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:14.403938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:14.404356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.069419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-676ab0c9-2a38-4502-be9b-3b9c4803bd9e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:15.070028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-676ab0c9-2a38-4502-be9b-3b9c4803bd9e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:15.075982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-676ab0c9-2a38-4502-be9b-3b9c4803bd9e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:15.076466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-676ab0c9-2a38-4502-be9b-3b9c4803bd9e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:15.076899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-676ab0c9-2a38-4502-be9b-3b9c4803bd9e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.078327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-676ab0c9-2a38-4502-be9b-3b9c4803bd9e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:15.078885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-676ab0c9-2a38-4502-be9b-3b9c4803bd9e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:15.079347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-676ab0c9-2a38-4502-be9b-3b9c4803bd9e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.141034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-676ab0c9-2a38-4502-be9b-3b9c4803bd9e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:15.148760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-676ab0c9-2a38-4502-be9b-3b9c4803bd9e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083181 Aug 31 00:28:15.149336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 350/740] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:15 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:16.169766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-37553382-928f-4fb0-b243-53275fc280ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:16.170416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-37553382-928f-4fb0-b243-53275fc280ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:16.177606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37553382-928f-4fb0-b243-53275fc280ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.178117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37553382-928f-4fb0-b243-53275fc280ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.178550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37553382-928f-4fb0-b243-53275fc280ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.179277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37553382-928f-4fb0-b243-53275fc280ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.179723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37553382-928f-4fb0-b243-53275fc280ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.180140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37553382-928f-4fb0-b243-53275fc280ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.243974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37553382-928f-4fb0-b243-53275fc280ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:16.251764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-37553382-928f-4fb0-b243-53275fc280ea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085814 Aug 31 00:28:16.252264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 351/741] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:16 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:17.273227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7543bb5e-6d26-47bd-98af-519922872b3e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:17.273852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7543bb5e-6d26-47bd-98af-519922872b3e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:17.280208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7543bb5e-6d26-47bd-98af-519922872b3e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:17.281253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7543bb5e-6d26-47bd-98af-519922872b3e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:17.281790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7543bb5e-6d26-47bd-98af-519922872b3e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:17.282489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7543bb5e-6d26-47bd-98af-519922872b3e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:17.282944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7543bb5e-6d26-47bd-98af-519922872b3e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:17.283397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7543bb5e-6d26-47bd-98af-519922872b3e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:17.344633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7543bb5e-6d26-47bd-98af-519922872b3e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:17.352827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7543bb5e-6d26-47bd-98af-519922872b3e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083521 Aug 31 00:28:17.353400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 352/742] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:17 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:18.375016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5e407d33-a3c4-4bec-bd0a-af692f212864 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:18.375771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5e407d33-a3c4-4bec-bd0a-af692f212864 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:18.382108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e407d33-a3c4-4bec-bd0a-af692f212864 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:18.382585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e407d33-a3c4-4bec-bd0a-af692f212864 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:18.383053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e407d33-a3c4-4bec-bd0a-af692f212864 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:18.383733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e407d33-a3c4-4bec-bd0a-af692f212864 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:18.384178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e407d33-a3c4-4bec-bd0a-af692f212864 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:18.384587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e407d33-a3c4-4bec-bd0a-af692f212864 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:18.445739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5e407d33-a3c4-4bec-bd0a-af692f212864 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:18.456172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5e407d33-a3c4-4bec-bd0a-af692f212864 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085501 Aug 31 00:28:18.456766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 353/743] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:18 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:19.476548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a4503eb3-daa0-401d-a9fb-5125bada773f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:19.477199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a4503eb3-daa0-401d-a9fb-5125bada773f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:19.483569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4503eb3-daa0-401d-a9fb-5125bada773f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:19.484211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4503eb3-daa0-401d-a9fb-5125bada773f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:19.484639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4503eb3-daa0-401d-a9fb-5125bada773f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:19.485318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4503eb3-daa0-401d-a9fb-5125bada773f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:19.485762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4503eb3-daa0-401d-a9fb-5125bada773f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:19.486174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4503eb3-daa0-401d-a9fb-5125bada773f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:19.547289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4503eb3-daa0-401d-a9fb-5125bada773f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:19.554919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a4503eb3-daa0-401d-a9fb-5125bada773f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.082266 Aug 31 00:28:19.555499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 354/744] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:19 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:20.575670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2e5663cd-a47d-4b26-8375-828e1192e0de tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:20.576360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2e5663cd-a47d-4b26-8375-828e1192e0de tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:20.583008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e5663cd-a47d-4b26-8375-828e1192e0de tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.583513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e5663cd-a47d-4b26-8375-828e1192e0de tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.583941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e5663cd-a47d-4b26-8375-828e1192e0de tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.584619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e5663cd-a47d-4b26-8375-828e1192e0de tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.585071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e5663cd-a47d-4b26-8375-828e1192e0de tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.585484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e5663cd-a47d-4b26-8375-828e1192e0de tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.589365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:20.649168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2e5663cd-a47d-4b26-8375-828e1192e0de tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:20.657366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2e5663cd-a47d-4b26-8375-828e1192e0de tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085739 Aug 31 00:28:20.657941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 355/745] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:20 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:21.678199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5c4c07b8-37c8-4b04-96d5-5719d816923d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:21.679105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5c4c07b8-37c8-4b04-96d5-5719d816923d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:21.685232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c07b8-37c8-4b04-96d5-5719d816923d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:21.685694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c07b8-37c8-4b04-96d5-5719d816923d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:21.686117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c07b8-37c8-4b04-96d5-5719d816923d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:21.686789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c07b8-37c8-4b04-96d5-5719d816923d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:21.687511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c07b8-37c8-4b04-96d5-5719d816923d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:21.687924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c07b8-37c8-4b04-96d5-5719d816923d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:21.751967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5c4c07b8-37c8-4b04-96d5-5719d816923d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:21.759703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5c4c07b8-37c8-4b04-96d5-5719d816923d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085474 Aug 31 00:28:21.760246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 356/746] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:21 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:22.781406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-394a1e2a-c3b6-4041-980c-f9389bc911a1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:22.782370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-394a1e2a-c3b6-4041-980c-f9389bc911a1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:22.788871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-394a1e2a-c3b6-4041-980c-f9389bc911a1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:22.789342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-394a1e2a-c3b6-4041-980c-f9389bc911a1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:22.789766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-394a1e2a-c3b6-4041-980c-f9389bc911a1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:22.790442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-394a1e2a-c3b6-4041-980c-f9389bc911a1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:22.790884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-394a1e2a-c3b6-4041-980c-f9389bc911a1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:22.791331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-394a1e2a-c3b6-4041-980c-f9389bc911a1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:22.854200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-394a1e2a-c3b6-4041-980c-f9389bc911a1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:22.866347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-394a1e2a-c3b6-4041-980c-f9389bc911a1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.087644 Aug 31 00:28:22.866923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 357/747] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:22 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:23.889712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fdbd1e66-261f-4094-a7b2-076987949646 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:23.890463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fdbd1e66-261f-4094-a7b2-076987949646 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:23.897259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e66-261f-4094-a7b2-076987949646 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:23.897748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e66-261f-4094-a7b2-076987949646 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:23.898182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e66-261f-4094-a7b2-076987949646 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:23.898903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e66-261f-4094-a7b2-076987949646 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:23.899403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e66-261f-4094-a7b2-076987949646 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:23.899823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e66-261f-4094-a7b2-076987949646 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:23.969385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fdbd1e66-261f-4094-a7b2-076987949646 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:23.977127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fdbd1e66-261f-4094-a7b2-076987949646 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.091223 Aug 31 00:28:23.977687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 358/748] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:23 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:24.399269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=17 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:24.423597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=70 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:24.997743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-783f3ef2-a2e9-45ee-870c-e5dece22a41e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:24.998346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-783f3ef2-a2e9-45ee-870c-e5dece22a41e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:25.005140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-783f3ef2-a2e9-45ee-870c-e5dece22a41e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:25.005690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-783f3ef2-a2e9-45ee-870c-e5dece22a41e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:25.006154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-783f3ef2-a2e9-45ee-870c-e5dece22a41e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:25.006850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-783f3ef2-a2e9-45ee-870c-e5dece22a41e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:25.007333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-783f3ef2-a2e9-45ee-870c-e5dece22a41e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:25.007757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-783f3ef2-a2e9-45ee-870c-e5dece22a41e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:25.071139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-783f3ef2-a2e9-45ee-870c-e5dece22a41e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:25.078937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-783f3ef2-a2e9-45ee-870c-e5dece22a41e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085114 Aug 31 00:28:25.079579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 359/749] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:24 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:26.100283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2f1502b3-4a3e-4845-b38e-4f20cee8537a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:26.100924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2f1502b3-4a3e-4845-b38e-4f20cee8537a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:26.107328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1502b3-4a3e-4845-b38e-4f20cee8537a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:26.107812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1502b3-4a3e-4845-b38e-4f20cee8537a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:26.108246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1502b3-4a3e-4845-b38e-4f20cee8537a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:26.109439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1502b3-4a3e-4845-b38e-4f20cee8537a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:26.110010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1502b3-4a3e-4845-b38e-4f20cee8537a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:26.110435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1502b3-4a3e-4845-b38e-4f20cee8537a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:26.170804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2f1502b3-4a3e-4845-b38e-4f20cee8537a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:26.179199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2f1502b3-4a3e-4845-b38e-4f20cee8537a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.082819 Aug 31 00:28:26.179767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 360/750] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:26 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:27.200459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0d1ba6b-4e61-41b2-9103-3525ad889d3c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:27.201075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0d1ba6b-4e61-41b2-9103-3525ad889d3c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:27.207818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d1ba6b-4e61-41b2-9103-3525ad889d3c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:27.208304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d1ba6b-4e61-41b2-9103-3525ad889d3c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:27.208736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d1ba6b-4e61-41b2-9103-3525ad889d3c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:27.209423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d1ba6b-4e61-41b2-9103-3525ad889d3c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:27.209875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d1ba6b-4e61-41b2-9103-3525ad889d3c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:27.210295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d1ba6b-4e61-41b2-9103-3525ad889d3c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:27.271284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0d1ba6b-4e61-41b2-9103-3525ad889d3c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:27.278993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0d1ba6b-4e61-41b2-9103-3525ad889d3c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.082506 Aug 31 00:28:27.279583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 361/751] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:27 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:28.301760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-98fc09ca-5922-4ef3-8f44-644a3a34b557 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:28.302403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-98fc09ca-5922-4ef3-8f44-644a3a34b557 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:28.308663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98fc09ca-5922-4ef3-8f44-644a3a34b557 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.309140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98fc09ca-5922-4ef3-8f44-644a3a34b557 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.309565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98fc09ca-5922-4ef3-8f44-644a3a34b557 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.310245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98fc09ca-5922-4ef3-8f44-644a3a34b557 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.310695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98fc09ca-5922-4ef3-8f44-644a3a34b557 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.311134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98fc09ca-5922-4ef3-8f44-644a3a34b557 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.374547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-98fc09ca-5922-4ef3-8f44-644a3a34b557 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:28.383015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-98fc09ca-5922-4ef3-8f44-644a3a34b557 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085248 Aug 31 00:28:28.383596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 362/752] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:28 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:29.403620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2c21de1f-7a50-4fa6-b34e-7b7d9d0aa005 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:29.404290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2c21de1f-7a50-4fa6-b34e-7b7d9d0aa005 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:29.410961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c21de1f-7a50-4fa6-b34e-7b7d9d0aa005 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:29.411478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c21de1f-7a50-4fa6-b34e-7b7d9d0aa005 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:29.411911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c21de1f-7a50-4fa6-b34e-7b7d9d0aa005 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:29.412590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c21de1f-7a50-4fa6-b34e-7b7d9d0aa005 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:29.413037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c21de1f-7a50-4fa6-b34e-7b7d9d0aa005 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:29.413453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c21de1f-7a50-4fa6-b34e-7b7d9d0aa005 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:29.476054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2c21de1f-7a50-4fa6-b34e-7b7d9d0aa005 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:29.484133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2c21de1f-7a50-4fa6-b34e-7b7d9d0aa005 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084282 Aug 31 00:28:29.484962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 363/753] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:29 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:30.504926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-721d335d-2c65-4ddf-8987-73ea6a8d6249 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:30.505599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-721d335d-2c65-4ddf-8987-73ea6a8d6249 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:30.512037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-721d335d-2c65-4ddf-8987-73ea6a8d6249 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.512518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-721d335d-2c65-4ddf-8987-73ea6a8d6249 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.512950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-721d335d-2c65-4ddf-8987-73ea6a8d6249 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.513638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-721d335d-2c65-4ddf-8987-73ea6a8d6249 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.514089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-721d335d-2c65-4ddf-8987-73ea6a8d6249 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.514510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-721d335d-2c65-4ddf-8987-73ea6a8d6249 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.575198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-721d335d-2c65-4ddf-8987-73ea6a8d6249 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:30.583520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-721d335d-2c65-4ddf-8987-73ea6a8d6249 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.082682 Aug 31 00:28:30.584146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 364/754] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:30 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:31.606166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bc962fd1-92de-42a5-a4e1-f5d938c87ca5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:31.606799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bc962fd1-92de-42a5-a4e1-f5d938c87ca5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:31.613114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc962fd1-92de-42a5-a4e1-f5d938c87ca5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:31.613587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc962fd1-92de-42a5-a4e1-f5d938c87ca5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:31.614040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc962fd1-92de-42a5-a4e1-f5d938c87ca5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:31.614715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc962fd1-92de-42a5-a4e1-f5d938c87ca5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:31.615184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc962fd1-92de-42a5-a4e1-f5d938c87ca5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:31.615599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc962fd1-92de-42a5-a4e1-f5d938c87ca5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:31.676699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bc962fd1-92de-42a5-a4e1-f5d938c87ca5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:31.684222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bc962fd1-92de-42a5-a4e1-f5d938c87ca5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083416 Aug 31 00:28:31.684790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 365/755] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:31 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:32.705911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b05b3013-a259-426a-8d31-02172c560d36 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:32.706583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b05b3013-a259-426a-8d31-02172c560d36 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:32.713030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b05b3013-a259-426a-8d31-02172c560d36 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:32.713504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b05b3013-a259-426a-8d31-02172c560d36 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:32.713930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b05b3013-a259-426a-8d31-02172c560d36 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:32.714609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b05b3013-a259-426a-8d31-02172c560d36 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:32.715070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b05b3013-a259-426a-8d31-02172c560d36 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:32.715500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b05b3013-a259-426a-8d31-02172c560d36 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:32.776521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b05b3013-a259-426a-8d31-02172c560d36 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:32.785253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b05b3013-a259-426a-8d31-02172c560d36 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083706 Aug 31 00:28:32.785833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 366/756] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:32 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:33.805861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cb2c0429-74cf-4c0f-a90b-284ba5a18ac1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:33.806527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cb2c0429-74cf-4c0f-a90b-284ba5a18ac1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:33.812932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb2c0429-74cf-4c0f-a90b-284ba5a18ac1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.813408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb2c0429-74cf-4c0f-a90b-284ba5a18ac1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.813836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb2c0429-74cf-4c0f-a90b-284ba5a18ac1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.814521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb2c0429-74cf-4c0f-a90b-284ba5a18ac1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.814969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb2c0429-74cf-4c0f-a90b-284ba5a18ac1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.815413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb2c0429-74cf-4c0f-a90b-284ba5a18ac1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.888721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cb2c0429-74cf-4c0f-a90b-284ba5a18ac1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:33.898064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cb2c0429-74cf-4c0f-a90b-284ba5a18ac1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.095995 Aug 31 00:28:33.898571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 367/757] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:33 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:34.919259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e3d2cfcd-03a8-46eb-ab4c-21bf2be21ef8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:34.919877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e3d2cfcd-03a8-46eb-ab4c-21bf2be21ef8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:34.926462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3d2cfcd-03a8-46eb-ab4c-21bf2be21ef8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:34.926935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3d2cfcd-03a8-46eb-ab4c-21bf2be21ef8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:34.927397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3d2cfcd-03a8-46eb-ab4c-21bf2be21ef8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:34.928078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3d2cfcd-03a8-46eb-ab4c-21bf2be21ef8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:34.928523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3d2cfcd-03a8-46eb-ab4c-21bf2be21ef8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:34.928939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3d2cfcd-03a8-46eb-ab4c-21bf2be21ef8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:34.990544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e3d2cfcd-03a8-46eb-ab4c-21bf2be21ef8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:34.998419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e3d2cfcd-03a8-46eb-ab4c-21bf2be21ef8 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083064 Aug 31 00:28:34.998976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 368/758] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:34 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:36.021594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-37114ac9-0829-456b-80ae-bcfb00245ba5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:36.023570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-37114ac9-0829-456b-80ae-bcfb00245ba5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:36.030020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37114ac9-0829-456b-80ae-bcfb00245ba5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:36.030493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37114ac9-0829-456b-80ae-bcfb00245ba5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:36.030935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37114ac9-0829-456b-80ae-bcfb00245ba5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:36.032486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37114ac9-0829-456b-80ae-bcfb00245ba5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:36.033200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37114ac9-0829-456b-80ae-bcfb00245ba5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:36.033612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37114ac9-0829-456b-80ae-bcfb00245ba5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:36.097448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37114ac9-0829-456b-80ae-bcfb00245ba5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:36.105598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-37114ac9-0829-456b-80ae-bcfb00245ba5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.090213 Aug 31 00:28:36.106163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 369/759] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:36 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:37.127030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b4483f02-9984-4a36-a864-7ad973a7d330 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:37.127688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b4483f02-9984-4a36-a864-7ad973a7d330 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:37.135337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4483f02-9984-4a36-a864-7ad973a7d330 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.135845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4483f02-9984-4a36-a864-7ad973a7d330 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.136279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4483f02-9984-4a36-a864-7ad973a7d330 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.136961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4483f02-9984-4a36-a864-7ad973a7d330 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.137409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4483f02-9984-4a36-a864-7ad973a7d330 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.137824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4483f02-9984-4a36-a864-7ad973a7d330 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.198573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b4483f02-9984-4a36-a864-7ad973a7d330 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:37.206584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b4483f02-9984-4a36-a864-7ad973a7d330 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083545 Aug 31 00:28:37.207175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 370/760] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:37 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:38.227321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bddd4189-ecd1-420c-adfc-67621f0e8895 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:38.227947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bddd4189-ecd1-420c-adfc-67621f0e8895 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:38.234219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddd4189-ecd1-420c-adfc-67621f0e8895 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.234709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddd4189-ecd1-420c-adfc-67621f0e8895 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.235175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddd4189-ecd1-420c-adfc-67621f0e8895 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:38.235856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddd4189-ecd1-420c-adfc-67621f0e8895 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.236310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddd4189-ecd1-420c-adfc-67621f0e8895 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.236727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddd4189-ecd1-420c-adfc-67621f0e8895 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:38.309102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bddd4189-ecd1-420c-adfc-67621f0e8895 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:38.313080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:38.318525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bddd4189-ecd1-420c-adfc-67621f0e8895 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.095220 Aug 31 00:28:38.319116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 371/761] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:38 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:39.340416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e7472772-9cb3-4ada-bdb0-1304d55d6eba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:39.341072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e7472772-9cb3-4ada-bdb0-1304d55d6eba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:39.343461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=56 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:39.348776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7472772-9cb3-4ada-bdb0-1304d55d6eba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:39.349252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7472772-9cb3-4ada-bdb0-1304d55d6eba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:39.349676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7472772-9cb3-4ada-bdb0-1304d55d6eba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:39.350357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7472772-9cb3-4ada-bdb0-1304d55d6eba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:39.350801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7472772-9cb3-4ada-bdb0-1304d55d6eba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:39.351248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7472772-9cb3-4ada-bdb0-1304d55d6eba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:39.412484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e7472772-9cb3-4ada-bdb0-1304d55d6eba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:39.420256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e7472772-9cb3-4ada-bdb0-1304d55d6eba tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083725 Aug 31 00:28:39.420816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 372/762] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:39 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:40.441665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a150e0fa-3bbc-4e9e-9f7b-32d64e84ddfb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:40.442292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a150e0fa-3bbc-4e9e-9f7b-32d64e84ddfb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:40.448712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a150e0fa-3bbc-4e9e-9f7b-32d64e84ddfb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:40.449188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a150e0fa-3bbc-4e9e-9f7b-32d64e84ddfb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:40.449616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a150e0fa-3bbc-4e9e-9f7b-32d64e84ddfb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:40.450286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a150e0fa-3bbc-4e9e-9f7b-32d64e84ddfb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:40.450730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a150e0fa-3bbc-4e9e-9f7b-32d64e84ddfb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:40.451171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a150e0fa-3bbc-4e9e-9f7b-32d64e84ddfb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:40.511286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a150e0fa-3bbc-4e9e-9f7b-32d64e84ddfb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:40.519552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a150e0fa-3bbc-4e9e-9f7b-32d64e84ddfb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.082402 Aug 31 00:28:40.520108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 373/763] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:40 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:41.540160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cba9c99c-8db1-4f4a-8c2d-4bcbf6be7fc6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:41.540809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cba9c99c-8db1-4f4a-8c2d-4bcbf6be7fc6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:41.547126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba9c99c-8db1-4f4a-8c2d-4bcbf6be7fc6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:41.547571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba9c99c-8db1-4f4a-8c2d-4bcbf6be7fc6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:41.548104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba9c99c-8db1-4f4a-8c2d-4bcbf6be7fc6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:41.548781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba9c99c-8db1-4f4a-8c2d-4bcbf6be7fc6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:41.549226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba9c99c-8db1-4f4a-8c2d-4bcbf6be7fc6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:41.549641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba9c99c-8db1-4f4a-8c2d-4bcbf6be7fc6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:41.613717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cba9c99c-8db1-4f4a-8c2d-4bcbf6be7fc6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:41.621860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cba9c99c-8db1-4f4a-8c2d-4bcbf6be7fc6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085533 Aug 31 00:28:41.622420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 374/764] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:41 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:42.642710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-363a7820-832f-408a-94fa-d5dd40255ba7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:42.643441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-363a7820-832f-408a-94fa-d5dd40255ba7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:42.649808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-363a7820-832f-408a-94fa-d5dd40255ba7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:42.650298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-363a7820-832f-408a-94fa-d5dd40255ba7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:42.650723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-363a7820-832f-408a-94fa-d5dd40255ba7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:42.651438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-363a7820-832f-408a-94fa-d5dd40255ba7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:42.651882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-363a7820-832f-408a-94fa-d5dd40255ba7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:42.652297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-363a7820-832f-408a-94fa-d5dd40255ba7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:42.720377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-363a7820-832f-408a-94fa-d5dd40255ba7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:42.728361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-363a7820-832f-408a-94fa-d5dd40255ba7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.089411 Aug 31 00:28:42.728936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 375/765] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:42 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:43.749792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8f0a50b9-daee-4a88-a627-2eb6725a9046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:43.751176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8f0a50b9-daee-4a88-a627-2eb6725a9046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:43.757512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f0a50b9-daee-4a88-a627-2eb6725a9046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:43.757988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f0a50b9-daee-4a88-a627-2eb6725a9046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:43.758414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f0a50b9-daee-4a88-a627-2eb6725a9046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:43.759121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f0a50b9-daee-4a88-a627-2eb6725a9046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:43.759605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f0a50b9-daee-4a88-a627-2eb6725a9046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:43.759990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f0a50b9-daee-4a88-a627-2eb6725a9046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:43.821749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8f0a50b9-daee-4a88-a627-2eb6725a9046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:43.829504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8f0a50b9-daee-4a88-a627-2eb6725a9046 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083631 Aug 31 00:28:43.830066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 376/766] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:43 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:44.850593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-74f9d814-7294-4535-a9fa-24bfacfee96d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:44.851275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-74f9d814-7294-4535-a9fa-24bfacfee96d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:44.857737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74f9d814-7294-4535-a9fa-24bfacfee96d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:44.858218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74f9d814-7294-4535-a9fa-24bfacfee96d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:44.858650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74f9d814-7294-4535-a9fa-24bfacfee96d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:44.859370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74f9d814-7294-4535-a9fa-24bfacfee96d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:44.860401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74f9d814-7294-4535-a9fa-24bfacfee96d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:44.860902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74f9d814-7294-4535-a9fa-24bfacfee96d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:44.924014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-74f9d814-7294-4535-a9fa-24bfacfee96d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:44.932688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-74f9d814-7294-4535-a9fa-24bfacfee96d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085870 Aug 31 00:28:44.933279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 377/767] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:44 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:45.955010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-281e988a-1494-4b74-92b5-2f8e31c956a4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:45.955743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-281e988a-1494-4b74-92b5-2f8e31c956a4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:45.962081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281e988a-1494-4b74-92b5-2f8e31c956a4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:45.962558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281e988a-1494-4b74-92b5-2f8e31c956a4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:45.962989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281e988a-1494-4b74-92b5-2f8e31c956a4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:45.963697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281e988a-1494-4b74-92b5-2f8e31c956a4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:45.964150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281e988a-1494-4b74-92b5-2f8e31c956a4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:45.964568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281e988a-1494-4b74-92b5-2f8e31c956a4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:46.025946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-281e988a-1494-4b74-92b5-2f8e31c956a4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:46.034048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-281e988a-1494-4b74-92b5-2f8e31c956a4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083311 Aug 31 00:28:46.034619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 378/768] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:45 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:47.055497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eaed0f8f-c8e3-4f01-9ca2-d5329d0a21f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:47.056134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eaed0f8f-c8e3-4f01-9ca2-d5329d0a21f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:47.062367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eaed0f8f-c8e3-4f01-9ca2-d5329d0a21f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:47.062842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eaed0f8f-c8e3-4f01-9ca2-d5329d0a21f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:47.063794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eaed0f8f-c8e3-4f01-9ca2-d5329d0a21f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:47.064474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eaed0f8f-c8e3-4f01-9ca2-d5329d0a21f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:47.064912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eaed0f8f-c8e3-4f01-9ca2-d5329d0a21f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:47.065324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eaed0f8f-c8e3-4f01-9ca2-d5329d0a21f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:47.129106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eaed0f8f-c8e3-4f01-9ca2-d5329d0a21f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:47.136907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eaed0f8f-c8e3-4f01-9ca2-d5329d0a21f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085233 Aug 31 00:28:47.137469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 379/769] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:47 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:48.161830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d36e95ff-5ea2-40bd-a172-d7d0a4782273 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:48.162499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d36e95ff-5ea2-40bd-a172-d7d0a4782273 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:48.168828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d36e95ff-5ea2-40bd-a172-d7d0a4782273 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:48.169303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d36e95ff-5ea2-40bd-a172-d7d0a4782273 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:48.169724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d36e95ff-5ea2-40bd-a172-d7d0a4782273 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:48.170433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d36e95ff-5ea2-40bd-a172-d7d0a4782273 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:48.170876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d36e95ff-5ea2-40bd-a172-d7d0a4782273 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:48.171313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d36e95ff-5ea2-40bd-a172-d7d0a4782273 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:48.232035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d36e95ff-5ea2-40bd-a172-d7d0a4782273 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:48.240581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d36e95ff-5ea2-40bd-a172-d7d0a4782273 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084283 Aug 31 00:28:48.241145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 380/770] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:48 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:49.261138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-75a0da0b-6417-457c-9c5e-a3d7a785893e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:49.261771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-75a0da0b-6417-457c-9c5e-a3d7a785893e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:49.268400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a0da0b-6417-457c-9c5e-a3d7a785893e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:49.268879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a0da0b-6417-457c-9c5e-a3d7a785893e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:49.269311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a0da0b-6417-457c-9c5e-a3d7a785893e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:49.269992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a0da0b-6417-457c-9c5e-a3d7a785893e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:49.270439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a0da0b-6417-457c-9c5e-a3d7a785893e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:49.270851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-75a0da0b-6417-457c-9c5e-a3d7a785893e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:49.334604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-75a0da0b-6417-457c-9c5e-a3d7a785893e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:49.342271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-75a0da0b-6417-457c-9c5e-a3d7a785893e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085090 Aug 31 00:28:49.342837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 381/771] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:49 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:50.363330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2fe862cf-7cd2-40fb-b526-a285da3a61a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:50.363990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2fe862cf-7cd2-40fb-b526-a285da3a61a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:50.370593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fe862cf-7cd2-40fb-b526-a285da3a61a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:50.371089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fe862cf-7cd2-40fb-b526-a285da3a61a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:50.371513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fe862cf-7cd2-40fb-b526-a285da3a61a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:50.372183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fe862cf-7cd2-40fb-b526-a285da3a61a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:50.372623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fe862cf-7cd2-40fb-b526-a285da3a61a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:50.373363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fe862cf-7cd2-40fb-b526-a285da3a61a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:50.437468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2fe862cf-7cd2-40fb-b526-a285da3a61a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:50.446480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2fe862cf-7cd2-40fb-b526-a285da3a61a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086993 Aug 31 00:28:50.447060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 382/772] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:50 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:51.467196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7bdfcbb8-b5cb-4d67-a0e7-06659bd4ff4e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:51.467892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7bdfcbb8-b5cb-4d67-a0e7-06659bd4ff4e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:51.474296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdfcbb8-b5cb-4d67-a0e7-06659bd4ff4e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:51.474775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdfcbb8-b5cb-4d67-a0e7-06659bd4ff4e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:51.475318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdfcbb8-b5cb-4d67-a0e7-06659bd4ff4e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:51.476000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdfcbb8-b5cb-4d67-a0e7-06659bd4ff4e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:51.476450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdfcbb8-b5cb-4d67-a0e7-06659bd4ff4e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:51.476868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdfcbb8-b5cb-4d67-a0e7-06659bd4ff4e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:51.541657 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7bdfcbb8-b5cb-4d67-a0e7-06659bd4ff4e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:51.550429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7bdfcbb8-b5cb-4d67-a0e7-06659bd4ff4e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.087115 Aug 31 00:28:51.551009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 383/773] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:51 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:52.570907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ada7e363-27c9-472b-90db-aafc77ab2000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:52.571630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ada7e363-27c9-472b-90db-aafc77ab2000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:52.578062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7e363-27c9-472b-90db-aafc77ab2000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:52.578554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7e363-27c9-472b-90db-aafc77ab2000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:52.579628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7e363-27c9-472b-90db-aafc77ab2000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:52.580318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7e363-27c9-472b-90db-aafc77ab2000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:52.580769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7e363-27c9-472b-90db-aafc77ab2000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:52.581187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7e363-27c9-472b-90db-aafc77ab2000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:52.642385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ada7e363-27c9-472b-90db-aafc77ab2000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:52.650077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ada7e363-27c9-472b-90db-aafc77ab2000 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083054 Aug 31 00:28:52.650652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 384/774] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:52 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:53.671303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8e36dcd5-33a9-4018-a8b7-2f879b749768 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:53.671988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8e36dcd5-33a9-4018-a8b7-2f879b749768 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:53.678280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e36dcd5-33a9-4018-a8b7-2f879b749768 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:53.678761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e36dcd5-33a9-4018-a8b7-2f879b749768 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:53.679230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e36dcd5-33a9-4018-a8b7-2f879b749768 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:53.679995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e36dcd5-33a9-4018-a8b7-2f879b749768 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:53.680482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e36dcd5-33a9-4018-a8b7-2f879b749768 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:53.680891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e36dcd5-33a9-4018-a8b7-2f879b749768 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:53.742774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8e36dcd5-33a9-4018-a8b7-2f879b749768 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:53.750607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8e36dcd5-33a9-4018-a8b7-2f879b749768 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083187 Aug 31 00:28:53.751245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 385/775] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:53 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:54.771612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-639ec206-4d83-4a12-89e2-edf95c8694ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:54.772390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-639ec206-4d83-4a12-89e2-edf95c8694ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:54.778758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-639ec206-4d83-4a12-89e2-edf95c8694ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:54.779269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-639ec206-4d83-4a12-89e2-edf95c8694ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:54.779730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-639ec206-4d83-4a12-89e2-edf95c8694ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:54.780418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-639ec206-4d83-4a12-89e2-edf95c8694ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:54.780866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-639ec206-4d83-4a12-89e2-edf95c8694ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:54.781282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-639ec206-4d83-4a12-89e2-edf95c8694ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:54.842324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-639ec206-4d83-4a12-89e2-edf95c8694ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:54.850667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-639ec206-4d83-4a12-89e2-edf95c8694ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083263 Aug 31 00:28:54.851253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 386/776] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:54 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:55.871971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1eb89943-9699-4b33-8401-f91c49f67e56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:55.872643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1eb89943-9699-4b33-8401-f91c49f67e56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:55.879224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1eb89943-9699-4b33-8401-f91c49f67e56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:55.879706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1eb89943-9699-4b33-8401-f91c49f67e56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:55.880136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1eb89943-9699-4b33-8401-f91c49f67e56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:55.880820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1eb89943-9699-4b33-8401-f91c49f67e56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:55.881364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1eb89943-9699-4b33-8401-f91c49f67e56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:55.881781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1eb89943-9699-4b33-8401-f91c49f67e56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:55.945184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1eb89943-9699-4b33-8401-f91c49f67e56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:55.952901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1eb89943-9699-4b33-8401-f91c49f67e56 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084813 Aug 31 00:28:55.953460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 387/777] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:55 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:56.975721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-525ceaca-e9ba-400b-b2c3-19799b69d3fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:56.975721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-525ceaca-e9ba-400b-b2c3-19799b69d3fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:56.981830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-525ceaca-e9ba-400b-b2c3-19799b69d3fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:56.982307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-525ceaca-e9ba-400b-b2c3-19799b69d3fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:56.982735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-525ceaca-e9ba-400b-b2c3-19799b69d3fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:56.983459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-525ceaca-e9ba-400b-b2c3-19799b69d3fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:56.983909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-525ceaca-e9ba-400b-b2c3-19799b69d3fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:56.984323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-525ceaca-e9ba-400b-b2c3-19799b69d3fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:57.003353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:57.050263 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-525ceaca-e9ba-400b-b2c3-19799b69d3fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:57.058423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-525ceaca-e9ba-400b-b2c3-19799b69d3fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.088025 Aug 31 00:28:57.059229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 388/778] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:56 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:58.080001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-95c8b21e-d092-4a38-aa1a-743dc2f3fdb5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:58.080699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-95c8b21e-d092-4a38-aa1a-743dc2f3fdb5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:58.087203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95c8b21e-d092-4a38-aa1a-743dc2f3fdb5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:58.087681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95c8b21e-d092-4a38-aa1a-743dc2f3fdb5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:58.088155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95c8b21e-d092-4a38-aa1a-743dc2f3fdb5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:58.088837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95c8b21e-d092-4a38-aa1a-743dc2f3fdb5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:58.089281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95c8b21e-d092-4a38-aa1a-743dc2f3fdb5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:58.089692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95c8b21e-d092-4a38-aa1a-743dc2f3fdb5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:58.150826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-95c8b21e-d092-4a38-aa1a-743dc2f3fdb5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:58.159831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-95c8b21e-d092-4a38-aa1a-743dc2f3fdb5 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084386 Aug 31 00:28:58.160406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 389/779] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:58 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:59.182495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-63794484-f863-43a3-ae5e-5a62b4b1d8db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:59.183174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-63794484-f863-43a3-ae5e-5a62b4b1d8db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:59.189726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63794484-f863-43a3-ae5e-5a62b4b1d8db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:59.190246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63794484-f863-43a3-ae5e-5a62b4b1d8db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:59.190674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63794484-f863-43a3-ae5e-5a62b4b1d8db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:59.191379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63794484-f863-43a3-ae5e-5a62b4b1d8db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:59.191829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63794484-f863-43a3-ae5e-5a62b4b1d8db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:59.192243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63794484-f863-43a3-ae5e-5a62b4b1d8db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:59.253095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-63794484-f863-43a3-ae5e-5a62b4b1d8db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:59.260789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-63794484-f863-43a3-ae5e-5a62b4b1d8db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.082350 Aug 31 00:28:59.261350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 390/780] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:59 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:00.281206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f9ff21c2-6c2f-4b52-9ebe-d6672028584b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:00.281836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f9ff21c2-6c2f-4b52-9ebe-d6672028584b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:00.288470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ff21c2-6c2f-4b52-9ebe-d6672028584b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:00.288943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ff21c2-6c2f-4b52-9ebe-d6672028584b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:00.289368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ff21c2-6c2f-4b52-9ebe-d6672028584b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:00.290045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ff21c2-6c2f-4b52-9ebe-d6672028584b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:00.290489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ff21c2-6c2f-4b52-9ebe-d6672028584b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:00.290901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ff21c2-6c2f-4b52-9ebe-d6672028584b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:00.355108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f9ff21c2-6c2f-4b52-9ebe-d6672028584b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:00.363343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f9ff21c2-6c2f-4b52-9ebe-d6672028584b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086035 Aug 31 00:29:00.363901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 391/781] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:00 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:01.441948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ac8efb9a-c7e2-4c02-95da-c93216ed7aa1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:01.442616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ac8efb9a-c7e2-4c02-95da-c93216ed7aa1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:01.449245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac8efb9a-c7e2-4c02-95da-c93216ed7aa1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:01.449718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac8efb9a-c7e2-4c02-95da-c93216ed7aa1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:01.450144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac8efb9a-c7e2-4c02-95da-c93216ed7aa1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:01.450856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac8efb9a-c7e2-4c02-95da-c93216ed7aa1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:01.451333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac8efb9a-c7e2-4c02-95da-c93216ed7aa1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:01.451752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac8efb9a-c7e2-4c02-95da-c93216ed7aa1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:01.512825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ac8efb9a-c7e2-4c02-95da-c93216ed7aa1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:01.521240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ac8efb9a-c7e2-4c02-95da-c93216ed7aa1 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083782 Aug 31 00:29:01.521808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 392/782] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:01 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:02.542590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-548d6abe-e602-4a40-8d44-90e43f05c5ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:02.543245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-548d6abe-e602-4a40-8d44-90e43f05c5ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:02.550262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548d6abe-e602-4a40-8d44-90e43f05c5ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:02.550740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548d6abe-e602-4a40-8d44-90e43f05c5ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:02.551201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548d6abe-e602-4a40-8d44-90e43f05c5ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:02.551890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548d6abe-e602-4a40-8d44-90e43f05c5ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:02.552344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548d6abe-e602-4a40-8d44-90e43f05c5ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:02.552802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548d6abe-e602-4a40-8d44-90e43f05c5ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:02.613994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-548d6abe-e602-4a40-8d44-90e43f05c5ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:02.621744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-548d6abe-e602-4a40-8d44-90e43f05c5ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083491 Aug 31 00:29:02.622330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 393/783] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:02 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:03.644095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f8307729-e586-4734-ac0f-a76c8c588f3f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:03.644836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f8307729-e586-4734-ac0f-a76c8c588f3f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:03.651772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8307729-e586-4734-ac0f-a76c8c588f3f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:03.652362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8307729-e586-4734-ac0f-a76c8c588f3f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:03.652951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8307729-e586-4734-ac0f-a76c8c588f3f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:03.653655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8307729-e586-4734-ac0f-a76c8c588f3f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:03.654159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8307729-e586-4734-ac0f-a76c8c588f3f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:03.654604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8307729-e586-4734-ac0f-a76c8c588f3f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:03.716647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f8307729-e586-4734-ac0f-a76c8c588f3f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:03.724672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f8307729-e586-4734-ac0f-a76c8c588f3f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085329 Aug 31 00:29:03.725227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 394/784] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:03 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:04.745350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ee34b57-1a34-4709-8ca2-1a985d40f86f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:04.745977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ee34b57-1a34-4709-8ca2-1a985d40f86f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:04.752193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee34b57-1a34-4709-8ca2-1a985d40f86f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:04.752659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee34b57-1a34-4709-8ca2-1a985d40f86f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:04.753083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee34b57-1a34-4709-8ca2-1a985d40f86f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:04.753755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee34b57-1a34-4709-8ca2-1a985d40f86f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:04.754204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee34b57-1a34-4709-8ca2-1a985d40f86f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:04.754613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee34b57-1a34-4709-8ca2-1a985d40f86f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:04.822362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ee34b57-1a34-4709-8ca2-1a985d40f86f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:04.831634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ee34b57-1a34-4709-8ca2-1a985d40f86f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.090082 Aug 31 00:29:04.832212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 395/785] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:04 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:05.853783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a922f9dd-c55a-4ed9-b1e4-f1ba3e75d170 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:05.854454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a922f9dd-c55a-4ed9-b1e4-f1ba3e75d170 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:05.861433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a922f9dd-c55a-4ed9-b1e4-f1ba3e75d170 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:05.861915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a922f9dd-c55a-4ed9-b1e4-f1ba3e75d170 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:05.862343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a922f9dd-c55a-4ed9-b1e4-f1ba3e75d170 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:05.863024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a922f9dd-c55a-4ed9-b1e4-f1ba3e75d170 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:05.863496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a922f9dd-c55a-4ed9-b1e4-f1ba3e75d170 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:05.863915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a922f9dd-c55a-4ed9-b1e4-f1ba3e75d170 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:05.925696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a922f9dd-c55a-4ed9-b1e4-f1ba3e75d170 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:05.933452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a922f9dd-c55a-4ed9-b1e4-f1ba3e75d170 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083649 Aug 31 00:29:05.934025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 396/786] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:05 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:06.956151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d3ff2f49-d5ff-40b7-b78d-e502f8ac0519 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:06.956871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d3ff2f49-d5ff-40b7-b78d-e502f8ac0519 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:06.963802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ff2f49-d5ff-40b7-b78d-e502f8ac0519 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:06.964281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ff2f49-d5ff-40b7-b78d-e502f8ac0519 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:06.964783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ff2f49-d5ff-40b7-b78d-e502f8ac0519 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:06.965534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ff2f49-d5ff-40b7-b78d-e502f8ac0519 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:06.965981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ff2f49-d5ff-40b7-b78d-e502f8ac0519 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:06.966450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ff2f49-d5ff-40b7-b78d-e502f8ac0519 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.040298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d3ff2f49-d5ff-40b7-b78d-e502f8ac0519 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:07.049140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d3ff2f49-d5ff-40b7-b78d-e502f8ac0519 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.098769 Aug 31 00:29:07.049711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 397/787] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:06 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:08.072268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-692846b7-995a-47c3-97f2-1e7d5bbcf0ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:08.072915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-692846b7-995a-47c3-97f2-1e7d5bbcf0ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:08.079256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-692846b7-995a-47c3-97f2-1e7d5bbcf0ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:08.079875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-692846b7-995a-47c3-97f2-1e7d5bbcf0ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:08.080305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-692846b7-995a-47c3-97f2-1e7d5bbcf0ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:08.080979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-692846b7-995a-47c3-97f2-1e7d5bbcf0ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:08.081421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-692846b7-995a-47c3-97f2-1e7d5bbcf0ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:08.081834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-692846b7-995a-47c3-97f2-1e7d5bbcf0ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:08.142197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-692846b7-995a-47c3-97f2-1e7d5bbcf0ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:08.149860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-692846b7-995a-47c3-97f2-1e7d5bbcf0ce tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.081461 Aug 31 00:29:08.150422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 398/788] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:08 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:09.170749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-88f2bdca-ae44-4baa-beaa-a557655d9f66 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:09.171389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-88f2bdca-ae44-4baa-beaa-a557655d9f66 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:09.178521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88f2bdca-ae44-4baa-beaa-a557655d9f66 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:09.179003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88f2bdca-ae44-4baa-beaa-a557655d9f66 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:09.179464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88f2bdca-ae44-4baa-beaa-a557655d9f66 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:09.180152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88f2bdca-ae44-4baa-beaa-a557655d9f66 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:09.180607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88f2bdca-ae44-4baa-beaa-a557655d9f66 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:09.181029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88f2bdca-ae44-4baa-beaa-a557655d9f66 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:09.249237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-88f2bdca-ae44-4baa-beaa-a557655d9f66 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:09.258086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-88f2bdca-ae44-4baa-beaa-a557655d9f66 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.091243 Aug 31 00:29:09.258656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 399/789] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:09 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:10.281969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d29de217-f889-417f-86dc-b9b4f223d9ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:10.282609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d29de217-f889-417f-86dc-b9b4f223d9ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:10.286057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=56 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:10.291503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29de217-f889-417f-86dc-b9b4f223d9ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:10.291987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29de217-f889-417f-86dc-b9b4f223d9ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:10.292419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29de217-f889-417f-86dc-b9b4f223d9ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:10.293109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29de217-f889-417f-86dc-b9b4f223d9ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:10.293567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29de217-f889-417f-86dc-b9b4f223d9ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:10.293976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29de217-f889-417f-86dc-b9b4f223d9ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:10.356020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d29de217-f889-417f-86dc-b9b4f223d9ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:10.363779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d29de217-f889-417f-86dc-b9b4f223d9ed tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085898 Aug 31 00:29:10.364343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 400/790] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:10 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:11.385122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-47db1fa2-1ca8-4324-a7da-cb4f8220df01 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:11.385811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-47db1fa2-1ca8-4324-a7da-cb4f8220df01 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:11.393391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47db1fa2-1ca8-4324-a7da-cb4f8220df01 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:11.393880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47db1fa2-1ca8-4324-a7da-cb4f8220df01 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:11.394309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47db1fa2-1ca8-4324-a7da-cb4f8220df01 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:11.395005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47db1fa2-1ca8-4324-a7da-cb4f8220df01 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:11.395474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47db1fa2-1ca8-4324-a7da-cb4f8220df01 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:11.395891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47db1fa2-1ca8-4324-a7da-cb4f8220df01 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:11.459489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-47db1fa2-1ca8-4324-a7da-cb4f8220df01 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:11.467186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-47db1fa2-1ca8-4324-a7da-cb4f8220df01 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085942 Aug 31 00:29:11.467752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 401/791] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:11 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:12.489264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a2c1460b-0163-44c1-bfe3-47eb774f98f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:12.489910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a2c1460b-0163-44c1-bfe3-47eb774f98f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:12.496289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2c1460b-0163-44c1-bfe3-47eb774f98f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:12.496768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2c1460b-0163-44c1-bfe3-47eb774f98f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:12.497196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2c1460b-0163-44c1-bfe3-47eb774f98f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:12.497876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2c1460b-0163-44c1-bfe3-47eb774f98f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:12.498319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2c1460b-0163-44c1-bfe3-47eb774f98f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:12.498729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2c1460b-0163-44c1-bfe3-47eb774f98f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:12.711840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a2c1460b-0163-44c1-bfe3-47eb774f98f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:12.719506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a2c1460b-0163-44c1-bfe3-47eb774f98f4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.234620 Aug 31 00:29:12.720074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 402/792] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:12 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:13.741207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-54050fb8-90d7-47d6-99e0-6cc551214a16 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:13.741913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-54050fb8-90d7-47d6-99e0-6cc551214a16 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:13.748298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54050fb8-90d7-47d6-99e0-6cc551214a16 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:13.748777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54050fb8-90d7-47d6-99e0-6cc551214a16 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:13.749208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54050fb8-90d7-47d6-99e0-6cc551214a16 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:13.749893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54050fb8-90d7-47d6-99e0-6cc551214a16 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:13.750340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54050fb8-90d7-47d6-99e0-6cc551214a16 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:13.750758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54050fb8-90d7-47d6-99e0-6cc551214a16 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:13.814626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-54050fb8-90d7-47d6-99e0-6cc551214a16 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:13.822920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-54050fb8-90d7-47d6-99e0-6cc551214a16 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085548 Aug 31 00:29:13.823502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 403/793] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:13 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:14.454588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:14.455894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:14.462509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:14.463000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:14.463460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:14.464282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:14.464735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:14.465150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:16.807454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:29:16.808045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:29:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a (ip 10.222.0.67) !!! Aug 31 00:29:16.809436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:29:16.809581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:29:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a (ip 10.222.0.67) !!! Aug 31 00:29:17.940556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:29:17.941118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:29:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a (ip 10.222.0.67) !!! Aug 31 00:29:24.462605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=9 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:24.492838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=96 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:57.711671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Cannot 'detach_volume' instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 while it is in vm_state rescued Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a HTTP/1.1 Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:29:57.713285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:29:57.715258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Cannot 'detach_volume' instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 while it is in vm_state rescued Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '2d43efc3-0d4e-4f0c-9242-7d5cf206ae43', 'id': '2a816307-3a33-4d13-9fad-a03edaa2c34a'} Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:57.716084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 while it is in vm_state rescued Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 while it is in vm_state rescued Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:29:57.717557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 409 to user: Cannot 'detach_volume' instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 while it is in vm_state rescued {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:57.718734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0d57556e-dde0-4d65-9e83-711bbad6aebf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a" status: 409 len: 152 microversion: 2.1 time: 103.324644 Aug 31 00:29:57.718734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 391/794] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:28:14 2022] DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a => generated 152 bytes in 103326 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:29:57.721615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-407a778b-ae54-4c8b-aaf4-854e0ea7c2bb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:57.722221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-407a778b-ae54-4c8b-aaf4-854e0ea7c2bb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:57.728423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-407a778b-ae54-4c8b-aaf4-854e0ea7c2bb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:57.728913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-407a778b-ae54-4c8b-aaf4-854e0ea7c2bb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:57.729352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-407a778b-ae54-4c8b-aaf4-854e0ea7c2bb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:57.730239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-407a778b-ae54-4c8b-aaf4-854e0ea7c2bb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:57.730697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-407a778b-ae54-4c8b-aaf4-854e0ea7c2bb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:57.731158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-407a778b-ae54-4c8b-aaf4-854e0ea7c2bb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:57.797001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-407a778b-ae54-4c8b-aaf4-854e0ea7c2bb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:57.805856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-407a778b-ae54-4c8b-aaf4-854e0ea7c2bb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.089266 Aug 31 00:29:57.806444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 392/795] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:57 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:57.838847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-177d623e-5c61-4568-a659-84dfd9b3a6e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:57.839383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-177d623e-5c61-4568-a659-84dfd9b3a6e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:57.845262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-177d623e-5c61-4568-a659-84dfd9b3a6e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:57.845747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-177d623e-5c61-4568-a659-84dfd9b3a6e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:57.846182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-177d623e-5c61-4568-a659-84dfd9b3a6e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:57.846863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-177d623e-5c61-4568-a659-84dfd9b3a6e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:57.847399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-177d623e-5c61-4568-a659-84dfd9b3a6e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:57.848240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-177d623e-5c61-4568-a659-84dfd9b3a6e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:57.870614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Cannot 'detach_volume' instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 while it is in vm_state rescued Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a HTTP/1.1 Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:29:57.872825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:29:57.874111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Cannot 'detach_volume' instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 while it is in vm_state rescued Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '2d43efc3-0d4e-4f0c-9242-7d5cf206ae43', 'id': '2a816307-3a33-4d13-9fad-a03edaa2c34a'} Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:57.874778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 while it is in vm_state rescued Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 while it is in vm_state rescued Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:29:57.875996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 409 to user: Cannot 'detach_volume' instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 while it is in vm_state rescued {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:57.876952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-da7026a8-af4c-4bbf-be97-8ec423f43228 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a" status: 409 len: 152 microversion: 2.1 time: 43.423748 Aug 31 00:29:57.876952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 404/796] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:29:14 2022] DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a => generated 152 bytes in 43425 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:29:57.884466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-457daf2c-9a49-495f-9158-13f315608974 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:57.885007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-457daf2c-9a49-495f-9158-13f315608974 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:57.891927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-457daf2c-9a49-495f-9158-13f315608974 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:57.892410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-457daf2c-9a49-495f-9158-13f315608974 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:57.892837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-457daf2c-9a49-495f-9158-13f315608974 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:57.893516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-457daf2c-9a49-495f-9158-13f315608974 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:57.893960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-457daf2c-9a49-495f-9158-13f315608974 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:57.894950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-457daf2c-9a49-495f-9158-13f315608974 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:57.964261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-457daf2c-9a49-495f-9158-13f315608974 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/action" status: 202 len: 0 microversion: 2.1 time: 0.084179 Aug 31 00:29:57.964887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 405/797] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 00:29:57 2022] POST /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:29:57.974526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-15a3c4a3-22a5-4520-9868-075a92a7bf82 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:57.975243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-15a3c4a3-22a5-4520-9868-075a92a7bf82 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:57.981550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15a3c4a3-22a5-4520-9868-075a92a7bf82 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:57.982023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15a3c4a3-22a5-4520-9868-075a92a7bf82 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:57.982450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15a3c4a3-22a5-4520-9868-075a92a7bf82 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:57.983416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15a3c4a3-22a5-4520-9868-075a92a7bf82 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:57.984013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15a3c4a3-22a5-4520-9868-075a92a7bf82 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:57.984586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15a3c4a3-22a5-4520-9868-075a92a7bf82 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:58.443736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-15a3c4a3-22a5-4520-9868-075a92a7bf82 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:58.458709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-15a3c4a3-22a5-4520-9868-075a92a7bf82 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1723 microversion: 2.1 time: 0.489324 Aug 31 00:29:58.459319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 406/798] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1723 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:58.785832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-177d623e-5c61-4568-a659-84dfd9b3a6e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'services' on Instance uuid 02e4497e-f74f-4b4e-aac6-88c39ead5f38 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:29:58.827758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0c645f42-87aa-4435-ab10-4746d5024e1b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:58.828359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0c645f42-87aa-4435-ab10-4746d5024e1b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:58.836039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c645f42-87aa-4435-ab10-4746d5024e1b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:58.836523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c645f42-87aa-4435-ab10-4746d5024e1b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:58.836946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c645f42-87aa-4435-ab10-4746d5024e1b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:58.837640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c645f42-87aa-4435-ab10-4746d5024e1b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:58.838373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c645f42-87aa-4435-ab10-4746d5024e1b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:58.838601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c645f42-87aa-4435-ab10-4746d5024e1b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:58.901767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0c645f42-87aa-4435-ab10-4746d5024e1b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:58.909598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0c645f42-87aa-4435-ab10-4746d5024e1b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085666 Aug 31 00:29:58.910872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 407/799] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:58 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:59.480791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3bcecbb1-05c7-487b-ba0a-abfd83b6c021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:59.481395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3bcecbb1-05c7-487b-ba0a-abfd83b6c021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:59.487815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bcecbb1-05c7-487b-ba0a-abfd83b6c021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:59.488958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bcecbb1-05c7-487b-ba0a-abfd83b6c021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:59.489634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bcecbb1-05c7-487b-ba0a-abfd83b6c021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:59.490364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bcecbb1-05c7-487b-ba0a-abfd83b6c021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:59.490824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bcecbb1-05c7-487b-ba0a-abfd83b6c021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:59.491279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bcecbb1-05c7-487b-ba0a-abfd83b6c021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:59.620404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3bcecbb1-05c7-487b-ba0a-abfd83b6c021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:59.629547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3bcecbb1-05c7-487b-ba0a-abfd83b6c021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1723 microversion: 2.1 time: 0.152047 Aug 31 00:29:59.630121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 408/800] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:59.930814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5042219e-11db-49e9-91d5-9cdf74276800 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:59.931549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5042219e-11db-49e9-91d5-9cdf74276800 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:59.937380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5042219e-11db-49e9-91d5-9cdf74276800 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:59.937859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5042219e-11db-49e9-91d5-9cdf74276800 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:59.938290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5042219e-11db-49e9-91d5-9cdf74276800 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:59.938974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5042219e-11db-49e9-91d5-9cdf74276800 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:59.939463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5042219e-11db-49e9-91d5-9cdf74276800 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:59.939881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5042219e-11db-49e9-91d5-9cdf74276800 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:00.003609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5042219e-11db-49e9-91d5-9cdf74276800 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:00.011534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5042219e-11db-49e9-91d5-9cdf74276800 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084641 Aug 31 00:30:00.012119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 409/801] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:59 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:00.651555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-31ade63e-27aa-44fc-9ee4-3758f319ddfb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:00.652157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-31ade63e-27aa-44fc-9ee4-3758f319ddfb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:00.658511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31ade63e-27aa-44fc-9ee4-3758f319ddfb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:00.658991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31ade63e-27aa-44fc-9ee4-3758f319ddfb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:00.659450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31ade63e-27aa-44fc-9ee4-3758f319ddfb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:00.660181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31ade63e-27aa-44fc-9ee4-3758f319ddfb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:00.660641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31ade63e-27aa-44fc-9ee4-3758f319ddfb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:00.661040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-31ade63e-27aa-44fc-9ee4-3758f319ddfb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:00.794151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-31ade63e-27aa-44fc-9ee4-3758f319ddfb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:00.802582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-31ade63e-27aa-44fc-9ee4-3758f319ddfb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1723 microversion: 2.1 time: 0.154850 Aug 31 00:30:00.803156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 410/802] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:01.032206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6fb1d045-556f-4364-ac47-9ff10c120b28 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:01.032852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6fb1d045-556f-4364-ac47-9ff10c120b28 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:01.039127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fb1d045-556f-4364-ac47-9ff10c120b28 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:01.039611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fb1d045-556f-4364-ac47-9ff10c120b28 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:01.040053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fb1d045-556f-4364-ac47-9ff10c120b28 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:01.040743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fb1d045-556f-4364-ac47-9ff10c120b28 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:01.041196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fb1d045-556f-4364-ac47-9ff10c120b28 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:01.041619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fb1d045-556f-4364-ac47-9ff10c120b28 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:01.104751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6fb1d045-556f-4364-ac47-9ff10c120b28 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:01.112672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6fb1d045-556f-4364-ac47-9ff10c120b28 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084335 Aug 31 00:30:01.114010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 411/803] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:01 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:01.824771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-38e1066c-660c-4a0b-896b-339b7d0ed548 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:01.825362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-38e1066c-660c-4a0b-896b-339b7d0ed548 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:01.832388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38e1066c-660c-4a0b-896b-339b7d0ed548 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:01.833022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38e1066c-660c-4a0b-896b-339b7d0ed548 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:01.833450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38e1066c-660c-4a0b-896b-339b7d0ed548 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:01.834126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38e1066c-660c-4a0b-896b-339b7d0ed548 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:01.834573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38e1066c-660c-4a0b-896b-339b7d0ed548 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:01.834987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38e1066c-660c-4a0b-896b-339b7d0ed548 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:01.974114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-38e1066c-660c-4a0b-896b-339b7d0ed548 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:01.982423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-38e1066c-660c-4a0b-896b-339b7d0ed548 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1729 microversion: 2.1 time: 0.161515 Aug 31 00:30:01.982983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 412/804] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:02.002745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-336a9703-f107-427f-b49c-024082ec5140 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:02.003264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-336a9703-f107-427f-b49c-024082ec5140 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:02.009647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-336a9703-f107-427f-b49c-024082ec5140 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.010133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-336a9703-f107-427f-b49c-024082ec5140 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.010574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-336a9703-f107-427f-b49c-024082ec5140 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.011288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-336a9703-f107-427f-b49c-024082ec5140 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.011741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-336a9703-f107-427f-b49c-024082ec5140 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.012164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-336a9703-f107-427f-b49c-024082ec5140 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.090068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-336a9703-f107-427f-b49c-024082ec5140 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090965 Aug 31 00:30:02.090662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 413/805] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 31 00:30:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:30:02.134453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c4639b3a-6f8b-4abf-a612-22ce2ea5826a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:02.135102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c4639b3a-6f8b-4abf-a612-22ce2ea5826a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:02.140971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4639b3a-6f8b-4abf-a612-22ce2ea5826a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.141446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4639b3a-6f8b-4abf-a612-22ce2ea5826a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.141874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4639b3a-6f8b-4abf-a612-22ce2ea5826a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.142569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4639b3a-6f8b-4abf-a612-22ce2ea5826a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.143020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4639b3a-6f8b-4abf-a612-22ce2ea5826a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.143455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4639b3a-6f8b-4abf-a612-22ce2ea5826a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.237714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c4639b3a-6f8b-4abf-a612-22ce2ea5826a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:02.245828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c4639b3a-6f8b-4abf-a612-22ce2ea5826a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.115402 Aug 31 00:30:02.246398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 414/806] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:02 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:03.103983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-24c46b7f-edcf-487f-aa73-17d1ff7bfa13 req-02c971cc-1513-4078-a3fa-6de17c223129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d43efc3-0d4e-4f0c-9242-7d5cf206ae43", "tag": "b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:03.113228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-24c46b7f-edcf-487f-aa73-17d1ff7bfa13 req-02c971cc-1513-4078-a3fa-6de17c223129 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:03.113944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-24c46b7f-edcf-487f-aa73-17d1ff7bfa13 req-02c971cc-1513-4078-a3fa-6de17c223129 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:03.114105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-24c46b7f-edcf-487f-aa73-17d1ff7bfa13 req-02c971cc-1513-4078-a3fa-6de17c223129 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:03.125630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-24c46b7f-edcf-487f-aa73-17d1ff7bfa13 req-02c971cc-1513-4078-a3fa-6de17c223129 service nova] Creating event network-changed:b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a for instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 on hv-cinder-85506 Aug 31 00:30:03.132153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-24c46b7f-edcf-487f-aa73-17d1ff7bfa13 req-02c971cc-1513-4078-a3fa-6de17c223129 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120528 Aug 31 00:30:03.132742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 415/807] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:30:03.267856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a0bfc68a-133f-4e20-a62b-d1a7be85666f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:03.268741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a0bfc68a-133f-4e20-a62b-d1a7be85666f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:03.275532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0bfc68a-133f-4e20-a62b-d1a7be85666f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:03.276324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0bfc68a-133f-4e20-a62b-d1a7be85666f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:03.276822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0bfc68a-133f-4e20-a62b-d1a7be85666f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:03.277602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0bfc68a-133f-4e20-a62b-d1a7be85666f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:03.278118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0bfc68a-133f-4e20-a62b-d1a7be85666f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:03.278592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0bfc68a-133f-4e20-a62b-d1a7be85666f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:03.358192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a0bfc68a-133f-4e20-a62b-d1a7be85666f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:03.368036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a0bfc68a-133f-4e20-a62b-d1a7be85666f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.104356 Aug 31 00:30:03.368036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 416/808] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:03 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:04.389869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-de1ae6d8-062a-4ace-9769-7dff43b842d2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:04.390542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-de1ae6d8-062a-4ace-9769-7dff43b842d2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:04.397403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de1ae6d8-062a-4ace-9769-7dff43b842d2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:04.397874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de1ae6d8-062a-4ace-9769-7dff43b842d2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:04.398296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de1ae6d8-062a-4ace-9769-7dff43b842d2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:04.398969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de1ae6d8-062a-4ace-9769-7dff43b842d2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:04.399448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de1ae6d8-062a-4ace-9769-7dff43b842d2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:04.399861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de1ae6d8-062a-4ace-9769-7dff43b842d2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:04.468894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-de1ae6d8-062a-4ace-9769-7dff43b842d2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:04.476564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-de1ae6d8-062a-4ace-9769-7dff43b842d2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.090550 Aug 31 00:30:04.477116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 417/809] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:04 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:05.147403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-44e2b79f-baa9-499e-a830-e5326a36ebdb req-4aaed5a5-13b8-4579-8742-d22f25f7c795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d43efc3-0d4e-4f0c-9242-7d5cf206ae43", "tag": "b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:05.156715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-44e2b79f-baa9-499e-a830-e5326a36ebdb req-4aaed5a5-13b8-4579-8742-d22f25f7c795 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:05.157131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-44e2b79f-baa9-499e-a830-e5326a36ebdb req-4aaed5a5-13b8-4579-8742-d22f25f7c795 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:05.157558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-44e2b79f-baa9-499e-a830-e5326a36ebdb req-4aaed5a5-13b8-4579-8742-d22f25f7c795 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:05.169352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-44e2b79f-baa9-499e-a830-e5326a36ebdb req-4aaed5a5-13b8-4579-8742-d22f25f7c795 service nova] Creating event network-changed:b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a for instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 on hv-cinder-85506 Aug 31 00:30:05.174366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-44e2b79f-baa9-499e-a830-e5326a36ebdb req-4aaed5a5-13b8-4579-8742-d22f25f7c795 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031072 Aug 31 00:30:05.174947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 418/810] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:30:05.497395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bc0ad949-4fd3-4156-ade2-e8547ada9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:05.498083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bc0ad949-4fd3-4156-ade2-e8547ada9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:05.505270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0ad949-4fd3-4156-ade2-e8547ada9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:05.505748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0ad949-4fd3-4156-ade2-e8547ada9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:05.506174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0ad949-4fd3-4156-ade2-e8547ada9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:05.506860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0ad949-4fd3-4156-ade2-e8547ada9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:05.507331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0ad949-4fd3-4156-ade2-e8547ada9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:05.507743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc0ad949-4fd3-4156-ade2-e8547ada9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:05.611379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bc0ad949-4fd3-4156-ade2-e8547ada9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:05.619850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bc0ad949-4fd3-4156-ade2-e8547ada9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.126526 Aug 31 00:30:05.620605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 419/811] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:05 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:06.640702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2a22f14f-dad8-4530-9d35-54b8bbbb16f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:06.641396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2a22f14f-dad8-4530-9d35-54b8bbbb16f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:06.649848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a22f14f-dad8-4530-9d35-54b8bbbb16f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:06.650403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a22f14f-dad8-4530-9d35-54b8bbbb16f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:06.651118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a22f14f-dad8-4530-9d35-54b8bbbb16f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:06.651887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a22f14f-dad8-4530-9d35-54b8bbbb16f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:06.652341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a22f14f-dad8-4530-9d35-54b8bbbb16f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:06.652755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a22f14f-dad8-4530-9d35-54b8bbbb16f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:06.728872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2a22f14f-dad8-4530-9d35-54b8bbbb16f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:06.737959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2a22f14f-dad8-4530-9d35-54b8bbbb16f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.101120 Aug 31 00:30:06.738692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 420/812] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:06 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:07.761221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-50d4404f-5461-45fe-9d41-d1530fe9dc0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:07.761895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-50d4404f-5461-45fe-9d41-d1530fe9dc0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:07.768181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d4404f-5461-45fe-9d41-d1530fe9dc0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:07.768661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d4404f-5461-45fe-9d41-d1530fe9dc0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:07.769092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d4404f-5461-45fe-9d41-d1530fe9dc0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:07.769791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d4404f-5461-45fe-9d41-d1530fe9dc0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:07.770245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d4404f-5461-45fe-9d41-d1530fe9dc0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:07.770659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d4404f-5461-45fe-9d41-d1530fe9dc0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:07.839629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-50d4404f-5461-45fe-9d41-d1530fe9dc0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:07.843313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:07.845287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:07.848542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-50d4404f-5461-45fe-9d41-d1530fe9dc0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.091092 Aug 31 00:30:07.849121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 421/813] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:07 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:08.791292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=16 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:08.869798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-189e46a3-d9a3-42a6-bfcf-0a6434fae39e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:08.870426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-189e46a3-d9a3-42a6-bfcf-0a6434fae39e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:08.877345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189e46a3-d9a3-42a6-bfcf-0a6434fae39e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:08.877826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189e46a3-d9a3-42a6-bfcf-0a6434fae39e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:08.878257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189e46a3-d9a3-42a6-bfcf-0a6434fae39e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:08.878962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189e46a3-d9a3-42a6-bfcf-0a6434fae39e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:08.880073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189e46a3-d9a3-42a6-bfcf-0a6434fae39e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:08.880530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189e46a3-d9a3-42a6-bfcf-0a6434fae39e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:08.942347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-189e46a3-d9a3-42a6-bfcf-0a6434fae39e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:08.950199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-189e46a3-d9a3-42a6-bfcf-0a6434fae39e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084592 Aug 31 00:30:08.950757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 422/814] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:08 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:09.971257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0faa726-7989-4a99-97aa-554572e01815 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:09.971933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0faa726-7989-4a99-97aa-554572e01815 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:09.978987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0faa726-7989-4a99-97aa-554572e01815 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:09.979489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0faa726-7989-4a99-97aa-554572e01815 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:09.979917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0faa726-7989-4a99-97aa-554572e01815 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:09.980600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0faa726-7989-4a99-97aa-554572e01815 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:09.981047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0faa726-7989-4a99-97aa-554572e01815 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:09.981463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0faa726-7989-4a99-97aa-554572e01815 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:10.046510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0faa726-7989-4a99-97aa-554572e01815 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:10.054396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0faa726-7989-4a99-97aa-554572e01815 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.087118 Aug 31 00:30:10.054965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 423/815] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:09 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:11.075228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c1235831-b433-4525-a556-533462945f3d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:11.075853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c1235831-b433-4525-a556-533462945f3d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:11.082796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1235831-b433-4525-a556-533462945f3d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:11.083445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1235831-b433-4525-a556-533462945f3d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:11.083884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1235831-b433-4525-a556-533462945f3d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:11.084579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1235831-b433-4525-a556-533462945f3d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:11.085041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1235831-b433-4525-a556-533462945f3d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:11.085464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1235831-b433-4525-a556-533462945f3d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:11.147179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c1235831-b433-4525-a556-533462945f3d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:11.154880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c1235831-b433-4525-a556-533462945f3d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083588 Aug 31 00:30:11.155475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 424/816] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:11 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:12.177443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-32873441-2a82-4dad-af57-2b291b38393f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:12.178082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-32873441-2a82-4dad-af57-2b291b38393f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:12.184518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32873441-2a82-4dad-af57-2b291b38393f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:12.185029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32873441-2a82-4dad-af57-2b291b38393f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:12.185439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32873441-2a82-4dad-af57-2b291b38393f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:12.186113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32873441-2a82-4dad-af57-2b291b38393f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:12.186554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32873441-2a82-4dad-af57-2b291b38393f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:12.186965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32873441-2a82-4dad-af57-2b291b38393f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:12.251277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-32873441-2a82-4dad-af57-2b291b38393f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:12.260160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-32873441-2a82-4dad-af57-2b291b38393f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.087205 Aug 31 00:30:12.260718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 425/817] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:12 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:13.280291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9a0f3287-a87e-4aa1-ad4e-6e0a8bc61064 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:13.280989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9a0f3287-a87e-4aa1-ad4e-6e0a8bc61064 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:13.288034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a0f3287-a87e-4aa1-ad4e-6e0a8bc61064 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:13.288788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a0f3287-a87e-4aa1-ad4e-6e0a8bc61064 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:13.289212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a0f3287-a87e-4aa1-ad4e-6e0a8bc61064 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:13.289889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a0f3287-a87e-4aa1-ad4e-6e0a8bc61064 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:13.290333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a0f3287-a87e-4aa1-ad4e-6e0a8bc61064 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:13.290746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a0f3287-a87e-4aa1-ad4e-6e0a8bc61064 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:13.350993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9a0f3287-a87e-4aa1-ad4e-6e0a8bc61064 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:13.358635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9a0f3287-a87e-4aa1-ad4e-6e0a8bc61064 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.082264 Aug 31 00:30:13.359217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 426/818] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:13 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:14.380444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a5ea5fee-cf9e-49ec-b12b-a32084caa9a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:14.381149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a5ea5fee-cf9e-49ec-b12b-a32084caa9a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:14.387590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5ea5fee-cf9e-49ec-b12b-a32084caa9a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:14.388067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5ea5fee-cf9e-49ec-b12b-a32084caa9a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:14.388500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5ea5fee-cf9e-49ec-b12b-a32084caa9a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:14.389192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5ea5fee-cf9e-49ec-b12b-a32084caa9a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:14.389644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5ea5fee-cf9e-49ec-b12b-a32084caa9a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:14.390064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5ea5fee-cf9e-49ec-b12b-a32084caa9a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:14.457681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a5ea5fee-cf9e-49ec-b12b-a32084caa9a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:14.465419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a5ea5fee-cf9e-49ec-b12b-a32084caa9a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.089480 Aug 31 00:30:14.465976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 427/819] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:14 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:15.486507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2084c205-de7c-44ad-b539-2e8f15e06b7a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:15.487224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2084c205-de7c-44ad-b539-2e8f15e06b7a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:15.493856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2084c205-de7c-44ad-b539-2e8f15e06b7a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:15.494343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2084c205-de7c-44ad-b539-2e8f15e06b7a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:15.494780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2084c205-de7c-44ad-b539-2e8f15e06b7a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:15.495499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2084c205-de7c-44ad-b539-2e8f15e06b7a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:15.495959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2084c205-de7c-44ad-b539-2e8f15e06b7a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:15.496378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2084c205-de7c-44ad-b539-2e8f15e06b7a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:15.558862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2084c205-de7c-44ad-b539-2e8f15e06b7a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:15.566677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2084c205-de7c-44ad-b539-2e8f15e06b7a tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084082 Aug 31 00:30:15.568097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 428/820] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:15 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:16.592945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-53d71f24-7d51-4b4a-ada8-afc31f017296 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:16.593648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-53d71f24-7d51-4b4a-ada8-afc31f017296 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:16.601177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53d71f24-7d51-4b4a-ada8-afc31f017296 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:16.601658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53d71f24-7d51-4b4a-ada8-afc31f017296 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:16.602093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53d71f24-7d51-4b4a-ada8-afc31f017296 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:16.602778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53d71f24-7d51-4b4a-ada8-afc31f017296 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:16.603272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53d71f24-7d51-4b4a-ada8-afc31f017296 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:16.603694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53d71f24-7d51-4b4a-ada8-afc31f017296 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:16.665161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-53d71f24-7d51-4b4a-ada8-afc31f017296 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:16.672859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-53d71f24-7d51-4b4a-ada8-afc31f017296 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083756 Aug 31 00:30:16.673419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 429/821] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:16 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:17.694796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4e46193-749c-4710-9aa5-64b38731d4f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:17.695514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4e46193-749c-4710-9aa5-64b38731d4f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:17.701852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4e46193-749c-4710-9aa5-64b38731d4f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:17.702356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4e46193-749c-4710-9aa5-64b38731d4f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:17.702787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4e46193-749c-4710-9aa5-64b38731d4f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:17.703501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4e46193-749c-4710-9aa5-64b38731d4f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:17.703957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4e46193-749c-4710-9aa5-64b38731d4f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:17.704373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4e46193-749c-4710-9aa5-64b38731d4f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:17.765420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f4e46193-749c-4710-9aa5-64b38731d4f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:17.773113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4e46193-749c-4710-9aa5-64b38731d4f6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083236 Aug 31 00:30:17.773668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 430/822] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:17 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:18.794336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1586492d-7397-4e88-a292-bcba84a71e19 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:18.795051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1586492d-7397-4e88-a292-bcba84a71e19 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:18.801422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1586492d-7397-4e88-a292-bcba84a71e19 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:18.801903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1586492d-7397-4e88-a292-bcba84a71e19 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:18.802338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1586492d-7397-4e88-a292-bcba84a71e19 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:18.803025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1586492d-7397-4e88-a292-bcba84a71e19 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:18.803504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1586492d-7397-4e88-a292-bcba84a71e19 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:18.803924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1586492d-7397-4e88-a292-bcba84a71e19 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:18.870492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1586492d-7397-4e88-a292-bcba84a71e19 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:18.878402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1586492d-7397-4e88-a292-bcba84a71e19 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.088056 Aug 31 00:30:18.878958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 431/823] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:18 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:19.899164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-76e01ba8-e978-445a-893d-10634d20b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:19.899846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-76e01ba8-e978-445a-893d-10634d20b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:19.906228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76e01ba8-e978-445a-893d-10634d20b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:19.906714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76e01ba8-e978-445a-893d-10634d20b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:19.907194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76e01ba8-e978-445a-893d-10634d20b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:19.907885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76e01ba8-e978-445a-893d-10634d20b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:19.908338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76e01ba8-e978-445a-893d-10634d20b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:19.908759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76e01ba8-e978-445a-893d-10634d20b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:19.971118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-76e01ba8-e978-445a-893d-10634d20b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:19.978897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-76e01ba8-e978-445a-893d-10634d20b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083985 Aug 31 00:30:19.979481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 432/824] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:19 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:21.000770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ff716b7-8c11-49f6-9f13-0a6f4c8d4985 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:21.001355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ff716b7-8c11-49f6-9f13-0a6f4c8d4985 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:21.008077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ff716b7-8c11-49f6-9f13-0a6f4c8d4985 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:21.008550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ff716b7-8c11-49f6-9f13-0a6f4c8d4985 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:21.008974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ff716b7-8c11-49f6-9f13-0a6f4c8d4985 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:21.009649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ff716b7-8c11-49f6-9f13-0a6f4c8d4985 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:21.010095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ff716b7-8c11-49f6-9f13-0a6f4c8d4985 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:21.010510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ff716b7-8c11-49f6-9f13-0a6f4c8d4985 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:21.073067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ff716b7-8c11-49f6-9f13-0a6f4c8d4985 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:21.080711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ff716b7-8c11-49f6-9f13-0a6f4c8d4985 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083960 Aug 31 00:30:21.081273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 433/825] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:20 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:22.102617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5c1fbac6-9d88-4f64-82ab-a0cada4d7f4f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:22.103291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5c1fbac6-9d88-4f64-82ab-a0cada4d7f4f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:22.109514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1fbac6-9d88-4f64-82ab-a0cada4d7f4f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:22.109985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1fbac6-9d88-4f64-82ab-a0cada4d7f4f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:22.110408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1fbac6-9d88-4f64-82ab-a0cada4d7f4f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:22.111108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1fbac6-9d88-4f64-82ab-a0cada4d7f4f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:22.111553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1fbac6-9d88-4f64-82ab-a0cada4d7f4f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:22.111971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1fbac6-9d88-4f64-82ab-a0cada4d7f4f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:22.174281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5c1fbac6-9d88-4f64-82ab-a0cada4d7f4f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:22.182168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5c1fbac6-9d88-4f64-82ab-a0cada4d7f4f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084135 Aug 31 00:30:22.182724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 434/826] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:22 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:23.202715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9e3b9701-9e9f-4f7f-b44d-03676d7398c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:23.203386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9e3b9701-9e9f-4f7f-b44d-03676d7398c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:23.210463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e3b9701-9e9f-4f7f-b44d-03676d7398c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:23.210937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e3b9701-9e9f-4f7f-b44d-03676d7398c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:23.211393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e3b9701-9e9f-4f7f-b44d-03676d7398c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:23.212065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e3b9701-9e9f-4f7f-b44d-03676d7398c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:23.212508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e3b9701-9e9f-4f7f-b44d-03676d7398c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:23.212919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e3b9701-9e9f-4f7f-b44d-03676d7398c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:23.277445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9e3b9701-9e9f-4f7f-b44d-03676d7398c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:23.285315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9e3b9701-9e9f-4f7f-b44d-03676d7398c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086552 Aug 31 00:30:23.285881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 435/827] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:23 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:24.308972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd907fe5-bb0b-46b1-823d-91d10e32fd8f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:24.309637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dd907fe5-bb0b-46b1-823d-91d10e32fd8f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:24.316072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd907fe5-bb0b-46b1-823d-91d10e32fd8f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:24.316556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd907fe5-bb0b-46b1-823d-91d10e32fd8f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:24.316992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd907fe5-bb0b-46b1-823d-91d10e32fd8f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:24.318549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd907fe5-bb0b-46b1-823d-91d10e32fd8f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:24.319137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd907fe5-bb0b-46b1-823d-91d10e32fd8f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:24.319569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd907fe5-bb0b-46b1-823d-91d10e32fd8f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:24.380665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dd907fe5-bb0b-46b1-823d-91d10e32fd8f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:24.388376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dd907fe5-bb0b-46b1-823d-91d10e32fd8f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083378 Aug 31 00:30:24.388930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 436/828] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:24 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:25.409152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c64659fe-f1ca-4424-8fb6-8cd972ebd2fa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:25.409820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c64659fe-f1ca-4424-8fb6-8cd972ebd2fa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:25.412802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=65 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:25.418705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c64659fe-f1ca-4424-8fb6-8cd972ebd2fa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:25.419150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c64659fe-f1ca-4424-8fb6-8cd972ebd2fa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:25.419583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c64659fe-f1ca-4424-8fb6-8cd972ebd2fa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:25.420262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c64659fe-f1ca-4424-8fb6-8cd972ebd2fa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:25.420703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c64659fe-f1ca-4424-8fb6-8cd972ebd2fa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:25.421114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c64659fe-f1ca-4424-8fb6-8cd972ebd2fa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:25.482446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c64659fe-f1ca-4424-8fb6-8cd972ebd2fa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:25.490336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c64659fe-f1ca-4424-8fb6-8cd972ebd2fa tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085186 Aug 31 00:30:25.490891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 437/829] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:25 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:26.511145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eb4034c6-0250-48a7-bcba-9992df72c26b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:26.511848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eb4034c6-0250-48a7-bcba-9992df72c26b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:26.518134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb4034c6-0250-48a7-bcba-9992df72c26b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:26.518614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb4034c6-0250-48a7-bcba-9992df72c26b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:26.519063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb4034c6-0250-48a7-bcba-9992df72c26b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:26.519755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb4034c6-0250-48a7-bcba-9992df72c26b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:26.520204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb4034c6-0250-48a7-bcba-9992df72c26b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:26.520815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb4034c6-0250-48a7-bcba-9992df72c26b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:26.539707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:26.583364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eb4034c6-0250-48a7-bcba-9992df72c26b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:26.591250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eb4034c6-0250-48a7-bcba-9992df72c26b tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084081 Aug 31 00:30:26.591813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 438/830] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:26 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:27.612761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-99de8fcb-290d-4fe6-b5da-37057c356693 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:27.613436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-99de8fcb-290d-4fe6-b5da-37057c356693 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:27.620645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99de8fcb-290d-4fe6-b5da-37057c356693 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:27.621287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99de8fcb-290d-4fe6-b5da-37057c356693 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:27.621790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99de8fcb-290d-4fe6-b5da-37057c356693 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:27.622478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99de8fcb-290d-4fe6-b5da-37057c356693 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:27.622924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99de8fcb-290d-4fe6-b5da-37057c356693 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:27.623364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99de8fcb-290d-4fe6-b5da-37057c356693 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:27.688601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-99de8fcb-290d-4fe6-b5da-37057c356693 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:27.698668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-99de8fcb-290d-4fe6-b5da-37057c356693 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.089752 Aug 31 00:30:27.699257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 439/831] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:27 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:28.719567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5e90b703-2787-42aa-b89d-aba6ef4cecd7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:28.720274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5e90b703-2787-42aa-b89d-aba6ef4cecd7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:28.726744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e90b703-2787-42aa-b89d-aba6ef4cecd7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:28.727283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e90b703-2787-42aa-b89d-aba6ef4cecd7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:28.727730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e90b703-2787-42aa-b89d-aba6ef4cecd7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:28.728398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e90b703-2787-42aa-b89d-aba6ef4cecd7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:28.728850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e90b703-2787-42aa-b89d-aba6ef4cecd7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:28.729270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e90b703-2787-42aa-b89d-aba6ef4cecd7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:28.845907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5e90b703-2787-42aa-b89d-aba6ef4cecd7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:28.854006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5e90b703-2787-42aa-b89d-aba6ef4cecd7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.138427 Aug 31 00:30:28.854597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 440/832] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:28 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:29.875387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-65712471-8194-469e-8db9-c1ba365b9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:29.876008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-65712471-8194-469e-8db9-c1ba365b9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:29.882861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65712471-8194-469e-8db9-c1ba365b9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:29.883379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65712471-8194-469e-8db9-c1ba365b9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:29.883820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65712471-8194-469e-8db9-c1ba365b9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:29.884511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65712471-8194-469e-8db9-c1ba365b9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:29.884967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65712471-8194-469e-8db9-c1ba365b9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:29.885392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65712471-8194-469e-8db9-c1ba365b9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:29.947594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-65712471-8194-469e-8db9-c1ba365b9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:29.955257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-65712471-8194-469e-8db9-c1ba365b9aa7 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083836 Aug 31 00:30:29.955822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 441/833] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:29 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:30.978964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4d38a63a-edee-4aa2-8245-15f1eee992b2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:30.979658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4d38a63a-edee-4aa2-8245-15f1eee992b2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:30.988598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d38a63a-edee-4aa2-8245-15f1eee992b2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:30.989180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d38a63a-edee-4aa2-8245-15f1eee992b2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:30.989624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d38a63a-edee-4aa2-8245-15f1eee992b2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:30.990397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d38a63a-edee-4aa2-8245-15f1eee992b2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:30.990853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d38a63a-edee-4aa2-8245-15f1eee992b2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:30.991294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d38a63a-edee-4aa2-8245-15f1eee992b2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:31.053020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4d38a63a-edee-4aa2-8245-15f1eee992b2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:31.060745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4d38a63a-edee-4aa2-8245-15f1eee992b2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.087833 Aug 31 00:30:31.061338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 442/834] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:30 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:32.081981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5a353761-97b2-40b5-86e8-c16c5c5552ad tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:32.082609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5a353761-97b2-40b5-86e8-c16c5c5552ad tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:32.089537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a353761-97b2-40b5-86e8-c16c5c5552ad tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:32.090050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a353761-97b2-40b5-86e8-c16c5c5552ad tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:32.090480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a353761-97b2-40b5-86e8-c16c5c5552ad tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:32.091192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a353761-97b2-40b5-86e8-c16c5c5552ad tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:32.091639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a353761-97b2-40b5-86e8-c16c5c5552ad tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:32.092049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a353761-97b2-40b5-86e8-c16c5c5552ad tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:32.155914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a353761-97b2-40b5-86e8-c16c5c5552ad tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:32.165056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5a353761-97b2-40b5-86e8-c16c5c5552ad tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086676 Aug 31 00:30:32.165609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 443/835] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:32 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:33.185631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ffc3acf3-eba7-4a02-98b7-1f333ac4b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:33.186246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ffc3acf3-eba7-4a02-98b7-1f333ac4b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:33.193327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc3acf3-eba7-4a02-98b7-1f333ac4b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:33.193818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc3acf3-eba7-4a02-98b7-1f333ac4b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:33.194257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc3acf3-eba7-4a02-98b7-1f333ac4b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:33.194936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc3acf3-eba7-4a02-98b7-1f333ac4b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:33.195440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc3acf3-eba7-4a02-98b7-1f333ac4b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:33.195859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc3acf3-eba7-4a02-98b7-1f333ac4b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:33.257294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ffc3acf3-eba7-4a02-98b7-1f333ac4b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:33.265041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ffc3acf3-eba7-4a02-98b7-1f333ac4b5db tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083465 Aug 31 00:30:33.265604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 444/836] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:33 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:34.287753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ce33ef2a-9193-46ee-8623-8f68563b676c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:34.288489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ce33ef2a-9193-46ee-8623-8f68563b676c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:34.298749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce33ef2a-9193-46ee-8623-8f68563b676c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:34.299285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce33ef2a-9193-46ee-8623-8f68563b676c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:34.299725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce33ef2a-9193-46ee-8623-8f68563b676c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:34.300434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce33ef2a-9193-46ee-8623-8f68563b676c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:34.300891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce33ef2a-9193-46ee-8623-8f68563b676c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:34.301316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce33ef2a-9193-46ee-8623-8f68563b676c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:34.386083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ce33ef2a-9193-46ee-8623-8f68563b676c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:34.393787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ce33ef2a-9193-46ee-8623-8f68563b676c tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.111672 Aug 31 00:30:34.394341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 445/837] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:34 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:35.416030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-01138a3d-86e7-4eb5-8bf9-cbca6cb4f1a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:35.416718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-01138a3d-86e7-4eb5-8bf9-cbca6cb4f1a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:35.423008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01138a3d-86e7-4eb5-8bf9-cbca6cb4f1a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:35.423509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01138a3d-86e7-4eb5-8bf9-cbca6cb4f1a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:35.423934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01138a3d-86e7-4eb5-8bf9-cbca6cb4f1a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:35.424614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01138a3d-86e7-4eb5-8bf9-cbca6cb4f1a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:35.425057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01138a3d-86e7-4eb5-8bf9-cbca6cb4f1a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:35.425466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01138a3d-86e7-4eb5-8bf9-cbca6cb4f1a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:35.488660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01138a3d-86e7-4eb5-8bf9-cbca6cb4f1a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:35.497275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-01138a3d-86e7-4eb5-8bf9-cbca6cb4f1a6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086196 Aug 31 00:30:35.497832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 446/838] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:35 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:36.518284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-add7916c-ee2a-43da-ac24-aaa17fd1c283 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:36.518957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-add7916c-ee2a-43da-ac24-aaa17fd1c283 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:36.526586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-add7916c-ee2a-43da-ac24-aaa17fd1c283 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:36.527080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-add7916c-ee2a-43da-ac24-aaa17fd1c283 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:36.527512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-add7916c-ee2a-43da-ac24-aaa17fd1c283 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:36.528190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-add7916c-ee2a-43da-ac24-aaa17fd1c283 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:36.528635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-add7916c-ee2a-43da-ac24-aaa17fd1c283 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:36.529047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-add7916c-ee2a-43da-ac24-aaa17fd1c283 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:36.592988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-add7916c-ee2a-43da-ac24-aaa17fd1c283 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:36.601552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-add7916c-ee2a-43da-ac24-aaa17fd1c283 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086117 Aug 31 00:30:36.602114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 447/839] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:36 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:37.622011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4648c2a1-57d9-4acb-a571-71887a239d44 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:37.622692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4648c2a1-57d9-4acb-a571-71887a239d44 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:37.629046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4648c2a1-57d9-4acb-a571-71887a239d44 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:37.629502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4648c2a1-57d9-4acb-a571-71887a239d44 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:37.629934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4648c2a1-57d9-4acb-a571-71887a239d44 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:37.630657 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4648c2a1-57d9-4acb-a571-71887a239d44 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:37.631134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4648c2a1-57d9-4acb-a571-71887a239d44 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:37.631560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4648c2a1-57d9-4acb-a571-71887a239d44 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:37.694659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4648c2a1-57d9-4acb-a571-71887a239d44 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:37.702491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4648c2a1-57d9-4acb-a571-71887a239d44 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084380 Aug 31 00:30:37.703072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 448/840] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:37 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:38.725293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6a95436d-be65-439b-9823-2e4a9b2ad9ae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:38.725971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6a95436d-be65-439b-9823-2e4a9b2ad9ae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:38.732394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a95436d-be65-439b-9823-2e4a9b2ad9ae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:38.732876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a95436d-be65-439b-9823-2e4a9b2ad9ae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:38.733305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a95436d-be65-439b-9823-2e4a9b2ad9ae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:38.733995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a95436d-be65-439b-9823-2e4a9b2ad9ae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:38.734450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a95436d-be65-439b-9823-2e4a9b2ad9ae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:38.734874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a95436d-be65-439b-9823-2e4a9b2ad9ae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:38.796564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6a95436d-be65-439b-9823-2e4a9b2ad9ae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:38.805018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6a95436d-be65-439b-9823-2e4a9b2ad9ae tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084257 Aug 31 00:30:38.805578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 449/841] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:38 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:39.825850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b3817cc3-b256-4f1e-92bc-e906480adaea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:39.826491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b3817cc3-b256-4f1e-92bc-e906480adaea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:39.832839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3817cc3-b256-4f1e-92bc-e906480adaea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.833319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3817cc3-b256-4f1e-92bc-e906480adaea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.833875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3817cc3-b256-4f1e-92bc-e906480adaea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.834563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3817cc3-b256-4f1e-92bc-e906480adaea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.835013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3817cc3-b256-4f1e-92bc-e906480adaea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.835460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3817cc3-b256-4f1e-92bc-e906480adaea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.897796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b3817cc3-b256-4f1e-92bc-e906480adaea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:39.905668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b3817cc3-b256-4f1e-92bc-e906480adaea tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083722 Aug 31 00:30:39.906230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 450/842] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:39 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:40.927197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5ba87e05-6538-47a9-b569-160ebf4efd1d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:40.927835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5ba87e05-6538-47a9-b569-160ebf4efd1d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:40.935521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ba87e05-6538-47a9-b569-160ebf4efd1d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:40.936012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ba87e05-6538-47a9-b569-160ebf4efd1d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:40.936449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ba87e05-6538-47a9-b569-160ebf4efd1d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:40.937152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ba87e05-6538-47a9-b569-160ebf4efd1d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:40.937609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ba87e05-6538-47a9-b569-160ebf4efd1d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:40.938031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ba87e05-6538-47a9-b569-160ebf4efd1d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:41.004054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5ba87e05-6538-47a9-b569-160ebf4efd1d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:41.012404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5ba87e05-6538-47a9-b569-160ebf4efd1d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.089154 Aug 31 00:30:41.012975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 451/843] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:40 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:42.033448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4c8177d4-be47-458d-bb2b-1dda534ece0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:42.034114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4c8177d4-be47-458d-bb2b-1dda534ece0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:42.040963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c8177d4-be47-458d-bb2b-1dda534ece0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:42.041449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c8177d4-be47-458d-bb2b-1dda534ece0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:42.041873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c8177d4-be47-458d-bb2b-1dda534ece0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:42.042555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c8177d4-be47-458d-bb2b-1dda534ece0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:42.043002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c8177d4-be47-458d-bb2b-1dda534ece0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:42.043446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c8177d4-be47-458d-bb2b-1dda534ece0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:42.109331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4c8177d4-be47-458d-bb2b-1dda534ece0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:42.118158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4c8177d4-be47-458d-bb2b-1dda534ece0e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.088662 Aug 31 00:30:42.118999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 452/844] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:42 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:43.139989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9b3d36eb-c485-4620-a185-01303d0db248 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:43.140655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9b3d36eb-c485-4620-a185-01303d0db248 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:43.147104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3d36eb-c485-4620-a185-01303d0db248 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:43.147579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3d36eb-c485-4620-a185-01303d0db248 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:43.148005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3d36eb-c485-4620-a185-01303d0db248 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:43.148681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3d36eb-c485-4620-a185-01303d0db248 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:43.149124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3d36eb-c485-4620-a185-01303d0db248 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:43.149540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3d36eb-c485-4620-a185-01303d0db248 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:43.211275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9b3d36eb-c485-4620-a185-01303d0db248 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:43.219211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9b3d36eb-c485-4620-a185-01303d0db248 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083040 Aug 31 00:30:43.219774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 453/845] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:43 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:44.240956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3972a459-fb15-4442-9bb0-8c52f4ad5cb6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:44.241687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3972a459-fb15-4442-9bb0-8c52f4ad5cb6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:44.248003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3972a459-fb15-4442-9bb0-8c52f4ad5cb6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:44.248419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3972a459-fb15-4442-9bb0-8c52f4ad5cb6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:44.248850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3972a459-fb15-4442-9bb0-8c52f4ad5cb6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:44.249531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3972a459-fb15-4442-9bb0-8c52f4ad5cb6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:44.249979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3972a459-fb15-4442-9bb0-8c52f4ad5cb6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:44.250400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3972a459-fb15-4442-9bb0-8c52f4ad5cb6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:44.311178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3972a459-fb15-4442-9bb0-8c52f4ad5cb6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:44.319687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3972a459-fb15-4442-9bb0-8c52f4ad5cb6 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083074 Aug 31 00:30:44.320244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 454/846] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:44 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:45.340619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ae755b04-7ee1-498c-b5cf-b5ad7cad3f17 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:45.341291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ae755b04-7ee1-498c-b5cf-b5ad7cad3f17 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:45.347670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae755b04-7ee1-498c-b5cf-b5ad7cad3f17 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:45.348150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae755b04-7ee1-498c-b5cf-b5ad7cad3f17 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:45.348586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae755b04-7ee1-498c-b5cf-b5ad7cad3f17 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:45.349270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae755b04-7ee1-498c-b5cf-b5ad7cad3f17 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:45.349789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae755b04-7ee1-498c-b5cf-b5ad7cad3f17 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:45.350209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae755b04-7ee1-498c-b5cf-b5ad7cad3f17 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:45.354238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:45.414701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ae755b04-7ee1-498c-b5cf-b5ad7cad3f17 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:45.422929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ae755b04-7ee1-498c-b5cf-b5ad7cad3f17 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086166 Aug 31 00:30:45.423539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 455/847] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:45 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:46.444259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-db22703f-e2b6-4c5d-9727-9940df0015bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:46.446407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-db22703f-e2b6-4c5d-9727-9940df0015bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:46.452206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db22703f-e2b6-4c5d-9727-9940df0015bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:46.452691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db22703f-e2b6-4c5d-9727-9940df0015bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:46.453127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db22703f-e2b6-4c5d-9727-9940df0015bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:46.453827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db22703f-e2b6-4c5d-9727-9940df0015bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:46.454283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db22703f-e2b6-4c5d-9727-9940df0015bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:46.454705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db22703f-e2b6-4c5d-9727-9940df0015bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:46.557585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-db22703f-e2b6-4c5d-9727-9940df0015bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:46.565169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-db22703f-e2b6-4c5d-9727-9940df0015bc tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.124778 Aug 31 00:30:46.565731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 456/848] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:46 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:47.586913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3713a175-8735-4be8-8df4-7329eb7d70a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:47.587629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3713a175-8735-4be8-8df4-7329eb7d70a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:47.593950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3713a175-8735-4be8-8df4-7329eb7d70a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:47.594426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3713a175-8735-4be8-8df4-7329eb7d70a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:47.594853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3713a175-8735-4be8-8df4-7329eb7d70a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:47.595569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3713a175-8735-4be8-8df4-7329eb7d70a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:47.596018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3713a175-8735-4be8-8df4-7329eb7d70a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:47.596435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3713a175-8735-4be8-8df4-7329eb7d70a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:47.658695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3713a175-8735-4be8-8df4-7329eb7d70a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:47.667556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3713a175-8735-4be8-8df4-7329eb7d70a3 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084488 Aug 31 00:30:47.667994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 457/849] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:47 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:48.689243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c79b422f-6bd4-4bd3-a446-7d70f29aa357 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:48.690039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c79b422f-6bd4-4bd3-a446-7d70f29aa357 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:48.696895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c79b422f-6bd4-4bd3-a446-7d70f29aa357 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:48.697374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c79b422f-6bd4-4bd3-a446-7d70f29aa357 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:48.697801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c79b422f-6bd4-4bd3-a446-7d70f29aa357 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:48.698488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c79b422f-6bd4-4bd3-a446-7d70f29aa357 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:48.698935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c79b422f-6bd4-4bd3-a446-7d70f29aa357 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:48.699383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c79b422f-6bd4-4bd3-a446-7d70f29aa357 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:48.763521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c79b422f-6bd4-4bd3-a446-7d70f29aa357 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:48.771264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c79b422f-6bd4-4bd3-a446-7d70f29aa357 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.085943 Aug 31 00:30:48.771920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 458/850] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:48 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:49.793096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c9f07927-4203-4769-b8af-c6e50e70680f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:49.793800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c9f07927-4203-4769-b8af-c6e50e70680f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:49.800207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f07927-4203-4769-b8af-c6e50e70680f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:49.800689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f07927-4203-4769-b8af-c6e50e70680f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:49.801121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f07927-4203-4769-b8af-c6e50e70680f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:49.801805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f07927-4203-4769-b8af-c6e50e70680f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:49.802924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f07927-4203-4769-b8af-c6e50e70680f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:49.803420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9f07927-4203-4769-b8af-c6e50e70680f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:49.867124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c9f07927-4203-4769-b8af-c6e50e70680f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:49.875385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c9f07927-4203-4769-b8af-c6e50e70680f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086513 Aug 31 00:30:49.875949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 459/851] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:49 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:50.896987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d40621a7-f499-4194-9461-d850112b5205 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:50.897661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d40621a7-f499-4194-9461-d850112b5205 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:50.903836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d40621a7-f499-4194-9461-d850112b5205 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:50.904315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d40621a7-f499-4194-9461-d850112b5205 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:50.904749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d40621a7-f499-4194-9461-d850112b5205 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:50.905437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d40621a7-f499-4194-9461-d850112b5205 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:50.905889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d40621a7-f499-4194-9461-d850112b5205 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:50.906311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d40621a7-f499-4194-9461-d850112b5205 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:50.967409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d40621a7-f499-4194-9461-d850112b5205 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:50.975530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d40621a7-f499-4194-9461-d850112b5205 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.082825 Aug 31 00:30:50.976100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 460/852] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:50 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:51.996501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4d0dc10f-de69-4fad-bec2-2e56d54c36c4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:51.997104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4d0dc10f-de69-4fad-bec2-2e56d54c36c4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:52.003494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0dc10f-de69-4fad-bec2-2e56d54c36c4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:52.003966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0dc10f-de69-4fad-bec2-2e56d54c36c4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:52.004391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0dc10f-de69-4fad-bec2-2e56d54c36c4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:52.005066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0dc10f-de69-4fad-bec2-2e56d54c36c4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:52.005507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0dc10f-de69-4fad-bec2-2e56d54c36c4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:52.005918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d0dc10f-de69-4fad-bec2-2e56d54c36c4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:52.069407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4d0dc10f-de69-4fad-bec2-2e56d54c36c4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:52.077198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4d0dc10f-de69-4fad-bec2-2e56d54c36c4 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084546 Aug 31 00:30:52.077758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 461/853] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:51 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:53.099435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9be44ffd-672d-4345-8a8a-d98f5a536e68 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:53.100246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9be44ffd-672d-4345-8a8a-d98f5a536e68 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:53.106702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be44ffd-672d-4345-8a8a-d98f5a536e68 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:53.107227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be44ffd-672d-4345-8a8a-d98f5a536e68 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:53.107665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be44ffd-672d-4345-8a8a-d98f5a536e68 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:53.108364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be44ffd-672d-4345-8a8a-d98f5a536e68 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:53.109104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be44ffd-672d-4345-8a8a-d98f5a536e68 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:53.109527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be44ffd-672d-4345-8a8a-d98f5a536e68 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:53.188421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9be44ffd-672d-4345-8a8a-d98f5a536e68 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:53.196832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9be44ffd-672d-4345-8a8a-d98f5a536e68 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.102284 Aug 31 00:30:53.197390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 462/854] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:53 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:54.219171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-97ce3f23-d4a8-42dd-98f5-a389243ba792 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:54.219850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-97ce3f23-d4a8-42dd-98f5-a389243ba792 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:54.226920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97ce3f23-d4a8-42dd-98f5-a389243ba792 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:54.227433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97ce3f23-d4a8-42dd-98f5-a389243ba792 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:54.227868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97ce3f23-d4a8-42dd-98f5-a389243ba792 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:54.228564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97ce3f23-d4a8-42dd-98f5-a389243ba792 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:54.229019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97ce3f23-d4a8-42dd-98f5-a389243ba792 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:54.229443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97ce3f23-d4a8-42dd-98f5-a389243ba792 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:54.290498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-97ce3f23-d4a8-42dd-98f5-a389243ba792 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:54.298269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-97ce3f23-d4a8-42dd-98f5-a389243ba792 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.083033 Aug 31 00:30:54.298835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 463/855] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:54 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:55.320435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8a6a4a7d-879e-4cc3-a818-0c7b35156dbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:55.321089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8a6a4a7d-879e-4cc3-a818-0c7b35156dbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:55.327455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a6a4a7d-879e-4cc3-a818-0c7b35156dbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:55.327929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a6a4a7d-879e-4cc3-a818-0c7b35156dbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:55.328354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a6a4a7d-879e-4cc3-a818-0c7b35156dbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:55.329099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a6a4a7d-879e-4cc3-a818-0c7b35156dbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:55.329542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a6a4a7d-879e-4cc3-a818-0c7b35156dbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:55.329952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a6a4a7d-879e-4cc3-a818-0c7b35156dbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:55.390663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8a6a4a7d-879e-4cc3-a818-0c7b35156dbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:55.398805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8a6a4a7d-879e-4cc3-a818-0c7b35156dbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.082988 Aug 31 00:30:55.399395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 464/856] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:55 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:56.419919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8dcb6858-42d6-43ac-99a0-7457a0a1fcbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:56.420591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8dcb6858-42d6-43ac-99a0-7457a0a1fcbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:56.422790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=56 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:56.428361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dcb6858-42d6-43ac-99a0-7457a0a1fcbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:56.428842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dcb6858-42d6-43ac-99a0-7457a0a1fcbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:56.429278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dcb6858-42d6-43ac-99a0-7457a0a1fcbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:56.429994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dcb6858-42d6-43ac-99a0-7457a0a1fcbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:56.430422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dcb6858-42d6-43ac-99a0-7457a0a1fcbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:56.430844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dcb6858-42d6-43ac-99a0-7457a0a1fcbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:56.494849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8dcb6858-42d6-43ac-99a0-7457a0a1fcbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:56.502605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8dcb6858-42d6-43ac-99a0-7457a0a1fcbb tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.086559 Aug 31 00:30:56.503830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 465/857] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:56 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:57.524401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b88628fa-b1be-46df-8e28-9aa04725e12f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:57.525066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b88628fa-b1be-46df-8e28-9aa04725e12f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:57.531493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88628fa-b1be-46df-8e28-9aa04725e12f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:57.531970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88628fa-b1be-46df-8e28-9aa04725e12f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:57.532392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88628fa-b1be-46df-8e28-9aa04725e12f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:57.533078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88628fa-b1be-46df-8e28-9aa04725e12f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:57.533538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88628fa-b1be-46df-8e28-9aa04725e12f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:57.533939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88628fa-b1be-46df-8e28-9aa04725e12f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:57.601581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b88628fa-b1be-46df-8e28-9aa04725e12f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:57.609448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b88628fa-b1be-46df-8e28-9aa04725e12f tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.089264 Aug 31 00:30:57.610056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 466/858] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:57 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:57.952203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:30:57.952401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d (ip 10.222.0.67) !!! Aug 31 00:30:57.964426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:57.964949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:57.971313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:57.971796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:57.972236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:57.972946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:57.973373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:57.973791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:07.968739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=5 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:07.993383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=74 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:58.117592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-177d623e-5c61-4568-a659-84dfd9b3a6e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d" status: 202 len: 0 microversion: 2.20 time: 120.282526 Aug 31 00:31:58.118157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 393/859] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 31 00:29:57 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d => generated 0 bytes in 120284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:31:58.123760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4fcce9ff-e50e-4da1-b416-8dec3079e786 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:58.124443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4fcce9ff-e50e-4da1-b416-8dec3079e786 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:58.131103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcce9ff-e50e-4da1-b416-8dec3079e786 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:58.131592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcce9ff-e50e-4da1-b416-8dec3079e786 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:58.132151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcce9ff-e50e-4da1-b416-8dec3079e786 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:58.132716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcce9ff-e50e-4da1-b416-8dec3079e786 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:58.133877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcce9ff-e50e-4da1-b416-8dec3079e786 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:58.133877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcce9ff-e50e-4da1-b416-8dec3079e786 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:58.177974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'services' on Instance uuid 02e4497e-f74f-4b4e-aac6-88c39ead5f38 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:31:58.205922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4fcce9ff-e50e-4da1-b416-8dec3079e786 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:31:58.215216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4fcce9ff-e50e-4da1-b416-8dec3079e786 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.095913 Aug 31 00:31:58.215774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 394/860] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:31:58 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:58.220418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:58.220895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:58.226531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:58.227226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:58.227835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:58.228842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:58.234272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:58.234745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:58.850530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f33c2fd2-fed8-4d5a-83f4-4ecdbb478186) Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d HTTP/1.1 Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:31:58.853315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:31:58.854848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:31:58.854848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:31:58.854848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:31:58.854848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:31:58.854848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:31:58.854848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:31:58.854848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:31:58.854848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 00:31:58.854848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:31:58.854848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f33c2fd2-fed8-4d5a-83f4-4ecdbb478186) Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '02e4497e-f74f-4b4e-aac6-88c39ead5f38', 'id': 'bff329ef-5896-4a6e-94ab-1f26ac09a59d'} Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:31:58.855755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f33c2fd2-fed8-4d5a-83f4-4ecdbb478186) Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:31:58.856910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f33c2fd2-fed8-4d5a-83f4-4ecdbb478186) Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:58.858099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f33c2fd2-fed8-4d5a-83f4-4ecdbb478186) Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:58.859179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f33c2fd2-fed8-4d5a-83f4-4ecdbb478186) Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f33c2fd2-fed8-4d5a-83f4-4ecdbb478186) Aug 31 00:31:58.860363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:31:58.861485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f33c2fd2-fed8-4d5a-83f4-4ecdbb478186) {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:31:58.861485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-da04f6ba-4d61-4bc2-82af-f35eaf532a72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d" status: 400 len: 269 microversion: 2.20 time: 60.960309 Aug 31 00:31:58.861485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 467/861] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 31 00:30:57 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d => generated 269 bytes in 60962 msecs (HTTP/1.1 400) 9 headers in 383 bytes (2 switches on core 0) Aug 31 00:31:58.861485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cf605a43-05ee-4e66-95fb-91c06981dadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:58.861787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cf605a43-05ee-4e66-95fb-91c06981dadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:31:58.867559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf605a43-05ee-4e66-95fb-91c06981dadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:58.868045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf605a43-05ee-4e66-95fb-91c06981dadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:58.868477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf605a43-05ee-4e66-95fb-91c06981dadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:58.869166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf605a43-05ee-4e66-95fb-91c06981dadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:31:58.869625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf605a43-05ee-4e66-95fb-91c06981dadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:31:58.870043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf605a43-05ee-4e66-95fb-91c06981dadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:31:58.906114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'services' on Instance uuid 02e4497e-f74f-4b4e-aac6-88c39ead5f38 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:32:08.224415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:08.865096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:08.888811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=8 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:08.910297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:36.821349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:32:36.822999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d (ip 10.222.0.67) !!! Aug 31 00:32:36.822999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:32:36.822999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d (ip 10.222.0.67) !!! Aug 31 00:32:37.950671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:32:37.951310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:32:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a (ip 10.222.0.67) !!! Aug 31 00:32:58.823866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:32:58.824585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:32:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a (ip 10.222.0.67) !!! Aug 31 00:33:58.453679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-cf605a43-05ee-4e66-95fb-91c06981dadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'services' on Instance uuid 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:33:58.482783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e524fac6-0a1b-43f3-b8eb-42152f99e5e8) Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d HTTP/1.1 Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:33:58.485700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:33:58.487734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:33:58.487734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:33:58.487734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:33:58.487734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:33:58.487734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:33:58.487734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:33:58.487734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:33:58.487734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 00:33:58.487734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:33:58.487734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e524fac6-0a1b-43f3-b8eb-42152f99e5e8) Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '02e4497e-f74f-4b4e-aac6-88c39ead5f38', 'id': 'bff329ef-5896-4a6e-94ab-1f26ac09a59d'} Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:33:58.489515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e524fac6-0a1b-43f3-b8eb-42152f99e5e8) Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:33:58.492556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e524fac6-0a1b-43f3-b8eb-42152f99e5e8) Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:58.494956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e524fac6-0a1b-43f3-b8eb-42152f99e5e8) Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:33:58.496786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e524fac6-0a1b-43f3-b8eb-42152f99e5e8) Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e524fac6-0a1b-43f3-b8eb-42152f99e5e8) Aug 31 00:33:58.498753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:33:58.500647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e524fac6-0a1b-43f3-b8eb-42152f99e5e8) {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:33:58.500647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ef987eb1-767c-4a88-b7b1-32c39bb3856f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d" status: 400 len: 269 microversion: 2.20 time: 120.270404 Aug 31 00:33:58.500647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 395/862] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 31 00:31:58 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d => generated 269 bytes in 120271 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Aug 31 00:33:58.567192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6bdfcb59-d1ed-4f77-92a0-0d430e4bc1c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:58.567807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6bdfcb59-d1ed-4f77-92a0-0d430e4bc1c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:58.574260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bdfcb59-d1ed-4f77-92a0-0d430e4bc1c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:58.574826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bdfcb59-d1ed-4f77-92a0-0d430e4bc1c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:58.575217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bdfcb59-d1ed-4f77-92a0-0d430e4bc1c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:58.575907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bdfcb59-d1ed-4f77-92a0-0d430e4bc1c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:58.576359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bdfcb59-d1ed-4f77-92a0-0d430e4bc1c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:58.576781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bdfcb59-d1ed-4f77-92a0-0d430e4bc1c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:58.643849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6bdfcb59-d1ed-4f77-92a0-0d430e4bc1c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:33:58.651994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6bdfcb59-d1ed-4f77-92a0-0d430e4bc1c2 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.163354 Aug 31 00:33:58.652643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 396/863] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:33:58 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:33:58.658381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:58.658879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:58.664922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:58.666666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:58.666666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:58.666666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:58.667203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:58.667388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:58.985270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cf605a43-05ee-4e66-95fb-91c06981dadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a" status: 202 len: 0 microversion: 2.1 time: 120.128690 Aug 31 00:33:58.986309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 468/864] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:31:58 2022] DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a => generated 0 bytes in 120130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:33:58.996798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:58.997234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:33:59.004930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:59.005484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:59.006048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:59.006831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:59.007420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:59.007834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:59.085921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'services' on Instance uuid 02e4497e-f74f-4b4e-aac6-88c39ead5f38 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:34:08.662943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:09.002386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:09.041676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:09.090671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=14 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:17.961652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:34:17.962279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:34:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a (ip 10.222.0.67) !!! Aug 31 00:34:22.759502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:34:22.760129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:34:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d (ip 10.222.0.67) !!! Aug 31 00:35:56.833241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:35:56.833961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:35:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d (ip 10.222.0.67) !!! Aug 31 00:35:56.834507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:35:56.834630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:35:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d (ip 10.222.0.67) !!! Aug 31 00:35:57.962145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:35:57.962753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:35:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a (ip 10.222.0.67) !!! Aug 31 00:35:58.800344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'services' on Instance uuid 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:35:58.940558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f59fd888-3b76-4e2f-84c1-094c9b9a799b) Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d HTTP/1.1 Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:35:58.942830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:35:58.944440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:35:58.944440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:35:58.944440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:35:58.944440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:35:58.944440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:35:58.944440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:35:58.944440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:35:58.944440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 00:35:58.944440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:35:58.944440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f59fd888-3b76-4e2f-84c1-094c9b9a799b) Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '02e4497e-f74f-4b4e-aac6-88c39ead5f38', 'id': 'bff329ef-5896-4a6e-94ab-1f26ac09a59d'} Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:35:58.945564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f59fd888-3b76-4e2f-84c1-094c9b9a799b) Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:35:58.947096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f59fd888-3b76-4e2f-84c1-094c9b9a799b) Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:35:58.948268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f59fd888-3b76-4e2f-84c1-094c9b9a799b) Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:35:58.950177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f59fd888-3b76-4e2f-84c1-094c9b9a799b) Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f59fd888-3b76-4e2f-84c1-094c9b9a799b) Aug 31 00:35:58.952598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:35:58.954789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f59fd888-3b76-4e2f-84c1-094c9b9a799b) {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:35:58.954789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5897cf79-8c56-4417-907e-abae7747df51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d" status: 400 len: 269 microversion: 2.20 time: 120.290757 Aug 31 00:35:58.954789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 397/865] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 31 00:33:58 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d => generated 269 bytes in 120292 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Aug 31 00:35:58.954789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-03c63cf6-31de-497d-8a90-bd5fafdf330e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:58.955509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-03c63cf6-31de-497d-8a90-bd5fafdf330e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:58.957717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03c63cf6-31de-497d-8a90-bd5fafdf330e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:58.958197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03c63cf6-31de-497d-8a90-bd5fafdf330e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:58.958640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03c63cf6-31de-497d-8a90-bd5fafdf330e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:58.959350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03c63cf6-31de-497d-8a90-bd5fafdf330e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:58.960364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03c63cf6-31de-497d-8a90-bd5fafdf330e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:58.960846 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03c63cf6-31de-497d-8a90-bd5fafdf330e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.022511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-03c63cf6-31de-497d-8a90-bd5fafdf330e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:59.030236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-03c63cf6-31de-497d-8a90-bd5fafdf330e tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.084219 Aug 31 00:35:59.030785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 398/866] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:58 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:59.035305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:59.035789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:59.042076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.042548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.042977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.043683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.044129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.044544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.185120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ced1e918-f226-4b32-9a7d-28995e7c00b1) Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a HTTP/1.1 Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:35:59.187415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:35:59.188925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:35:59.188925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:35:59.188925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:35:59.188925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:35:59.188925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:35:59.188925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:35:59.188925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:35:59.188925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:35:59.188925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:35:59.188925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ced1e918-f226-4b32-9a7d-28995e7c00b1) Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '2d43efc3-0d4e-4f0c-9242-7d5cf206ae43', 'id': '2a816307-3a33-4d13-9fad-a03edaa2c34a'} Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:35:59.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ced1e918-f226-4b32-9a7d-28995e7c00b1) Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:35:59.190771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ced1e918-f226-4b32-9a7d-28995e7c00b1) Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:35:59.191917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ced1e918-f226-4b32-9a7d-28995e7c00b1) Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:35:59.192925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ced1e918-f226-4b32-9a7d-28995e7c00b1) Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ced1e918-f226-4b32-9a7d-28995e7c00b1) Aug 31 00:35:59.194195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:35:59.195351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ced1e918-f226-4b32-9a7d-28995e7c00b1) {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:35:59.195351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1972b2e9-cfc9-401c-8ba6-356525c81294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a" status: 400 len: 269 microversion: 2.1 time: 120.201948 Aug 31 00:35:59.195351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 469/867] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:33:58 2022] DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a => generated 269 bytes in 120203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:35:59.196747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:59.197236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:59.203233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.203717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.204151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.204845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.205295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.205792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.235930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'services' on Instance uuid 02e4497e-f74f-4b4e-aac6-88c39ead5f38 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:36:09.039273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:09.201173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:09.226011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=8 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:09.240725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=14 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:37.973674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:37:37.974300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:37:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a (ip 10.222.0.67) !!! Aug 31 00:37:42.769589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:37:42.770193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:37:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d (ip 10.222.0.67) !!! Aug 31 00:37:59.131421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'services' on Instance uuid 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:37:59.209833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3c14b721-8221-41ce-87d8-81b0854e6389) Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d HTTP/1.1 Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:37:59.212691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:37:59.214469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:37:59.214469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:37:59.214469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:37:59.214469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:37:59.214469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:37:59.214469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:37:59.214469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:37:59.214469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 00:37:59.214469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:37:59.214469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3c14b721-8221-41ce-87d8-81b0854e6389) Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '02e4497e-f74f-4b4e-aac6-88c39ead5f38', 'id': 'bff329ef-5896-4a6e-94ab-1f26ac09a59d'} Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:37:59.215389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3c14b721-8221-41ce-87d8-81b0854e6389) Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:37:59.216466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3c14b721-8221-41ce-87d8-81b0854e6389) Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.217713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3c14b721-8221-41ce-87d8-81b0854e6389) Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:59.218791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3c14b721-8221-41ce-87d8-81b0854e6389) Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3c14b721-8221-41ce-87d8-81b0854e6389) Aug 31 00:37:59.219940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.221037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3c14b721-8221-41ce-87d8-81b0854e6389) {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:37:59.221037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-94daf67e-d87c-4251-a554-937134f49144 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d" status: 400 len: 269 microversion: 2.20 time: 120.182590 Aug 31 00:37:59.221037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 399/868] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 31 00:35:59 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d => generated 269 bytes in 120184 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Aug 31 00:37:59.251371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4052e715-ced6-4c3d-947a-3c592567c9d8) Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a HTTP/1.1 Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:37:59.260900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:37:59.262692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:37:59.262692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:37:59.262692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:37:59.262692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:37:59.262692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:37:59.262692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:37:59.262692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:37:59.262692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:37:59.262692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:37:59.262692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4052e715-ced6-4c3d-947a-3c592567c9d8) Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '2d43efc3-0d4e-4f0c-9242-7d5cf206ae43', 'id': '2a816307-3a33-4d13-9fad-a03edaa2c34a'} Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:37:59.264696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4052e715-ced6-4c3d-947a-3c592567c9d8) Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:37:59.266150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4052e715-ced6-4c3d-947a-3c592567c9d8) Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.268888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4052e715-ced6-4c3d-947a-3c592567c9d8) Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:59.270277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4052e715-ced6-4c3d-947a-3c592567c9d8) Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4052e715-ced6-4c3d-947a-3c592567c9d8) Aug 31 00:37:59.271835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.273104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4052e715-ced6-4c3d-947a-3c592567c9d8) {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:37:59.273104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d044b8f3-721b-401c-922a-1e7461d284f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a" status: 400 len: 269 microversion: 2.1 time: 120.064988 Aug 31 00:37:59.273104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 470/869] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:35:59 2022] DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a => generated 269 bytes in 120066 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:37:59.368079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dc144bec-6570-430d-a922-37bb096fbd61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.368571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dc144bec-6570-430d-a922-37bb096fbd61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.375690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc144bec-6570-430d-a922-37bb096fbd61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.376173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc144bec-6570-430d-a922-37bb096fbd61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.376604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc144bec-6570-430d-a922-37bb096fbd61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.377294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc144bec-6570-430d-a922-37bb096fbd61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.377743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc144bec-6570-430d-a922-37bb096fbd61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.378162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc144bec-6570-430d-a922-37bb096fbd61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.384401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e3dbbf65-a3bf-47e9-bd98-6fca526a3518 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.386629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e3dbbf65-a3bf-47e9-bd98-6fca526a3518 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.393256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3dbbf65-a3bf-47e9-bd98-6fca526a3518 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.393735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3dbbf65-a3bf-47e9-bd98-6fca526a3518 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.394163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3dbbf65-a3bf-47e9-bd98-6fca526a3518 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.394842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3dbbf65-a3bf-47e9-bd98-6fca526a3518 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.395311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3dbbf65-a3bf-47e9-bd98-6fca526a3518 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.395729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3dbbf65-a3bf-47e9-bd98-6fca526a3518 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.426508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e3dbbf65-a3bf-47e9-bd98-6fca526a3518 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169370 Aug 31 00:37:59.427096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 471/870] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:37:59 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:59.431818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6e740332-5a76-45d9-9c96-d48eee9bf718 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.433095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6e740332-5a76-45d9-9c96-d48eee9bf718 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.440488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e740332-5a76-45d9-9c96-d48eee9bf718 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.440950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e740332-5a76-45d9-9c96-d48eee9bf718 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.441377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e740332-5a76-45d9-9c96-d48eee9bf718 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.442066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e740332-5a76-45d9-9c96-d48eee9bf718 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.442517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e740332-5a76-45d9-9c96-d48eee9bf718 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.442932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6e740332-5a76-45d9-9c96-d48eee9bf718 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.459249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-dc144bec-6570-430d-a922-37bb096fbd61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'services' on Instance uuid 503c21ab-7fcf-41a4-b1b6-58109d0217f3 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:37:59.506853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6e740332-5a76-45d9-9c96-d48eee9bf718 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:59.515945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6e740332-5a76-45d9-9c96-d48eee9bf718 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1225 microversion: 2.1 time: 0.087510 Aug 31 00:37:59.516637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 472/871] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:59 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:59.521814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.522287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.530573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.530573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.530872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.531640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.532239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.532644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.539152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dc144bec-6570-430d-a922-37bb096fbd61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f" status: 202 len: 0 microversion: 2.1 time: 0.322517 Aug 31 00:37:59.539774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 400/872] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:37:59 2022] DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:37:59.547301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.548048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.555502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.556531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.557034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.557923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.558368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.558779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.639290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'services' on Instance uuid 02e4497e-f74f-4b4e-aac6-88c39ead5f38 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:37:59.658729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'services' on Instance uuid 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:37:59.710859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a0333e2-a99f-41bc-9ab3-4cce08d89da0) Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d HTTP/1.1 Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:37:59.713316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:37:59.714868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:37:59.714868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:37:59.714868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:37:59.714868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:37:59.714868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:37:59.714868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:37:59.714868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:37:59.714868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 00:37:59.714868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:37:59.714868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a0333e2-a99f-41bc-9ab3-4cce08d89da0) Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '02e4497e-f74f-4b4e-aac6-88c39ead5f38', 'id': 'bff329ef-5896-4a6e-94ab-1f26ac09a59d'} Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:37:59.715880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a0333e2-a99f-41bc-9ab3-4cce08d89da0) Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:37:59.716977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a0333e2-a99f-41bc-9ab3-4cce08d89da0) Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.718239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a0333e2-a99f-41bc-9ab3-4cce08d89da0) Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:59.719378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a0333e2-a99f-41bc-9ab3-4cce08d89da0) Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a0333e2-a99f-41bc-9ab3-4cce08d89da0) Aug 31 00:37:59.720447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.723410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a0333e2-a99f-41bc-9ab3-4cce08d89da0) {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:37:59.724820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dd0ccca3-f3ef-4324-b937-22634b6892ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d" status: 400 len: 269 microversion: 2.20 time: 0.206970 Aug 31 00:37:59.725861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 473/873] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 31 00:37:59 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d => generated 269 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Aug 31 00:37:59.727765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-efa5b456-cf21-4cab-ac26-d3e921e6fd06) Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a HTTP/1.1 Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:37:59.730070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:37:59.731678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:37:59.731678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:37:59.731678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:37:59.731678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:37:59.731678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:37:59.731678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:37:59.731678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:37:59.731678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:37:59.731678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:37:59.731678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-efa5b456-cf21-4cab-ac26-d3e921e6fd06) Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '2d43efc3-0d4e-4f0c-9242-7d5cf206ae43', 'id': '2a816307-3a33-4d13-9fad-a03edaa2c34a'} Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:37:59.732421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-efa5b456-cf21-4cab-ac26-d3e921e6fd06) Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:37:59.733662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-efa5b456-cf21-4cab-ac26-d3e921e6fd06) Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.735513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-efa5b456-cf21-4cab-ac26-d3e921e6fd06) Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:59.736818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-efa5b456-cf21-4cab-ac26-d3e921e6fd06) Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-efa5b456-cf21-4cab-ac26-d3e921e6fd06) Aug 31 00:37:59.738280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.739559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-efa5b456-cf21-4cab-ac26-d3e921e6fd06) {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:37:59.739671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.739776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ba8090e2-73cb-455d-b9d8-1bea8887e46d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a" status: 400 len: 269 microversion: 2.1 time: 0.189673 Aug 31 00:37:59.739874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.740031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 401/874] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:37:59 2022] DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a => generated 269 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:37:59.740031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9567160c-3210-49d4-b789-4b285d0804bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.740314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.740314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.740582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9567160c-3210-49d4-b789-4b285d0804bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.740727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.740727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.740727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.741135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.746746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9567160c-3210-49d4-b789-4b285d0804bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.747289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9567160c-3210-49d4-b789-4b285d0804bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.747729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9567160c-3210-49d4-b789-4b285d0804bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.748432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9567160c-3210-49d4-b789-4b285d0804bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.748887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9567160c-3210-49d4-b789-4b285d0804bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.749310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9567160c-3210-49d4-b789-4b285d0804bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.795803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9567160c-3210-49d4-b789-4b285d0804bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062646 Aug 31 00:37:59.796391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 402/875] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:37:59 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:59.800859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.801476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.808221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.808890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.809327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.810024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.810473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.810982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.842253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'services' on Instance uuid 503c21ab-7fcf-41a4-b1b6-58109d0217f3 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:37:59.851367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.851909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.852350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.853695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lazy-loading 'fault' on Instance uuid f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:37:59.901163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:59.905235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bfdfdb1-3ac9-4518-8d63-11a7e13484cc) Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Request method failure captured: Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f HTTP/1.1 Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqo0_3iVwfjjLYuwm66bn9iUjIPRZQjdAACsZuY6c8f-U7IwC-mp2VVMa8EsoaF2rmL34SF87V7NUN2GRNZlnkKcHrIPWz40tybjHMsI9s_Yjiqshls4RcEZWEMbCMil6stLTQenRorGhM9iftq6svlxUdWvamJ78eidStRmkko5WSg Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: e32cbe1a05ce414fb55f1de8bf71581c Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:37:59.907473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:37:59.909080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e32cbe1a05ce414fb55f1de8bf71581c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:37:59.909080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:37:59.909080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: e32cbe1a05ce414fb55f1de8bf71581c Aug 31 00:37:59.909080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:37:59.909080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesSnapshotTestJSON-187862735-project Aug 31 00:37:59.909080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:37:59.909080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:37:59.909080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: b03932102b7541f89a60a9c535a42e76 Aug 31 00:37:59.909080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesSnapshotTestJSON-187862735-project Aug 31 00:37:59.909080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bfdfdb1-3ac9-4518-8d63-11a7e13484cc) Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '503c21ab-7fcf-41a4-b1b6-58109d0217f3', 'id': 'f55ad42f-ca35-4b42-a8bc-3410cddfde6f'} Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:37:59.909780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bfdfdb1-3ac9-4518-8d63-11a7e13484cc) Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:37:59.910813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bfdfdb1-3ac9-4518-8d63-11a7e13484cc) Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.912252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bfdfdb1-3ac9-4518-8d63-11a7e13484cc) Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:59.913447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bfdfdb1-3ac9-4518-8d63-11a7e13484cc) Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bfdfdb1-3ac9-4518-8d63-11a7e13484cc) Aug 31 00:37:59.914903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:37:59.917176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d7e2a9ec-7426-421f-80fc-c71799e083fe tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1230 microversion: 2.1 time: 0.112189 Aug 31 00:37:59.917176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 403/876] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:59 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:59.917369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bfdfdb1-3ac9-4518-8d63-11a7e13484cc) {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:37:59.917369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-09279d72-8472-4ceb-a737-4b4d0b01ef13 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f" status: 400 len: 269 microversion: 2.1 time: 0.186580 Aug 31 00:37:59.917369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 474/877] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:37:59 2022] DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f => generated 269 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:37:59.917647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.917647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.919841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.920319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.923547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.924114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.924586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.925275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.925719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.926136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.935332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.935332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.935332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.935332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.935701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.935701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.010211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'services' on Instance uuid 02e4497e-f74f-4b4e-aac6-88c39ead5f38 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:00.052202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'services' on Instance uuid 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:00.081352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9752cb87-3ebd-4707-8b1e-184b56cf933d) Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d HTTP/1.1 Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:38:00.083614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:38:00.085008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.085008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:38:00.085008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:38:00.085008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:38:00.085008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:38:00.085008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:38:00.085008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:38:00.085008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 00:38:00.085008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:38:00.085008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9752cb87-3ebd-4707-8b1e-184b56cf933d) Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '02e4497e-f74f-4b4e-aac6-88c39ead5f38', 'id': 'bff329ef-5896-4a6e-94ab-1f26ac09a59d'} Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.086086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9752cb87-3ebd-4707-8b1e-184b56cf933d) Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.087984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9752cb87-3ebd-4707-8b1e-184b56cf933d) Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.089257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9752cb87-3ebd-4707-8b1e-184b56cf933d) Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.090277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9752cb87-3ebd-4707-8b1e-184b56cf933d) Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9752cb87-3ebd-4707-8b1e-184b56cf933d) Aug 31 00:38:00.091387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.092427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9752cb87-3ebd-4707-8b1e-184b56cf933d) {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.092427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6a7caa7d-3570-4c35-ab91-2615d37d0380 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d" status: 400 len: 269 microversion: 2.20 time: 0.172618 Aug 31 00:38:00.092427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 404/878] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 31 00:37:59 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d => generated 269 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Aug 31 00:38:00.092427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.092717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.097347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.097827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.098256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.098937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.099419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.099842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.117112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2be8e3d4-c195-4460-a3c4-568883e7ddb0) Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a HTTP/1.1 Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:38:00.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:38:00.121062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.121062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:38:00.121062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:38:00.121062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:38:00.121062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:38:00.121062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:38:00.121062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:38:00.121062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:38:00.121062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:38:00.121062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2be8e3d4-c195-4460-a3c4-568883e7ddb0) Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '2d43efc3-0d4e-4f0c-9242-7d5cf206ae43', 'id': '2a816307-3a33-4d13-9fad-a03edaa2c34a'} Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.121667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2be8e3d4-c195-4460-a3c4-568883e7ddb0) Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.122836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2be8e3d4-c195-4460-a3c4-568883e7ddb0) Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.123962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2be8e3d4-c195-4460-a3c4-568883e7ddb0) Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.124965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2be8e3d4-c195-4460-a3c4-568883e7ddb0) Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2be8e3d4-c195-4460-a3c4-568883e7ddb0) Aug 31 00:38:00.126036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.127125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2be8e3d4-c195-4460-a3c4-568883e7ddb0) {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.127125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c12b179d-02f4-4eae-8107-f40b43041293 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a" status: 400 len: 269 microversion: 2.1 time: 0.205606 Aug 31 00:38:00.127125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 475/879] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:37:59 2022] DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a => generated 269 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:38:00.127125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0e974145-2e4c-485e-8372-055f9a207393 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.128295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0e974145-2e4c-485e-8372-055f9a207393 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.135799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e974145-2e4c-485e-8372-055f9a207393 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.136401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e974145-2e4c-485e-8372-055f9a207393 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.136697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e974145-2e4c-485e-8372-055f9a207393 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.137386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e974145-2e4c-485e-8372-055f9a207393 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.137834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e974145-2e4c-485e-8372-055f9a207393 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.138255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e974145-2e4c-485e-8372-055f9a207393 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.170249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0e974145-2e4c-485e-8372-055f9a207393 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047731 Aug 31 00:38:00.170823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 476/880] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:00.175367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.176004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.182008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.182488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.182917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.183645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.184098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.184513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.184933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'services' on Instance uuid 503c21ab-7fcf-41a4-b1b6-58109d0217f3 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:00.217003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.218146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.218532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.219090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lazy-loading 'fault' on Instance uuid f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:00.250987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a5a2207-6319-4410-88fe-5b5a7ccf5192) Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Request method failure captured: Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f HTTP/1.1 Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqo0_3iVwfjjLYuwm66bn9iUjIPRZQjdAACsZuY6c8f-U7IwC-mp2VVMa8EsoaF2rmL34SF87V7NUN2GRNZlnkKcHrIPWz40tybjHMsI9s_Yjiqshls4RcEZWEMbCMil6stLTQenRorGhM9iftq6svlxUdWvamJ78eidStRmkko5WSg Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: e32cbe1a05ce414fb55f1de8bf71581c Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:38:00.253153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:38:00.254470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e32cbe1a05ce414fb55f1de8bf71581c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.254470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:38:00.254470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: e32cbe1a05ce414fb55f1de8bf71581c Aug 31 00:38:00.254470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:38:00.254470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesSnapshotTestJSON-187862735-project Aug 31 00:38:00.254470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:38:00.254470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:38:00.254470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: b03932102b7541f89a60a9c535a42e76 Aug 31 00:38:00.254470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesSnapshotTestJSON-187862735-project Aug 31 00:38:00.254470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a5a2207-6319-4410-88fe-5b5a7ccf5192) Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '503c21ab-7fcf-41a4-b1b6-58109d0217f3', 'id': 'f55ad42f-ca35-4b42-a8bc-3410cddfde6f'} Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.255164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a5a2207-6319-4410-88fe-5b5a7ccf5192) Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.256202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a5a2207-6319-4410-88fe-5b5a7ccf5192) Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.257343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a5a2207-6319-4410-88fe-5b5a7ccf5192) Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.258328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a5a2207-6319-4410-88fe-5b5a7ccf5192) Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a5a2207-6319-4410-88fe-5b5a7ccf5192) Aug 31 00:38:00.260036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.261625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a5a2207-6319-4410-88fe-5b5a7ccf5192) {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.261625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4c17f88c-af03-4457-b278-2e641e9d1d58 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f" status: 400 len: 269 microversion: 2.1 time: 0.168217 Aug 31 00:38:00.261625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 405/881] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:38:00 2022] DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f => generated 269 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:38:00.261625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.262177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.267388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.267881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.268182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9add734db2a4adc9857040166c02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd201c4183dde4ac693ac92c43c02df77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:00.268320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.268990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.269437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.270044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.277457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1c219d08-cffb-45ad-9d8a-f709a401d796 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 200 len: 1230 microversion: 2.1 time: 0.105439 Aug 31 00:38:00.278428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 477/882] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:00 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:00.283014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.283577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.291433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.292005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.292413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.293315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.293700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.294163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.365876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'services' on Instance uuid 02e4497e-f74f-4b4e-aac6-88c39ead5f38 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:00.417642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'services' on Instance uuid 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:00.436965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84379f17-b259-4a83-ad18-f098696b2c67) Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d HTTP/1.1 Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:38:00.439470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:38:00.441062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.441062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:38:00.441062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:38:00.441062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:38:00.441062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:38:00.441062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:38:00.441062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:38:00.441062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 00:38:00.441062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:38:00.441062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84379f17-b259-4a83-ad18-f098696b2c67) Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '02e4497e-f74f-4b4e-aac6-88c39ead5f38', 'id': 'bff329ef-5896-4a6e-94ab-1f26ac09a59d'} Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.441956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84379f17-b259-4a83-ad18-f098696b2c67) Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.443172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84379f17-b259-4a83-ad18-f098696b2c67) Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.444522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84379f17-b259-4a83-ad18-f098696b2c67) Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.445891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84379f17-b259-4a83-ad18-f098696b2c67) Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84379f17-b259-4a83-ad18-f098696b2c67) Aug 31 00:38:00.448196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.449504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84379f17-b259-4a83-ad18-f098696b2c67) {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.449504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1731c20c-9004-4bd8-aeb0-69a0ed895031 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d" status: 400 len: 269 microversion: 2.20 time: 0.184407 Aug 31 00:38:00.449504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 406/883] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 31 00:38:00 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d => generated 269 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Aug 31 00:38:00.449504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.449869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.453849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.454327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.454778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.455490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.455930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.456349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.482140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-accc9624-ee46-4a8f-ab2e-a821cc1efe51) Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a HTTP/1.1 Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:38:00.484339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:38:00.487595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.487595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:38:00.487595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:38:00.487595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:38:00.487595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:38:00.487595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:38:00.487595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:38:00.487595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:38:00.487595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:38:00.487595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-accc9624-ee46-4a8f-ab2e-a821cc1efe51) Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '2d43efc3-0d4e-4f0c-9242-7d5cf206ae43', 'id': '2a816307-3a33-4d13-9fad-a03edaa2c34a'} Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.489035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-accc9624-ee46-4a8f-ab2e-a821cc1efe51) Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.490818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-accc9624-ee46-4a8f-ab2e-a821cc1efe51) Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.494058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-accc9624-ee46-4a8f-ab2e-a821cc1efe51) Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.496210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-accc9624-ee46-4a8f-ab2e-a821cc1efe51) Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-accc9624-ee46-4a8f-ab2e-a821cc1efe51) Aug 31 00:38:00.499211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.502150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-accc9624-ee46-4a8f-ab2e-a821cc1efe51) {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.502150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e59a747f-e1dd-41de-b661-12c4c368c0af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a" status: 400 len: 269 microversion: 2.1 time: 0.207317 Aug 31 00:38:00.502150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 478/884] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:38:00 2022] DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a => generated 269 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:38:00.502150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-08d96ab7-5c13-437c-8265-355b6aa0d943 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.502684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-08d96ab7-5c13-437c-8265-355b6aa0d943 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.502684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08d96ab7-5c13-437c-8265-355b6aa0d943 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.502684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08d96ab7-5c13-437c-8265-355b6aa0d943 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.503092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08d96ab7-5c13-437c-8265-355b6aa0d943 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.503624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08d96ab7-5c13-437c-8265-355b6aa0d943 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.504076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08d96ab7-5c13-437c-8265-355b6aa0d943 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.504495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08d96ab7-5c13-437c-8265-355b6aa0d943 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.535973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-08d96ab7-5c13-437c-8265-355b6aa0d943 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048065 Aug 31 00:38:00.536503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 479/885] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:00.540982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.541574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.543534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'services' on Instance uuid 503c21ab-7fcf-41a4-b1b6-58109d0217f3 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:00.547543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.548034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.548470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.549164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.549617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.550040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.564143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] HTTP exception thrown: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Request method failure captured: Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 HTTP/1.1 Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqneLIkwKpQMngI1sfC0534g9i1uYyTwoqFllpaA_w1yKEtC6XYbCtZz7XjCfMVIYr1sblvLLIESgO3GRAjiIK6LK28FG2lkLpzzbJYG6-Js2sZTcI5RQncblENpETa31Iq-ZwRYuCup5yI8w9XtUwKQ6SR3QQU2vqBIDJ7OWL9viWU Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: d201c4183dde4ac693ac92c43c02df77 Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:38:00.565697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d201c4183dde4ac693ac92c43c02df77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: d201c4183dde4ac693ac92c43c02df77 Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-TestVolumeBootPattern-1800903404-project Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: f9add734db2a4adc9857040166c02675 Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-TestVolumeBootPattern-1800903404-project Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:00.567183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': 'f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488'} Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.568146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:00.569323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.570824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Returning 404 to user: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.570824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1fd0281c-c063-41b0-8854-ec146857f865 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 404 len: 111 microversion: 2.1 time: 0.029667 Aug 31 00:38:00.570824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 480/886] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:00 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:38:00.573046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.573568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.579712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.580193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.580629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.581323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.581777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.582200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.601425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbe4ed8a-80d5-415a-acc8-34a77b25f4a0) Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Request method failure captured: Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f HTTP/1.1 Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqo0_3iVwfjjLYuwm66bn9iUjIPRZQjdAACsZuY6c8f-U7IwC-mp2VVMa8EsoaF2rmL34SF87V7NUN2GRNZlnkKcHrIPWz40tybjHMsI9s_Yjiqshls4RcEZWEMbCMil6stLTQenRorGhM9iftq6svlxUdWvamJ78eidStRmkko5WSg Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: e32cbe1a05ce414fb55f1de8bf71581c Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:38:00.604631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:38:00.606150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e32cbe1a05ce414fb55f1de8bf71581c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.606150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:38:00.606150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: e32cbe1a05ce414fb55f1de8bf71581c Aug 31 00:38:00.606150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:38:00.606150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesSnapshotTestJSON-187862735-project Aug 31 00:38:00.606150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:38:00.606150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:38:00.606150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: b03932102b7541f89a60a9c535a42e76 Aug 31 00:38:00.606150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesSnapshotTestJSON-187862735-project Aug 31 00:38:00.606150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbe4ed8a-80d5-415a-acc8-34a77b25f4a0) Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '503c21ab-7fcf-41a4-b1b6-58109d0217f3', 'id': 'f55ad42f-ca35-4b42-a8bc-3410cddfde6f'} Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.606835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbe4ed8a-80d5-415a-acc8-34a77b25f4a0) Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.608259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbe4ed8a-80d5-415a-acc8-34a77b25f4a0) Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.609401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbe4ed8a-80d5-415a-acc8-34a77b25f4a0) Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.610700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbe4ed8a-80d5-415a-acc8-34a77b25f4a0) Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbe4ed8a-80d5-415a-acc8-34a77b25f4a0) Aug 31 00:38:00.611805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.613303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbe4ed8a-80d5-415a-acc8-34a77b25f4a0) {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.613303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e8e06692-14bf-4786-8eb5-9f414df75238 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f" status: 400 len: 269 microversion: 2.1 time: 0.164611 Aug 31 00:38:00.613303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 407/887] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:38:00 2022] DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f => generated 269 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:38:00.613303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.613589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.620864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.621349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.621780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.622467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.622914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.623367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.670233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'services' on Instance uuid 02e4497e-f74f-4b4e-aac6-88c39ead5f38 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:00.714358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'services' on Instance uuid 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:00.741857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08032dd4-20f3-4066-87ef-e997dfa3f871) Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d HTTP/1.1 Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:38:00.744389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:38:00.745795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.745795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:38:00.745795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 00:38:00.745795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 00:38:00.745795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:38:00.745795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:38:00.745795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:38:00.745795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 00:38:00.745795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 00:38:00.745795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08032dd4-20f3-4066-87ef-e997dfa3f871) Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '02e4497e-f74f-4b4e-aac6-88c39ead5f38', 'id': 'bff329ef-5896-4a6e-94ab-1f26ac09a59d'} Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.746649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08032dd4-20f3-4066-87ef-e997dfa3f871) Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.747711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08032dd4-20f3-4066-87ef-e997dfa3f871) Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.748864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08032dd4-20f3-4066-87ef-e997dfa3f871) Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.749898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08032dd4-20f3-4066-87ef-e997dfa3f871) Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08032dd4-20f3-4066-87ef-e997dfa3f871) Aug 31 00:38:00.751023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.756234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08032dd4-20f3-4066-87ef-e997dfa3f871) {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.756234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a378b27e-87a3-4155-8d94-20a03c980d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d" status: 400 len: 269 microversion: 2.20 time: 0.177307 Aug 31 00:38:00.756234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 481/888] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 31 00:38:00 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments/bff329ef-5896-4a6e-94ab-1f26ac09a59d => generated 269 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Aug 31 00:38:00.756234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.756691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.757687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.758184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.759577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.760399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.760859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.761283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.783750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b6d2a8d-ce93-4c4e-90d9-bed971b12580) Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a HTTP/1.1 Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:38:00.785889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:38:00.787311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.787311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:38:00.787311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:38:00.787311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:38:00.787311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:38:00.787311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:38:00.787311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:38:00.787311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:38:00.787311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:38:00.787311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b6d2a8d-ce93-4c4e-90d9-bed971b12580) Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '2d43efc3-0d4e-4f0c-9242-7d5cf206ae43', 'id': '2a816307-3a33-4d13-9fad-a03edaa2c34a'} Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.787938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b6d2a8d-ce93-4c4e-90d9-bed971b12580) Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.789286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b6d2a8d-ce93-4c4e-90d9-bed971b12580) Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.790683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b6d2a8d-ce93-4c4e-90d9-bed971b12580) Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.791793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b6d2a8d-ce93-4c4e-90d9-bed971b12580) Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b6d2a8d-ce93-4c4e-90d9-bed971b12580) Aug 31 00:38:00.793397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.795203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b6d2a8d-ce93-4c4e-90d9-bed971b12580) {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.795203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9dca4014-92b3-4835-a9f9-7b681a4f5b0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a" status: 400 len: 269 microversion: 2.1 time: 0.178704 Aug 31 00:38:00.795203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 408/889] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:38:00 2022] DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments/2a816307-3a33-4d13-9fad-a03edaa2c34a => generated 269 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:38:00.796582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1960daea-92d0-4ef2-8aac-5e4d98bb71f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.798712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1960daea-92d0-4ef2-8aac-5e4d98bb71f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.805548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1960daea-92d0-4ef2-8aac-5e4d98bb71f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.806332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1960daea-92d0-4ef2-8aac-5e4d98bb71f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.806947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1960daea-92d0-4ef2-8aac-5e4d98bb71f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.807680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1960daea-92d0-4ef2-8aac-5e4d98bb71f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.808132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1960daea-92d0-4ef2-8aac-5e4d98bb71f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.808559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1960daea-92d0-4ef2-8aac-5e4d98bb71f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.840695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1960daea-92d0-4ef2-8aac-5e4d98bb71f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051853 Aug 31 00:38:00.841251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 409/890] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:00.845940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lazy-loading 'services' on Instance uuid 503c21ab-7fcf-41a4-b1b6-58109d0217f3 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:00.846094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.846548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.852216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.853355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.853792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.854483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.854935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.855513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.870202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] HTTP exception thrown: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Request method failure captured: Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 HTTP/1.1 Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqneLIkwKpQMngI1sfC0534g9i1uYyTwoqFllpaA_w1yKEtC6XYbCtZz7XjCfMVIYr1sblvLLIESgO3GRAjiIK6LK28FG2lkLpzzbJYG6-Js2sZTcI5RQncblENpETa31Iq-ZwRYuCup5yI8w9XtUwKQ6SR3QQU2vqBIDJ7OWL9viWU Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: d201c4183dde4ac693ac92c43c02df77 Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:38:00.871743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d201c4183dde4ac693ac92c43c02df77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: d201c4183dde4ac693ac92c43c02df77 Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-TestVolumeBootPattern-1800903404-project Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: f9add734db2a4adc9857040166c02675 Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-TestVolumeBootPattern-1800903404-project Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:00.873275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488'} Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.874313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:00.875614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.876661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Returning 404 to user: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.876661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2a2d399f-6b18-43f1-b5a0-d439325d9afd tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 404 len: 111 microversion: 2.1 time: 0.030951 Aug 31 00:38:00.876661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 410/891] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:00 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:38:00.887244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d117f40c-3aab-4dfe-8fda-d178cb53c820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.889372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d117f40c-3aab-4dfe-8fda-d178cb53c820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.895221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d117f40c-3aab-4dfe-8fda-d178cb53c820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.895702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d117f40c-3aab-4dfe-8fda-d178cb53c820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.896161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d117f40c-3aab-4dfe-8fda-d178cb53c820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.896848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d117f40c-3aab-4dfe-8fda-d178cb53c820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.897296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d117f40c-3aab-4dfe-8fda-d178cb53c820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.897713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d117f40c-3aab-4dfe-8fda-d178cb53c820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.910682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f25d1a2-25c1-429d-8f25-2868cf5e343a) Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Request method failure captured: Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f HTTP/1.1 Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqo0_3iVwfjjLYuwm66bn9iUjIPRZQjdAACsZuY6c8f-U7IwC-mp2VVMa8EsoaF2rmL34SF87V7NUN2GRNZlnkKcHrIPWz40tybjHMsI9s_Yjiqshls4RcEZWEMbCMil6stLTQenRorGhM9iftq6svlxUdWvamJ78eidStRmkko5WSg Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: e32cbe1a05ce414fb55f1de8bf71581c Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:38:00.912974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:38:00.914299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e32cbe1a05ce414fb55f1de8bf71581c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e32cbe1a05ce414fb55f1de8bf71581c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:00.914299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:38:00.914299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: e32cbe1a05ce414fb55f1de8bf71581c Aug 31 00:38:00.914299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-187862735 Aug 31 00:38:00.914299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesSnapshotTestJSON-187862735-project Aug 31 00:38:00.914299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:38:00.914299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:38:00.914299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: b03932102b7541f89a60a9c535a42e76 Aug 31 00:38:00.914299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesSnapshotTestJSON-187862735-project Aug 31 00:38:00.914299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f25d1a2-25c1-429d-8f25-2868cf5e343a) Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '503c21ab-7fcf-41a4-b1b6-58109d0217f3', 'id': 'f55ad42f-ca35-4b42-a8bc-3410cddfde6f'} Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.916389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f25d1a2-25c1-429d-8f25-2868cf5e343a) Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:00.917463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f25d1a2-25c1-429d-8f25-2868cf5e343a) Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.918642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f25d1a2-25c1-429d-8f25-2868cf5e343a) Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.921574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f25d1a2-25c1-429d-8f25-2868cf5e343a) Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f25d1a2-25c1-429d-8f25-2868cf5e343a) Aug 31 00:38:00.924005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:00.926570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f25d1a2-25c1-429d-8f25-2868cf5e343a) {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:00.926570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0ee7f2cc-8b9c-41c7-ad7a-875ba657d4dc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f" status: 400 len: 269 microversion: 2.1 time: 0.167153 Aug 31 00:38:00.926570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 482/892] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:38:00 2022] DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3/os-volume_attachments/f55ad42f-ca35-4b42-a8bc-3410cddfde6f => generated 269 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:38:00.926570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-407b16b2-baea-4439-a7a6-ca83894c9fd5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.927518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-407b16b2-baea-4439-a7a6-ca83894c9fd5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.934046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-407b16b2-baea-4439-a7a6-ca83894c9fd5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.935674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-407b16b2-baea-4439-a7a6-ca83894c9fd5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.935674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-407b16b2-baea-4439-a7a6-ca83894c9fd5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.935674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-407b16b2-baea-4439-a7a6-ca83894c9fd5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.936166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-407b16b2-baea-4439-a7a6-ca83894c9fd5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.936536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-407b16b2-baea-4439-a7a6-ca83894c9fd5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.940159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d117f40c-3aab-4dfe-8fda-d178cb53c820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065120 Aug 31 00:38:00.943072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 411/893] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:00.975919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-407b16b2-baea-4439-a7a6-ca83894c9fd5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054795 Aug 31 00:38:00.976475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 483/894] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:01.029391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-41881782", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1651012719", "security_groups": [{"name": "tempest-secgroup-smoke-1728845074"}], "block_device_mapping_v2": [{"uuid": "ac7812ae-6383-4b12-966b-80194c59651b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21ad909f-0afd-4817-bcd2-68090ccea7ac"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:38:01.143768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] validate_networks() for [('21ad909f-0afd-4817-bcd2-68090ccea7ac', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:38:01.801279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:38:01.801864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:38:01.802178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:38:01.802578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:38:01.802984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:38:01.812495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:01.812905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:01.813361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:01.814074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:01.814520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:01.814946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:01.832354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Getting quotas for project d201c4183dde4ac693ac92c43c02df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:38:01.836244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Getting quotas for user f9add734db2a4adc9857040166c02675 and project d201c4183dde4ac693ac92c43c02df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:38:01.853290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b3b50d7a-8ba4-4546-bede-23d70cd17f8d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:01.855474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b3b50d7a-8ba4-4546-bede-23d70cd17f8d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:01.862375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3b50d7a-8ba4-4546-bede-23d70cd17f8d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:01.862864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3b50d7a-8ba4-4546-bede-23d70cd17f8d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:01.863331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3b50d7a-8ba4-4546-bede-23d70cd17f8d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:01.864032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3b50d7a-8ba4-4546-bede-23d70cd17f8d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:01.864484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3b50d7a-8ba4-4546-bede-23d70cd17f8d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:01.864906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3b50d7a-8ba4-4546-bede-23d70cd17f8d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:01.895959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b3b50d7a-8ba4-4546-bede-23d70cd17f8d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046815 Aug 31 00:38:01.896510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 484/895] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:01 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:01.898114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:38:01.901342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: cfa47172-28ee-444e-b33b-8188345db8f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac7812ae-6383-4b12-966b-80194c59651b',volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:38:01.953747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4334b7d2-6593-4a18-919e-c7d566c1138d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:01.955905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4334b7d2-6593-4a18-919e-c7d566c1138d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:01.961849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4334b7d2-6593-4a18-919e-c7d566c1138d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:01.962473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4334b7d2-6593-4a18-919e-c7d566c1138d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:01.962967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4334b7d2-6593-4a18-919e-c7d566c1138d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:01.963692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4334b7d2-6593-4a18-919e-c7d566c1138d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:01.964144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4334b7d2-6593-4a18-919e-c7d566c1138d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:01.964563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4334b7d2-6593-4a18-919e-c7d566c1138d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:01.965460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume ac7812ae-6383-4b12-966b-80194c59651b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-c25159d4-d9d2-4535-a3d2-cbcd7cdfa306) Aug 31 00:38:01.969554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Request method failure captured: Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 476 Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqneLIkwKpQMngI1sfC0534g9i1uYyTwoqFllpaA_w1yKEtC6XYbCtZz7XjCfMVIYr1sblvLLIESgO3GRAjiIK6LK28FG2lkLpzzbJYG6-Js2sZTcI5RQncblENpETa31Iq-ZwRYuCup5yI8w9XtUwKQ6SR3QQU2vqBIDJ7OWL9viWU Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: d201c4183dde4ac693ac92c43c02df77 Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:38:01.970010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:38:01.971372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d201c4183dde4ac693ac92c43c02df77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:01.971372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:01.971372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: d201c4183dde4ac693ac92c43c02df77 Aug 31 00:38:01.971372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:01.971372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-TestVolumeBootPattern-1800903404-project Aug 31 00:38:01.971372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:38:01.971372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:38:01.971372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: f9add734db2a4adc9857040166c02675 Aug 31 00:38:01.971372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-TestVolumeBootPattern-1800903404-project Aug 31 00:38:01.971372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Aug 31 00:38:01.975431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {"server": {"name": "tempest-TestVolumeBootPattern-server-41881782", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1651012719", "security_groups": [{"name": "tempest-secgroup-smoke-1728845074"}], "block_device_mapping_v2": [{"uuid": "ac7812ae-6383-4b12-966b-80194c59651b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21ad909f-0afd-4817-bcd2-68090ccea7ac"}]}} Aug 31 00:38:01.975431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:38:01.975431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: Invalid input received: Invalid volume: Volume ac7812ae-6383-4b12-966b-80194c59651b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-c25159d4-d9d2-4535-a3d2-cbcd7cdfa306) Aug 31 00:38:01.975431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-41881782', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-1651012719', 'security_groups': [{'name': 'tempest-secgroup-smoke-1728845074'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': 'ac7812ae-6383-4b12-966b-80194c59651b'}], 'networks': [{'uuid': '21ad909f-0afd-4817-bcd2-68090ccea7ac'}]}}} Aug 31 00:38:01.975431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:01.975431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:01.975431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:01.975431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:01.975431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:01.975431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:01.976222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume ac7812ae-6383-4b12-966b-80194c59651b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-c25159d4-d9d2-4535-a3d2-cbcd7cdfa306) Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1971, in _validate_bdm Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5001, in _check_attach_and_reserve_volume Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:38:01.978079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 00:38:01.980102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume ac7812ae-6383-4b12-966b-80194c59651b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-c25159d4-d9d2-4535-a3d2-cbcd7cdfa306) Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1550, in _provision_instances Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:38:01.982087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1460, in _provision_instances Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1866, in _bdm_validate_set_size_and_instance Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._validate_bdm( Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1980, in _validate_bdm Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume ac7812ae-6383-4b12-966b-80194c59651b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-c25159d4-d9d2-4535-a3d2-cbcd7cdfa306) Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:01.983949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume ac7812ae-6383-4b12-966b-80194c59651b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-c25159d4-d9d2-4535-a3d2-cbcd7cdfa306) Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:01.985750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:01.991267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume ac7812ae-6383-4b12-966b-80194c59651b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-c25159d4-d9d2-4535-a3d2-cbcd7cdfa306) Aug 31 00:38:01.991267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:01.991267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume ac7812ae-6383-4b12-966b-80194c59651b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-c25159d4-d9d2-4535-a3d2-cbcd7cdfa306) {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:01.991267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5c5869e1-7199-46b5-ab05-25c1e13f786d tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 0.945328 Aug 31 00:38:01.991267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 412/896] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:38:01 2022] POST /compute/v2.1/servers => generated 295 bytes in 947 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:38:01.993887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a3e7472a-51bc-4522-a8db-74298fe9fb65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:01.997288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4334b7d2-6593-4a18-919e-c7d566c1138d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047481 Aug 31 00:38:01.997860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 485/897] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:38:01.997990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a3e7472a-51bc-4522-a8db-74298fe9fb65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:02.010051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3e7472a-51bc-4522-a8db-74298fe9fb65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:02.010703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3e7472a-51bc-4522-a8db-74298fe9fb65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:02.011163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3e7472a-51bc-4522-a8db-74298fe9fb65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.012196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3e7472a-51bc-4522-a8db-74298fe9fb65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:02.012315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3e7472a-51bc-4522-a8db-74298fe9fb65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:02.012715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3e7472a-51bc-4522-a8db-74298fe9fb65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.044033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a3e7472a-51bc-4522-a8db-74298fe9fb65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055405 Aug 31 00:38:02.044941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 413/898] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:02.446139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:02.446842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:02.452892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:02.453371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:02.453801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.454480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:02.454931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:02.455405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.468546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] HTTP exception thrown: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Request method failure captured: Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 HTTP/1.1 Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqneLIkwKpQMngI1sfC0534g9i1uYyTwoqFllpaA_w1yKEtC6XYbCtZz7XjCfMVIYr1sblvLLIESgO3GRAjiIK6LK28FG2lkLpzzbJYG6-Js2sZTcI5RQncblENpETa31Iq-ZwRYuCup5yI8w9XtUwKQ6SR3QQU2vqBIDJ7OWL9viWU Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: d201c4183dde4ac693ac92c43c02df77 Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:38:02.470069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d201c4183dde4ac693ac92c43c02df77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: d201c4183dde4ac693ac92c43c02df77 Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-TestVolumeBootPattern-1800903404-project Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: f9add734db2a4adc9857040166c02675 Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-TestVolumeBootPattern-1800903404-project Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:02.471592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': 'f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488'} Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:02.472417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:02.473565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:38:02.474724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Returning 404 to user: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:02.474724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e285b2f6-4b2e-42d0-a604-15d9a35f7abf tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 404 len: 111 microversion: 2.1 time: 0.029260 Aug 31 00:38:02.474724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 486/899] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:38:02 2022] DELETE /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:38:02.480584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:02.481188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] [instance: f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:02.487324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:02.487802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:02.488233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.488908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:02.489356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:02.489773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.503569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] HTTP exception thrown: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Request method failure captured: Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 HTTP/1.1 Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqneLIkwKpQMngI1sfC0534g9i1uYyTwoqFllpaA_w1yKEtC6XYbCtZz7XjCfMVIYr1sblvLLIESgO3GRAjiIK6LK28FG2lkLpzzbJYG6-Js2sZTcI5RQncblENpETa31Iq-ZwRYuCup5yI8w9XtUwKQ6SR3QQU2vqBIDJ7OWL9viWU Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: d201c4183dde4ac693ac92c43c02df77 Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:38:02.505065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d201c4183dde4ac693ac92c43c02df77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d201c4183dde4ac693ac92c43c02df77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: d201c4183dde4ac693ac92c43c02df77 Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800903404 Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-TestVolumeBootPattern-1800903404-project Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: f9add734db2a4adc9857040166c02675 Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-TestVolumeBootPattern-1800903404-project Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:02.506594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488'} Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:02.507450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. Aug 31 00:38:02.508725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:38:02.509980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Returning 404 to user: Instance f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:02.509980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-38da4126-f1b2-42fa-87af-3e489b5b8406 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488" status: 404 len: 111 microversion: 2.1 time: 0.030303 Aug 31 00:38:02.509980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 414/900] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:02 2022] GET /compute/v2.1/servers/f4c3f88e-0d93-4baa-9d32-c8c7c1c2c488 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:38:02.908708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f999a455-ca1e-4ddf-8c9c-f589d58ac1aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:02.910883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f999a455-ca1e-4ddf-8c9c-f589d58ac1aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:02.918116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f999a455-ca1e-4ddf-8c9c-f589d58ac1aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:02.918602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f999a455-ca1e-4ddf-8c9c-f589d58ac1aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:02.919048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f999a455-ca1e-4ddf-8c9c-f589d58ac1aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.919758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f999a455-ca1e-4ddf-8c9c-f589d58ac1aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:02.920209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f999a455-ca1e-4ddf-8c9c-f589d58ac1aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:02.920634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f999a455-ca1e-4ddf-8c9c-f589d58ac1aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.950184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f999a455-ca1e-4ddf-8c9c-f589d58ac1aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Aug 31 00:38:02.950738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 487/901] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:02 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:03.011544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dfdec01d-b8d5-4397-81c2-cd1bfc8165f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:03.013655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dfdec01d-b8d5-4397-81c2-cd1bfc8165f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:03.019946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dfdec01d-b8d5-4397-81c2-cd1bfc8165f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:03.020420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dfdec01d-b8d5-4397-81c2-cd1bfc8165f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:03.020850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dfdec01d-b8d5-4397-81c2-cd1bfc8165f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:03.021535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dfdec01d-b8d5-4397-81c2-cd1bfc8165f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:03.021981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dfdec01d-b8d5-4397-81c2-cd1bfc8165f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:03.022400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dfdec01d-b8d5-4397-81c2-cd1bfc8165f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:03.039456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:03.053800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dfdec01d-b8d5-4397-81c2-cd1bfc8165f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046975 Aug 31 00:38:03.054351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 415/902] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:03.057039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7fbde5e5-f105-46e4-b569-b4582e163483 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:03.059211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7fbde5e5-f105-46e4-b569-b4582e163483 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:03.065408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fbde5e5-f105-46e4-b569-b4582e163483 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:03.065892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fbde5e5-f105-46e4-b569-b4582e163483 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:03.066325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fbde5e5-f105-46e4-b569-b4582e163483 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:03.067115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fbde5e5-f105-46e4-b569-b4582e163483 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:03.067481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fbde5e5-f105-46e4-b569-b4582e163483 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:03.067898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fbde5e5-f105-46e4-b569-b4582e163483 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:03.099113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7fbde5e5-f105-46e4-b569-b4582e163483 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046342 Aug 31 00:38:03.099685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 488/903] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:03.962641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a2ddfd20-2e9d-427f-88e0-0c35bcd8a309 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:03.964694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a2ddfd20-2e9d-427f-88e0-0c35bcd8a309 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:03.970659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2ddfd20-2e9d-427f-88e0-0c35bcd8a309 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:03.971179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2ddfd20-2e9d-427f-88e0-0c35bcd8a309 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:03.971611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2ddfd20-2e9d-427f-88e0-0c35bcd8a309 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:03.972296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2ddfd20-2e9d-427f-88e0-0c35bcd8a309 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:03.972746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2ddfd20-2e9d-427f-88e0-0c35bcd8a309 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:03.973161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2ddfd20-2e9d-427f-88e0-0c35bcd8a309 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:04.005352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a2ddfd20-2e9d-427f-88e0-0c35bcd8a309 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046754 Aug 31 00:38:04.005902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 416/904] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:03 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:04.066603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6c9e1204-9c7e-40b9-ad05-6412962fe425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:04.068813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6c9e1204-9c7e-40b9-ad05-6412962fe425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:04.075528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c9e1204-9c7e-40b9-ad05-6412962fe425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:04.076006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c9e1204-9c7e-40b9-ad05-6412962fe425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:04.076441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c9e1204-9c7e-40b9-ad05-6412962fe425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:04.077130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c9e1204-9c7e-40b9-ad05-6412962fe425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:04.077582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c9e1204-9c7e-40b9-ad05-6412962fe425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:04.078002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6c9e1204-9c7e-40b9-ad05-6412962fe425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:04.108167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6c9e1204-9c7e-40b9-ad05-6412962fe425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045500 Aug 31 00:38:04.108815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 489/905] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:04.111328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-41d59af7-bb19-46ea-9c7e-b92209f81b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:04.113458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-41d59af7-bb19-46ea-9c7e-b92209f81b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:04.120166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d59af7-bb19-46ea-9c7e-b92209f81b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:04.120599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d59af7-bb19-46ea-9c7e-b92209f81b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:04.121023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d59af7-bb19-46ea-9c7e-b92209f81b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:04.121702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d59af7-bb19-46ea-9c7e-b92209f81b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:04.122143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d59af7-bb19-46ea-9c7e-b92209f81b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:04.122558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d59af7-bb19-46ea-9c7e-b92209f81b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:04.158622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-41d59af7-bb19-46ea-9c7e-b92209f81b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051430 Aug 31 00:38:04.159201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 417/906] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:05.018573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0cc8f137-6474-4864-b80e-e194e38572ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:05.020743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0cc8f137-6474-4864-b80e-e194e38572ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:05.027461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cc8f137-6474-4864-b80e-e194e38572ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:05.027946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cc8f137-6474-4864-b80e-e194e38572ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:05.028381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cc8f137-6474-4864-b80e-e194e38572ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:05.029069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cc8f137-6474-4864-b80e-e194e38572ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:05.029528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cc8f137-6474-4864-b80e-e194e38572ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:05.029954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cc8f137-6474-4864-b80e-e194e38572ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:05.060138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0cc8f137-6474-4864-b80e-e194e38572ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045505 Aug 31 00:38:05.060689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 490/907] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:05 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:05.121405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cccb60a6-70fe-43fe-84b6-7d4ef96898a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:05.123588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cccb60a6-70fe-43fe-84b6-7d4ef96898a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:05.130128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cccb60a6-70fe-43fe-84b6-7d4ef96898a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:05.130615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cccb60a6-70fe-43fe-84b6-7d4ef96898a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:05.131064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cccb60a6-70fe-43fe-84b6-7d4ef96898a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:05.131770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cccb60a6-70fe-43fe-84b6-7d4ef96898a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:05.132219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cccb60a6-70fe-43fe-84b6-7d4ef96898a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:05.132639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cccb60a6-70fe-43fe-84b6-7d4ef96898a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:05.167007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cccb60a6-70fe-43fe-84b6-7d4ef96898a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049865 Aug 31 00:38:05.167820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 418/908] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:05.174943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c689786e-c003-4bca-946a-0d5ce82615af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:05.177099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c689786e-c003-4bca-946a-0d5ce82615af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:05.184374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c689786e-c003-4bca-946a-0d5ce82615af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:05.184839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c689786e-c003-4bca-946a-0d5ce82615af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:05.185297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c689786e-c003-4bca-946a-0d5ce82615af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:05.185975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c689786e-c003-4bca-946a-0d5ce82615af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:05.186418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c689786e-c003-4bca-946a-0d5ce82615af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:05.186829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c689786e-c003-4bca-946a-0d5ce82615af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:05.216596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c689786e-c003-4bca-946a-0d5ce82615af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048651 Aug 31 00:38:05.217164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 491/909] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:06.073537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bed5d6ce-b8ae-4f35-8e47-05ac05433a86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:06.075731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bed5d6ce-b8ae-4f35-8e47-05ac05433a86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:06.081629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bed5d6ce-b8ae-4f35-8e47-05ac05433a86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:06.082114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bed5d6ce-b8ae-4f35-8e47-05ac05433a86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:06.082548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bed5d6ce-b8ae-4f35-8e47-05ac05433a86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:06.083276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bed5d6ce-b8ae-4f35-8e47-05ac05433a86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:06.083731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bed5d6ce-b8ae-4f35-8e47-05ac05433a86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:06.084154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bed5d6ce-b8ae-4f35-8e47-05ac05433a86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:06.114720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bed5d6ce-b8ae-4f35-8e47-05ac05433a86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046017 Aug 31 00:38:06.115290 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 419/910] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:06 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:06.179520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c4091fb8-33f4-46e5-b214-ad4c4eddc430 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:06.181702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c4091fb8-33f4-46e5-b214-ad4c4eddc430 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:06.188473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4091fb8-33f4-46e5-b214-ad4c4eddc430 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:06.188958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4091fb8-33f4-46e5-b214-ad4c4eddc430 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:06.189393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4091fb8-33f4-46e5-b214-ad4c4eddc430 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:06.190082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4091fb8-33f4-46e5-b214-ad4c4eddc430 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:06.190535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4091fb8-33f4-46e5-b214-ad4c4eddc430 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:06.190955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4091fb8-33f4-46e5-b214-ad4c4eddc430 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:06.221528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c4091fb8-33f4-46e5-b214-ad4c4eddc430 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045998 Aug 31 00:38:06.222251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 492/911] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:38:06.229366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-77b18da0-56b6-4580-aafb-be5382ac6eaf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:06.231505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-77b18da0-56b6-4580-aafb-be5382ac6eaf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:06.238155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b18da0-56b6-4580-aafb-be5382ac6eaf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:06.238631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b18da0-56b6-4580-aafb-be5382ac6eaf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:06.239080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b18da0-56b6-4580-aafb-be5382ac6eaf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:06.239774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b18da0-56b6-4580-aafb-be5382ac6eaf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:06.240224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b18da0-56b6-4580-aafb-be5382ac6eaf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:06.240639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77b18da0-56b6-4580-aafb-be5382ac6eaf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:06.270463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-77b18da0-56b6-4580-aafb-be5382ac6eaf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Aug 31 00:38:06.271021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 420/912] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:07.127833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a800cdfd-dc4d-4908-9952-a824c734dfe5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:07.129992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a800cdfd-dc4d-4908-9952-a824c734dfe5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:07.136037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a800cdfd-dc4d-4908-9952-a824c734dfe5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:07.136520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a800cdfd-dc4d-4908-9952-a824c734dfe5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:07.136959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a800cdfd-dc4d-4908-9952-a824c734dfe5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:07.137648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a800cdfd-dc4d-4908-9952-a824c734dfe5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:07.138133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a800cdfd-dc4d-4908-9952-a824c734dfe5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:07.138557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a800cdfd-dc4d-4908-9952-a824c734dfe5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:07.169940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a800cdfd-dc4d-4908-9952-a824c734dfe5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045996 Aug 31 00:38:07.170503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 493/913] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:07 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:07.235164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dc1034db-6f77-4c47-bf27-4942e7599767 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:07.237282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dc1034db-6f77-4c47-bf27-4942e7599767 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:07.243861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc1034db-6f77-4c47-bf27-4942e7599767 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:07.244343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc1034db-6f77-4c47-bf27-4942e7599767 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:07.244777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc1034db-6f77-4c47-bf27-4942e7599767 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:07.245459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc1034db-6f77-4c47-bf27-4942e7599767 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:07.245909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc1034db-6f77-4c47-bf27-4942e7599767 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:07.246336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc1034db-6f77-4c47-bf27-4942e7599767 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:07.280121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dc1034db-6f77-4c47-bf27-4942e7599767 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049091 Aug 31 00:38:07.280692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 421/914] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:07.288376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5d035b0a-94cb-4d25-8709-16ce5e2111ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:07.291314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5d035b0a-94cb-4d25-8709-16ce5e2111ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:07.298470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d035b0a-94cb-4d25-8709-16ce5e2111ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:07.298956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d035b0a-94cb-4d25-8709-16ce5e2111ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:07.299413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d035b0a-94cb-4d25-8709-16ce5e2111ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:07.300493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d035b0a-94cb-4d25-8709-16ce5e2111ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:07.300953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d035b0a-94cb-4d25-8709-16ce5e2111ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:07.301419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5d035b0a-94cb-4d25-8709-16ce5e2111ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:07.342916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5d035b0a-94cb-4d25-8709-16ce5e2111ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063262 Aug 31 00:38:07.343806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 494/915] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:08.183657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c68cb78a-28d8-427a-ab8c-760f3921b579 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:08.185757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c68cb78a-28d8-427a-ab8c-760f3921b579 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:08.191656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68cb78a-28d8-427a-ab8c-760f3921b579 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:08.192133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68cb78a-28d8-427a-ab8c-760f3921b579 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:08.192562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68cb78a-28d8-427a-ab8c-760f3921b579 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:08.193241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68cb78a-28d8-427a-ab8c-760f3921b579 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:08.193687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68cb78a-28d8-427a-ab8c-760f3921b579 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:08.194103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c68cb78a-28d8-427a-ab8c-760f3921b579 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:08.223232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c68cb78a-28d8-427a-ab8c-760f3921b579 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Aug 31 00:38:08.223773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 422/916] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:08 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:08.293607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1b06a088-c270-4633-bf8f-8f1df708f5dd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:08.295819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1b06a088-c270-4633-bf8f-8f1df708f5dd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:08.302151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b06a088-c270-4633-bf8f-8f1df708f5dd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:08.302631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b06a088-c270-4633-bf8f-8f1df708f5dd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:08.303081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b06a088-c270-4633-bf8f-8f1df708f5dd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:08.303768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b06a088-c270-4633-bf8f-8f1df708f5dd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:08.304214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b06a088-c270-4633-bf8f-8f1df708f5dd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:08.304629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b06a088-c270-4633-bf8f-8f1df708f5dd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:08.336172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1b06a088-c270-4633-bf8f-8f1df708f5dd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047194 Aug 31 00:38:08.336771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 495/917] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:08.357559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a078dc5c-6447-4e5f-a10d-ad5006d382b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:08.359987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a078dc5c-6447-4e5f-a10d-ad5006d382b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:08.366243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a078dc5c-6447-4e5f-a10d-ad5006d382b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:08.366723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a078dc5c-6447-4e5f-a10d-ad5006d382b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:08.367189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a078dc5c-6447-4e5f-a10d-ad5006d382b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:08.368528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a078dc5c-6447-4e5f-a10d-ad5006d382b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:08.369202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a078dc5c-6447-4e5f-a10d-ad5006d382b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:08.369404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a078dc5c-6447-4e5f-a10d-ad5006d382b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:08.399147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a078dc5c-6447-4e5f-a10d-ad5006d382b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045204 Aug 31 00:38:08.399483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 423/918] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:09.236362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e159805e-92b0-4199-a121-8fca93c58124 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:09.238495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e159805e-92b0-4199-a121-8fca93c58124 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:09.245136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e159805e-92b0-4199-a121-8fca93c58124 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:09.245613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e159805e-92b0-4199-a121-8fca93c58124 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:09.246049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e159805e-92b0-4199-a121-8fca93c58124 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:09.246733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e159805e-92b0-4199-a121-8fca93c58124 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:09.247227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e159805e-92b0-4199-a121-8fca93c58124 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:09.247652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e159805e-92b0-4199-a121-8fca93c58124 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:09.277510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e159805e-92b0-4199-a121-8fca93c58124 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045406 Aug 31 00:38:09.278068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 496/919] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:09 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:09.348849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5129e14d-c2a1-4b5b-a6a4-0d4111c81e92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:09.351192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5129e14d-c2a1-4b5b-a6a4-0d4111c81e92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:09.357546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5129e14d-c2a1-4b5b-a6a4-0d4111c81e92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:09.358123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5129e14d-c2a1-4b5b-a6a4-0d4111c81e92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:09.358677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5129e14d-c2a1-4b5b-a6a4-0d4111c81e92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:09.359525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5129e14d-c2a1-4b5b-a6a4-0d4111c81e92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:09.360053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5129e14d-c2a1-4b5b-a6a4-0d4111c81e92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:09.360493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5129e14d-c2a1-4b5b-a6a4-0d4111c81e92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:09.394314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5129e14d-c2a1-4b5b-a6a4-0d4111c81e92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049557 Aug 31 00:38:09.394861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 424/920] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:09.411748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-673d6316-821c-4c9a-9951-2cf686b025a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:09.413905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-673d6316-821c-4c9a-9951-2cf686b025a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:09.420321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-673d6316-821c-4c9a-9951-2cf686b025a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:09.420733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-673d6316-821c-4c9a-9951-2cf686b025a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:09.421158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-673d6316-821c-4c9a-9951-2cf686b025a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:09.421832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-673d6316-821c-4c9a-9951-2cf686b025a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:09.422276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-673d6316-821c-4c9a-9951-2cf686b025a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:09.422689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-673d6316-821c-4c9a-9951-2cf686b025a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:09.453480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-673d6316-821c-4c9a-9951-2cf686b025a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045530 Aug 31 00:38:09.454038 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 497/921] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:10.289623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fc8d8041-9129-4eeb-bde6-eebd8613ebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:10.292446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fc8d8041-9129-4eeb-bde6-eebd8613ebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:10.298489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc8d8041-9129-4eeb-bde6-eebd8613ebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:10.298969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc8d8041-9129-4eeb-bde6-eebd8613ebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:10.299437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc8d8041-9129-4eeb-bde6-eebd8613ebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:10.300119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc8d8041-9129-4eeb-bde6-eebd8613ebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:10.300569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc8d8041-9129-4eeb-bde6-eebd8613ebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:10.300989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc8d8041-9129-4eeb-bde6-eebd8613ebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:10.336716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fc8d8041-9129-4eeb-bde6-eebd8613ebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050647 Aug 31 00:38:10.337691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 425/922] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:10 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:10.407158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0bc2c4d7-2ce4-4e3d-a14c-173ef8065795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:10.410422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0bc2c4d7-2ce4-4e3d-a14c-173ef8065795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:10.419993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bc2c4d7-2ce4-4e3d-a14c-173ef8065795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:10.420645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bc2c4d7-2ce4-4e3d-a14c-173ef8065795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:10.420907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bc2c4d7-2ce4-4e3d-a14c-173ef8065795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:10.421638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bc2c4d7-2ce4-4e3d-a14c-173ef8065795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:10.422091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bc2c4d7-2ce4-4e3d-a14c-173ef8065795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:10.422511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bc2c4d7-2ce4-4e3d-a14c-173ef8065795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:10.462324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0bc2c4d7-2ce4-4e3d-a14c-173ef8065795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058879 Aug 31 00:38:10.463297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 498/923] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:38:10.466262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6c1dba4a-a245-4dd5-be6a-ba8afe8b5235 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:10.468649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6c1dba4a-a245-4dd5-be6a-ba8afe8b5235 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:10.475309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c1dba4a-a245-4dd5-be6a-ba8afe8b5235 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:10.475789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c1dba4a-a245-4dd5-be6a-ba8afe8b5235 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:10.476215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c1dba4a-a245-4dd5-be6a-ba8afe8b5235 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:10.477010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c1dba4a-a245-4dd5-be6a-ba8afe8b5235 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:10.477457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c1dba4a-a245-4dd5-be6a-ba8afe8b5235 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:10.477885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c1dba4a-a245-4dd5-be6a-ba8afe8b5235 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:10.513296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6c1dba4a-a245-4dd5-be6a-ba8afe8b5235 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051153 Aug 31 00:38:10.513870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 426/924] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:11.349811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eb7b0f57-144b-4c3b-b5dd-9c10e7980988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:11.351984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eb7b0f57-144b-4c3b-b5dd-9c10e7980988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:11.358662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb7b0f57-144b-4c3b-b5dd-9c10e7980988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:11.359441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb7b0f57-144b-4c3b-b5dd-9c10e7980988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:11.359879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb7b0f57-144b-4c3b-b5dd-9c10e7980988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:11.360569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb7b0f57-144b-4c3b-b5dd-9c10e7980988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:11.361022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb7b0f57-144b-4c3b-b5dd-9c10e7980988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:11.361444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb7b0f57-144b-4c3b-b5dd-9c10e7980988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:11.391240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eb7b0f57-144b-4c3b-b5dd-9c10e7980988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045305 Aug 31 00:38:11.391793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 499/925] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:11 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:11.475197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3dc3de86-dc7c-4bbc-997e-97e216107360 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:11.477335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3dc3de86-dc7c-4bbc-997e-97e216107360 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:11.486557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3dc3de86-dc7c-4bbc-997e-97e216107360 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:11.487052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3dc3de86-dc7c-4bbc-997e-97e216107360 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:11.487491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3dc3de86-dc7c-4bbc-997e-97e216107360 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:11.488175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3dc3de86-dc7c-4bbc-997e-97e216107360 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:11.488623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3dc3de86-dc7c-4bbc-997e-97e216107360 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:11.489038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3dc3de86-dc7c-4bbc-997e-97e216107360 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:11.519134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3dc3de86-dc7c-4bbc-997e-97e216107360 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047855 Aug 31 00:38:11.519687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 427/926] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:11.526061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f09fe5ed-2dd8-4d48-86f0-75533a9121d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:11.528248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f09fe5ed-2dd8-4d48-86f0-75533a9121d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:11.534592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f09fe5ed-2dd8-4d48-86f0-75533a9121d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:11.535090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f09fe5ed-2dd8-4d48-86f0-75533a9121d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:11.535555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f09fe5ed-2dd8-4d48-86f0-75533a9121d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:11.536232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f09fe5ed-2dd8-4d48-86f0-75533a9121d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:11.536677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f09fe5ed-2dd8-4d48-86f0-75533a9121d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:11.537091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f09fe5ed-2dd8-4d48-86f0-75533a9121d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:11.566342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f09fe5ed-2dd8-4d48-86f0-75533a9121d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Aug 31 00:38:11.567028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 500/927] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:12.404089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f31a4278-b1fd-4d4a-8279-c0643f727ba1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:12.406232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f31a4278-b1fd-4d4a-8279-c0643f727ba1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:12.408114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:12.408769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:12.414768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f31a4278-b1fd-4d4a-8279-c0643f727ba1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:12.415326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f31a4278-b1fd-4d4a-8279-c0643f727ba1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:12.416072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f31a4278-b1fd-4d4a-8279-c0643f727ba1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:12.416811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f31a4278-b1fd-4d4a-8279-c0643f727ba1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:12.417266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f31a4278-b1fd-4d4a-8279-c0643f727ba1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:12.417690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f31a4278-b1fd-4d4a-8279-c0643f727ba1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:12.450326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f31a4278-b1fd-4d4a-8279-c0643f727ba1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050536 Aug 31 00:38:12.450875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 428/928] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:12 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:12.531533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d29717da-874a-4d2e-b525-c6e8e7a70f75 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:12.534281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d29717da-874a-4d2e-b525-c6e8e7a70f75 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:12.541212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29717da-874a-4d2e-b525-c6e8e7a70f75 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:12.541695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29717da-874a-4d2e-b525-c6e8e7a70f75 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:12.542128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29717da-874a-4d2e-b525-c6e8e7a70f75 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:12.542817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29717da-874a-4d2e-b525-c6e8e7a70f75 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:12.543555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29717da-874a-4d2e-b525-c6e8e7a70f75 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:12.543826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d29717da-874a-4d2e-b525-c6e8e7a70f75 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:12.574369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d29717da-874a-4d2e-b525-c6e8e7a70f75 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046890 Aug 31 00:38:12.574948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 501/929] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:12.578340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9fdd9fd7-6766-49df-badf-2ece1c4e6ad0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:12.580571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9fdd9fd7-6766-49df-badf-2ece1c4e6ad0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:12.586938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fdd9fd7-6766-49df-badf-2ece1c4e6ad0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:12.587549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fdd9fd7-6766-49df-badf-2ece1c4e6ad0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:12.588161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fdd9fd7-6766-49df-badf-2ece1c4e6ad0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:12.588754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fdd9fd7-6766-49df-badf-2ece1c4e6ad0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:12.589210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fdd9fd7-6766-49df-badf-2ece1c4e6ad0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:12.589630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fdd9fd7-6766-49df-badf-2ece1c4e6ad0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:12.619314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9fdd9fd7-6766-49df-badf-2ece1c4e6ad0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Aug 31 00:38:12.620126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 429/930] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:13.463512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-43995398-3cff-431e-a345-eed705b0279a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:13.465635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-43995398-3cff-431e-a345-eed705b0279a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:13.471610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43995398-3cff-431e-a345-eed705b0279a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:13.472085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43995398-3cff-431e-a345-eed705b0279a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:13.472573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43995398-3cff-431e-a345-eed705b0279a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:13.473252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43995398-3cff-431e-a345-eed705b0279a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:13.473695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43995398-3cff-431e-a345-eed705b0279a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:13.474110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43995398-3cff-431e-a345-eed705b0279a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:13.493930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:13.507696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-43995398-3cff-431e-a345-eed705b0279a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048894 Aug 31 00:38:13.508267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 502/931] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:13 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:13.586781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5dd8c716-c35e-4808-ba99-faf310294b65 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:13.589742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5dd8c716-c35e-4808-ba99-faf310294b65 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:13.596126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dd8c716-c35e-4808-ba99-faf310294b65 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:13.596602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dd8c716-c35e-4808-ba99-faf310294b65 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:13.597033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dd8c716-c35e-4808-ba99-faf310294b65 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:13.597711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dd8c716-c35e-4808-ba99-faf310294b65 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:13.598159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dd8c716-c35e-4808-ba99-faf310294b65 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:13.598576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dd8c716-c35e-4808-ba99-faf310294b65 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:13.630942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1090db7e-db50-47cf-b2ea-83307447fedc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:13.631765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5dd8c716-c35e-4808-ba99-faf310294b65 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048903 Aug 31 00:38:13.632328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 430/932] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:13.633156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1090db7e-db50-47cf-b2ea-83307447fedc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:13.640427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1090db7e-db50-47cf-b2ea-83307447fedc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:13.640916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1090db7e-db50-47cf-b2ea-83307447fedc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:13.641349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1090db7e-db50-47cf-b2ea-83307447fedc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:13.642045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1090db7e-db50-47cf-b2ea-83307447fedc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:13.642497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1090db7e-db50-47cf-b2ea-83307447fedc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:13.642921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1090db7e-db50-47cf-b2ea-83307447fedc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:13.672569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1090db7e-db50-47cf-b2ea-83307447fedc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045684 Aug 31 00:38:13.673123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 503/933] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:14.526090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3b2a28ec-7702-43e0-b90f-ff64d0c2d941 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:14.528363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3b2a28ec-7702-43e0-b90f-ff64d0c2d941 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:14.534304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b2a28ec-7702-43e0-b90f-ff64d0c2d941 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:14.534783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b2a28ec-7702-43e0-b90f-ff64d0c2d941 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:14.535253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b2a28ec-7702-43e0-b90f-ff64d0c2d941 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:14.535940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b2a28ec-7702-43e0-b90f-ff64d0c2d941 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:14.536393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b2a28ec-7702-43e0-b90f-ff64d0c2d941 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:14.536817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b2a28ec-7702-43e0-b90f-ff64d0c2d941 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:14.568151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3b2a28ec-7702-43e0-b90f-ff64d0c2d941 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Aug 31 00:38:14.568711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 431/934] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:14 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:14.644836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-623e9c2b-16bb-4377-bf78-903bcd7f0c8b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:14.647019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-623e9c2b-16bb-4377-bf78-903bcd7f0c8b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:14.653532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-623e9c2b-16bb-4377-bf78-903bcd7f0c8b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:14.654026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-623e9c2b-16bb-4377-bf78-903bcd7f0c8b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:14.654450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-623e9c2b-16bb-4377-bf78-903bcd7f0c8b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:14.655162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-623e9c2b-16bb-4377-bf78-903bcd7f0c8b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:14.655616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-623e9c2b-16bb-4377-bf78-903bcd7f0c8b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:14.656039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-623e9c2b-16bb-4377-bf78-903bcd7f0c8b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:14.685707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-623e9c2b-16bb-4377-bf78-903bcd7f0c8b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044841 Aug 31 00:38:14.685909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6ac926e9-d598-43a0-b456-88670a248135 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:14.686373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 504/935] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:14.688357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6ac926e9-d598-43a0-b456-88670a248135 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:14.694735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ac926e9-d598-43a0-b456-88670a248135 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:14.695264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ac926e9-d598-43a0-b456-88670a248135 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:14.695705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ac926e9-d598-43a0-b456-88670a248135 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:14.696498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ac926e9-d598-43a0-b456-88670a248135 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:14.697966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ac926e9-d598-43a0-b456-88670a248135 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:14.698318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ac926e9-d598-43a0-b456-88670a248135 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:14.702184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:14.743911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6ac926e9-d598-43a0-b456-88670a248135 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062403 Aug 31 00:38:14.746286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 432/936] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:15.581250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-57c6d283-aa28-4f99-8bd6-a509c9201560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:15.583419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-57c6d283-aa28-4f99-8bd6-a509c9201560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:15.589739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57c6d283-aa28-4f99-8bd6-a509c9201560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:15.590229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57c6d283-aa28-4f99-8bd6-a509c9201560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:15.590668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57c6d283-aa28-4f99-8bd6-a509c9201560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:15.591383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57c6d283-aa28-4f99-8bd6-a509c9201560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:15.591840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57c6d283-aa28-4f99-8bd6-a509c9201560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:15.592265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57c6d283-aa28-4f99-8bd6-a509c9201560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:15.624129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-57c6d283-aa28-4f99-8bd6-a509c9201560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046800 Aug 31 00:38:15.624736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 505/937] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:15 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:15.698246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93279ded-07e7-40d4-88e1-a7f72bc1aad5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:15.700393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-93279ded-07e7-40d4-88e1-a7f72bc1aad5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:15.706920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93279ded-07e7-40d4-88e1-a7f72bc1aad5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:15.707466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93279ded-07e7-40d4-88e1-a7f72bc1aad5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:15.707994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93279ded-07e7-40d4-88e1-a7f72bc1aad5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:15.708735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93279ded-07e7-40d4-88e1-a7f72bc1aad5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:15.709209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93279ded-07e7-40d4-88e1-a7f72bc1aad5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:15.709636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93279ded-07e7-40d4-88e1-a7f72bc1aad5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:15.739717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-93279ded-07e7-40d4-88e1-a7f72bc1aad5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045604 Aug 31 00:38:15.740261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 433/938] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:15.756855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ebd96a90-50e5-4270-ae78-ecf7bfa1ab08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:15.758987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ebd96a90-50e5-4270-ae78-ecf7bfa1ab08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:15.765368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd96a90-50e5-4270-ae78-ecf7bfa1ab08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:15.765850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd96a90-50e5-4270-ae78-ecf7bfa1ab08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:15.766287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd96a90-50e5-4270-ae78-ecf7bfa1ab08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:15.766978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd96a90-50e5-4270-ae78-ecf7bfa1ab08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:15.767461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd96a90-50e5-4270-ae78-ecf7bfa1ab08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:15.767887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd96a90-50e5-4270-ae78-ecf7bfa1ab08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:15.798430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ebd96a90-50e5-4270-ae78-ecf7bfa1ab08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Aug 31 00:38:15.798992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 506/939] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:16.637299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3b7fe5c8-e5ad-499e-b57e-c7b7c5c72104 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:16.639450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3b7fe5c8-e5ad-499e-b57e-c7b7c5c72104 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:16.645341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b7fe5c8-e5ad-499e-b57e-c7b7c5c72104 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:16.645799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b7fe5c8-e5ad-499e-b57e-c7b7c5c72104 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:16.646223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b7fe5c8-e5ad-499e-b57e-c7b7c5c72104 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:16.646889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b7fe5c8-e5ad-499e-b57e-c7b7c5c72104 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:16.647362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b7fe5c8-e5ad-499e-b57e-c7b7c5c72104 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:16.647775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b7fe5c8-e5ad-499e-b57e-c7b7c5c72104 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:16.682784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3b7fe5c8-e5ad-499e-b57e-c7b7c5c72104 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050099 Aug 31 00:38:16.683358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 434/940] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:16 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:16.752858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-994fa9d4-e945-42a7-a7c9-2a5b4a280d61 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:16.755061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-994fa9d4-e945-42a7-a7c9-2a5b4a280d61 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:16.761973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-994fa9d4-e945-42a7-a7c9-2a5b4a280d61 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:16.762536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-994fa9d4-e945-42a7-a7c9-2a5b4a280d61 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:16.762875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-994fa9d4-e945-42a7-a7c9-2a5b4a280d61 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:16.763598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-994fa9d4-e945-42a7-a7c9-2a5b4a280d61 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:16.764054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-994fa9d4-e945-42a7-a7c9-2a5b4a280d61 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:16.764478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-994fa9d4-e945-42a7-a7c9-2a5b4a280d61 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:16.795489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-994fa9d4-e945-42a7-a7c9-2a5b4a280d61 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046547 Aug 31 00:38:16.796047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 507/941] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:16.810346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-370ba71e-bc8f-4608-810f-4d4c53c37679 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:16.812598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-370ba71e-bc8f-4608-810f-4d4c53c37679 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:16.818969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-370ba71e-bc8f-4608-810f-4d4c53c37679 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:16.819484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-370ba71e-bc8f-4608-810f-4d4c53c37679 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:16.819919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-370ba71e-bc8f-4608-810f-4d4c53c37679 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:16.820603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-370ba71e-bc8f-4608-810f-4d4c53c37679 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:16.821056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-370ba71e-bc8f-4608-810f-4d4c53c37679 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:16.821478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-370ba71e-bc8f-4608-810f-4d4c53c37679 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:16.851352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-370ba71e-bc8f-4608-810f-4d4c53c37679 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045466 Aug 31 00:38:16.851967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 435/942] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:17.695212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9c401f91-1763-4381-beee-8715743e1af1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:17.697331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9c401f91-1763-4381-beee-8715743e1af1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:17.703458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c401f91-1763-4381-beee-8715743e1af1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:17.703932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c401f91-1763-4381-beee-8715743e1af1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:17.704358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c401f91-1763-4381-beee-8715743e1af1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:17.705040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c401f91-1763-4381-beee-8715743e1af1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:17.705481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c401f91-1763-4381-beee-8715743e1af1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:17.705893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c401f91-1763-4381-beee-8715743e1af1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:17.736524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9c401f91-1763-4381-beee-8715743e1af1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045307 Aug 31 00:38:17.737073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 508/943] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:17 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:17.808148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6b1a5934-1df2-4865-8038-aa0c14b8a547 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:17.810252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6b1a5934-1df2-4865-8038-aa0c14b8a547 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:17.816577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a5934-1df2-4865-8038-aa0c14b8a547 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:17.817154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a5934-1df2-4865-8038-aa0c14b8a547 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:17.817453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a5934-1df2-4865-8038-aa0c14b8a547 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:17.818118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a5934-1df2-4865-8038-aa0c14b8a547 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:17.818563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a5934-1df2-4865-8038-aa0c14b8a547 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:17.818975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a5934-1df2-4865-8038-aa0c14b8a547 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:17.848919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6b1a5934-1df2-4865-8038-aa0c14b8a547 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044911 Aug 31 00:38:17.849469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 436/944] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:17.863946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9a2467ad-1d3a-432e-a8db-bd8e00f2504e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:17.866122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9a2467ad-1d3a-432e-a8db-bd8e00f2504e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:17.872803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a2467ad-1d3a-432e-a8db-bd8e00f2504e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:17.873283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a2467ad-1d3a-432e-a8db-bd8e00f2504e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:17.873720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a2467ad-1d3a-432e-a8db-bd8e00f2504e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:17.874409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a2467ad-1d3a-432e-a8db-bd8e00f2504e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:17.874863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a2467ad-1d3a-432e-a8db-bd8e00f2504e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:17.875315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a2467ad-1d3a-432e-a8db-bd8e00f2504e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:17.905966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9a2467ad-1d3a-432e-a8db-bd8e00f2504e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045966 Aug 31 00:38:17.906524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 509/945] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:18.748940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-aeba7609-c0c3-4a40-865c-7152fa035b32 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:18.750948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-aeba7609-c0c3-4a40-865c-7152fa035b32 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:18.756899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aeba7609-c0c3-4a40-865c-7152fa035b32 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:18.757372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aeba7609-c0c3-4a40-865c-7152fa035b32 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:18.757795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aeba7609-c0c3-4a40-865c-7152fa035b32 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:18.758467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aeba7609-c0c3-4a40-865c-7152fa035b32 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:18.758908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aeba7609-c0c3-4a40-865c-7152fa035b32 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:18.759986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aeba7609-c0c3-4a40-865c-7152fa035b32 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:18.789264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-aeba7609-c0c3-4a40-865c-7152fa035b32 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044324 Aug 31 00:38:18.789805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 437/946] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:18 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:18.862202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6cbe608a-59a6-457c-87f0-6996b6d1edad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:18.864342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6cbe608a-59a6-457c-87f0-6996b6d1edad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:18.871696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cbe608a-59a6-457c-87f0-6996b6d1edad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:18.872172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cbe608a-59a6-457c-87f0-6996b6d1edad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:18.872616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cbe608a-59a6-457c-87f0-6996b6d1edad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:18.873287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cbe608a-59a6-457c-87f0-6996b6d1edad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:18.874106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cbe608a-59a6-457c-87f0-6996b6d1edad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:18.874525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cbe608a-59a6-457c-87f0-6996b6d1edad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:18.904916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6cbe608a-59a6-457c-87f0-6996b6d1edad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046909 Aug 31 00:38:18.905457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 510/947] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:18.917937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4e9d6da1-4b52-45ac-a78e-7d0130ab1ab0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:18.920112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4e9d6da1-4b52-45ac-a78e-7d0130ab1ab0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:18.926452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e9d6da1-4b52-45ac-a78e-7d0130ab1ab0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:18.926929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e9d6da1-4b52-45ac-a78e-7d0130ab1ab0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:18.927400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e9d6da1-4b52-45ac-a78e-7d0130ab1ab0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:18.928085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e9d6da1-4b52-45ac-a78e-7d0130ab1ab0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:18.928535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e9d6da1-4b52-45ac-a78e-7d0130ab1ab0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:18.928955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e9d6da1-4b52-45ac-a78e-7d0130ab1ab0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:18.958737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4e9d6da1-4b52-45ac-a78e-7d0130ab1ab0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044915 Aug 31 00:38:18.959320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 438/948] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:18 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:19.801611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a6aa6415-2880-49b0-943e-745a08a3ec47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:19.803726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a6aa6415-2880-49b0-943e-745a08a3ec47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:19.810496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6aa6415-2880-49b0-943e-745a08a3ec47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:19.810971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6aa6415-2880-49b0-943e-745a08a3ec47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:19.811433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6aa6415-2880-49b0-943e-745a08a3ec47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:19.812125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6aa6415-2880-49b0-943e-745a08a3ec47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:19.812575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6aa6415-2880-49b0-943e-745a08a3ec47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:19.812993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6aa6415-2880-49b0-943e-745a08a3ec47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:19.846208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a6aa6415-2880-49b0-943e-745a08a3ec47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048579 Aug 31 00:38:19.846760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 511/949] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:19 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:19.918211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-79c39129-7aa9-4828-a9f7-0d46a0d97f79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:19.920366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-79c39129-7aa9-4828-a9f7-0d46a0d97f79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:19.926377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c39129-7aa9-4828-a9f7-0d46a0d97f79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:19.926850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c39129-7aa9-4828-a9f7-0d46a0d97f79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:19.927304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c39129-7aa9-4828-a9f7-0d46a0d97f79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:19.927977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c39129-7aa9-4828-a9f7-0d46a0d97f79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:19.928422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c39129-7aa9-4828-a9f7-0d46a0d97f79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:19.928840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c39129-7aa9-4828-a9f7-0d46a0d97f79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:19.958065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-79c39129-7aa9-4828-a9f7-0d46a0d97f79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044760 Aug 31 00:38:19.958612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 439/950] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:19.971410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-86fda46e-aff1-4722-ab8a-c9f5a156b750 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:19.973586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-86fda46e-aff1-4722-ab8a-c9f5a156b750 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:19.981047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86fda46e-aff1-4722-ab8a-c9f5a156b750 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:19.981529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86fda46e-aff1-4722-ab8a-c9f5a156b750 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:19.981957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86fda46e-aff1-4722-ab8a-c9f5a156b750 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:19.982653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86fda46e-aff1-4722-ab8a-c9f5a156b750 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:19.983132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86fda46e-aff1-4722-ab8a-c9f5a156b750 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:19.983553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86fda46e-aff1-4722-ab8a-c9f5a156b750 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:20.017081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-86fda46e-aff1-4722-ab8a-c9f5a156b750 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049616 Aug 31 00:38:20.017644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 512/951] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:20.859185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-75dcffac-37af-4098-9ef0-df40e0a5af59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:20.861286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-75dcffac-37af-4098-9ef0-df40e0a5af59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:20.867219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75dcffac-37af-4098-9ef0-df40e0a5af59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:20.867696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75dcffac-37af-4098-9ef0-df40e0a5af59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:20.868262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75dcffac-37af-4098-9ef0-df40e0a5af59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:20.869778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75dcffac-37af-4098-9ef0-df40e0a5af59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:20.870230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75dcffac-37af-4098-9ef0-df40e0a5af59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:20.870676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75dcffac-37af-4098-9ef0-df40e0a5af59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:20.904065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-75dcffac-37af-4098-9ef0-df40e0a5af59 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049073 Aug 31 00:38:20.904621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 440/952] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:20 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:20.970690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e717b9ee-92e7-4e1c-963c-6a78d77b6886 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:20.972835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e717b9ee-92e7-4e1c-963c-6a78d77b6886 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:20.979451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e717b9ee-92e7-4e1c-963c-6a78d77b6886 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:20.979923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e717b9ee-92e7-4e1c-963c-6a78d77b6886 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:20.980348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e717b9ee-92e7-4e1c-963c-6a78d77b6886 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:20.981025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e717b9ee-92e7-4e1c-963c-6a78d77b6886 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:20.981465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e717b9ee-92e7-4e1c-963c-6a78d77b6886 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:20.981879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e717b9ee-92e7-4e1c-963c-6a78d77b6886 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:21.013840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e717b9ee-92e7-4e1c-963c-6a78d77b6886 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047222 Aug 31 00:38:21.014413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 513/953] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:21.029526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ce3ca090-3a58-4d3b-9c70-3557b7d0eec5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:21.031723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ce3ca090-3a58-4d3b-9c70-3557b7d0eec5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:21.038069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce3ca090-3a58-4d3b-9c70-3557b7d0eec5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:21.038542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce3ca090-3a58-4d3b-9c70-3557b7d0eec5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:21.038970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce3ca090-3a58-4d3b-9c70-3557b7d0eec5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:21.039670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce3ca090-3a58-4d3b-9c70-3557b7d0eec5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:21.040154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce3ca090-3a58-4d3b-9c70-3557b7d0eec5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:21.041164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce3ca090-3a58-4d3b-9c70-3557b7d0eec5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:21.070940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ce3ca090-3a58-4d3b-9c70-3557b7d0eec5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Aug 31 00:38:21.071836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 441/954] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:21 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:21.917517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-13eb828a-99f1-4715-adf3-cbe3744ddf9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:21.919641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-13eb828a-99f1-4715-adf3-cbe3744ddf9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:21.925744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13eb828a-99f1-4715-adf3-cbe3744ddf9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:21.926254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13eb828a-99f1-4715-adf3-cbe3744ddf9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:21.926720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13eb828a-99f1-4715-adf3-cbe3744ddf9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:21.927473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13eb828a-99f1-4715-adf3-cbe3744ddf9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:21.927925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13eb828a-99f1-4715-adf3-cbe3744ddf9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:21.928344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13eb828a-99f1-4715-adf3-cbe3744ddf9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:21.958516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-13eb828a-99f1-4715-adf3-cbe3744ddf9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Aug 31 00:38:21.959086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 514/955] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:21 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:22.027198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6143c6c1-88dc-4dac-a565-758652add2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:22.029338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6143c6c1-88dc-4dac-a565-758652add2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:22.032335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:22.036433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6143c6c1-88dc-4dac-a565-758652add2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:22.036913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6143c6c1-88dc-4dac-a565-758652add2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:22.037340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6143c6c1-88dc-4dac-a565-758652add2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:22.038030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6143c6c1-88dc-4dac-a565-758652add2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:22.038477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6143c6c1-88dc-4dac-a565-758652add2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:22.038895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6143c6c1-88dc-4dac-a565-758652add2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:22.070445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6143c6c1-88dc-4dac-a565-758652add2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047711 Aug 31 00:38:22.070997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 442/956] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:22.082661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-46be0a58-bbe3-4b49-ada2-50f11ef0fa2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:22.084807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-46be0a58-bbe3-4b49-ada2-50f11ef0fa2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:22.091845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46be0a58-bbe3-4b49-ada2-50f11ef0fa2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:22.092321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46be0a58-bbe3-4b49-ada2-50f11ef0fa2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:22.092749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46be0a58-bbe3-4b49-ada2-50f11ef0fa2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:22.093430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46be0a58-bbe3-4b49-ada2-50f11ef0fa2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:22.093878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46be0a58-bbe3-4b49-ada2-50f11ef0fa2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:22.094291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46be0a58-bbe3-4b49-ada2-50f11ef0fa2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:22.123768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-46be0a58-bbe3-4b49-ada2-50f11ef0fa2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Aug 31 00:38:22.124316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 515/957] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:22 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:22.971388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-eaad35fa-2877-414d-b3a0-23d0d536ec6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:22.973512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eaad35fa-2877-414d-b3a0-23d0d536ec6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:22.979747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaad35fa-2877-414d-b3a0-23d0d536ec6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:22.980320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaad35fa-2877-414d-b3a0-23d0d536ec6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:22.980754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaad35fa-2877-414d-b3a0-23d0d536ec6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:22.981440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaad35fa-2877-414d-b3a0-23d0d536ec6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:22.981895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaad35fa-2877-414d-b3a0-23d0d536ec6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:22.982327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eaad35fa-2877-414d-b3a0-23d0d536ec6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:23.013603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-eaad35fa-2877-414d-b3a0-23d0d536ec6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046262 Aug 31 00:38:23.014168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 443/958] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:22 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:23.082991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c1fe48e1-f860-41c0-9750-6956872d1582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:23.085362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c1fe48e1-f860-41c0-9750-6956872d1582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:23.093064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fe48e1-f860-41c0-9750-6956872d1582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:23.093574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fe48e1-f860-41c0-9750-6956872d1582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:23.094214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fe48e1-f860-41c0-9750-6956872d1582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:23.095214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fe48e1-f860-41c0-9750-6956872d1582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:23.095670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fe48e1-f860-41c0-9750-6956872d1582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:23.096086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fe48e1-f860-41c0-9750-6956872d1582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:23.126901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c1fe48e1-f860-41c0-9750-6956872d1582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048013 Aug 31 00:38:23.127485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 516/959] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:23.136512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-92ae8c14-2542-4f07-a8bf-95375b9f2a3f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:23.138663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-92ae8c14-2542-4f07-a8bf-95375b9f2a3f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:23.145087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92ae8c14-2542-4f07-a8bf-95375b9f2a3f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:23.145563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92ae8c14-2542-4f07-a8bf-95375b9f2a3f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:23.145997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92ae8c14-2542-4f07-a8bf-95375b9f2a3f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:23.146709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92ae8c14-2542-4f07-a8bf-95375b9f2a3f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:23.147190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92ae8c14-2542-4f07-a8bf-95375b9f2a3f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:23.147615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92ae8c14-2542-4f07-a8bf-95375b9f2a3f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:23.177044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-92ae8c14-2542-4f07-a8bf-95375b9f2a3f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Aug 31 00:38:23.177597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 444/960] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:24.027391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4f2ea18a-97ba-42c3-b7b4-697bd89ea6df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:24.029532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4f2ea18a-97ba-42c3-b7b4-697bd89ea6df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:24.035543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f2ea18a-97ba-42c3-b7b4-697bd89ea6df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.036026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f2ea18a-97ba-42c3-b7b4-697bd89ea6df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.036466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f2ea18a-97ba-42c3-b7b4-697bd89ea6df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.037152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f2ea18a-97ba-42c3-b7b4-697bd89ea6df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.037605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f2ea18a-97ba-42c3-b7b4-697bd89ea6df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.038028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f2ea18a-97ba-42c3-b7b4-697bd89ea6df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.067641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4f2ea18a-97ba-42c3-b7b4-697bd89ea6df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Aug 31 00:38:24.068189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 517/961] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:24 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:24.139931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c948064b-ee52-4f30-b0ae-4b59b062e439 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:24.142084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c948064b-ee52-4f30-b0ae-4b59b062e439 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:24.148467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c948064b-ee52-4f30-b0ae-4b59b062e439 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.148947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c948064b-ee52-4f30-b0ae-4b59b062e439 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.149556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c948064b-ee52-4f30-b0ae-4b59b062e439 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.151001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c948064b-ee52-4f30-b0ae-4b59b062e439 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.151473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c948064b-ee52-4f30-b0ae-4b59b062e439 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.151897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c948064b-ee52-4f30-b0ae-4b59b062e439 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.181410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c948064b-ee52-4f30-b0ae-4b59b062e439 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045460 Aug 31 00:38:24.181964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 445/962] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:24.189698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-54563aec-07c6-4788-8c40-3e7f4afddcd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:24.191862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-54563aec-07c6-4788-8c40-3e7f4afddcd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:24.198782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54563aec-07c6-4788-8c40-3e7f4afddcd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.199290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54563aec-07c6-4788-8c40-3e7f4afddcd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.199716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54563aec-07c6-4788-8c40-3e7f4afddcd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.200394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54563aec-07c6-4788-8c40-3e7f4afddcd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.200840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54563aec-07c6-4788-8c40-3e7f4afddcd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.201254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54563aec-07c6-4788-8c40-3e7f4afddcd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.231213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-54563aec-07c6-4788-8c40-3e7f4afddcd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045359 Aug 31 00:38:24.231769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 518/963] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:25.080713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5cfb7362-347d-4339-a2de-bf04100326e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:25.082823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5cfb7362-347d-4339-a2de-bf04100326e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:25.089496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cfb7362-347d-4339-a2de-bf04100326e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.089977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cfb7362-347d-4339-a2de-bf04100326e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.090411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cfb7362-347d-4339-a2de-bf04100326e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:25.091128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cfb7362-347d-4339-a2de-bf04100326e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.091585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cfb7362-347d-4339-a2de-bf04100326e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.092007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cfb7362-347d-4339-a2de-bf04100326e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:25.121677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5cfb7362-347d-4339-a2de-bf04100326e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044861 Aug 31 00:38:25.122220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 446/964] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:25 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:25.193871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-46e3bdd3-0940-4045-8998-de84ca8242ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:25.196181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-46e3bdd3-0940-4045-8998-de84ca8242ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:25.199782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:25.203847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46e3bdd3-0940-4045-8998-de84ca8242ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.204324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46e3bdd3-0940-4045-8998-de84ca8242ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.204759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46e3bdd3-0940-4045-8998-de84ca8242ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:25.205442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46e3bdd3-0940-4045-8998-de84ca8242ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.205899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46e3bdd3-0940-4045-8998-de84ca8242ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.206316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46e3bdd3-0940-4045-8998-de84ca8242ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:25.210068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:25.237725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-46e3bdd3-0940-4045-8998-de84ca8242ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047850 Aug 31 00:38:25.240090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 519/965] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:25.244440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d215d0b7-6d3f-4cc6-b8ff-06ffc62945b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:25.246559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d215d0b7-6d3f-4cc6-b8ff-06ffc62945b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:25.253107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d215d0b7-6d3f-4cc6-b8ff-06ffc62945b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.253609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d215d0b7-6d3f-4cc6-b8ff-06ffc62945b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.254127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d215d0b7-6d3f-4cc6-b8ff-06ffc62945b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:25.254812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d215d0b7-6d3f-4cc6-b8ff-06ffc62945b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.255298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d215d0b7-6d3f-4cc6-b8ff-06ffc62945b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.255723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d215d0b7-6d3f-4cc6-b8ff-06ffc62945b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:25.286677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d215d0b7-6d3f-4cc6-b8ff-06ffc62945b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046762 Aug 31 00:38:25.287267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 447/966] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:26.134171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fa4c8909-68b5-4053-a6b9-a57d6a43c071 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:26.136941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fa4c8909-68b5-4053-a6b9-a57d6a43c071 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:26.142918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa4c8909-68b5-4053-a6b9-a57d6a43c071 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:26.143422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa4c8909-68b5-4053-a6b9-a57d6a43c071 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:26.143850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa4c8909-68b5-4053-a6b9-a57d6a43c071 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:26.144527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa4c8909-68b5-4053-a6b9-a57d6a43c071 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:26.144972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa4c8909-68b5-4053-a6b9-a57d6a43c071 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:26.145389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa4c8909-68b5-4053-a6b9-a57d6a43c071 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:26.175628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fa4c8909-68b5-4053-a6b9-a57d6a43c071 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045538 Aug 31 00:38:26.176191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 520/967] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:26 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:26.250313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3023597a-f0c0-41c6-820b-d61d31dcc0ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:26.252609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3023597a-f0c0-41c6-820b-d61d31dcc0ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:26.259022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3023597a-f0c0-41c6-820b-d61d31dcc0ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:26.259526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3023597a-f0c0-41c6-820b-d61d31dcc0ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:26.259957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3023597a-f0c0-41c6-820b-d61d31dcc0ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:26.260637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3023597a-f0c0-41c6-820b-d61d31dcc0ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:26.261076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3023597a-f0c0-41c6-820b-d61d31dcc0ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:26.261491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3023597a-f0c0-41c6-820b-d61d31dcc0ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:26.286008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:26.291871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3023597a-f0c0-41c6-820b-d61d31dcc0ce tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045542 Aug 31 00:38:26.292439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 448/968] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:26.301673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eedd0042-264e-4ad4-bd91-9ee695ca0116 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:26.303858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eedd0042-264e-4ad4-bd91-9ee695ca0116 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:26.310856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedd0042-264e-4ad4-bd91-9ee695ca0116 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:26.311361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedd0042-264e-4ad4-bd91-9ee695ca0116 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:26.311787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedd0042-264e-4ad4-bd91-9ee695ca0116 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:26.312461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedd0042-264e-4ad4-bd91-9ee695ca0116 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:26.312902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedd0042-264e-4ad4-bd91-9ee695ca0116 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:26.313320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedd0042-264e-4ad4-bd91-9ee695ca0116 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:26.344054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eedd0042-264e-4ad4-bd91-9ee695ca0116 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 Aug 31 00:38:26.344604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 521/969] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:26 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:27.188191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-35669744-6af8-48b6-af2e-65467891a5a9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:27.190331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-35669744-6af8-48b6-af2e-65467891a5a9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:27.197224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35669744-6af8-48b6-af2e-65467891a5a9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:27.197713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35669744-6af8-48b6-af2e-65467891a5a9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:27.198242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35669744-6af8-48b6-af2e-65467891a5a9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:27.199132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35669744-6af8-48b6-af2e-65467891a5a9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:27.199727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35669744-6af8-48b6-af2e-65467891a5a9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:27.200245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35669744-6af8-48b6-af2e-65467891a5a9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:27.230213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-35669744-6af8-48b6-af2e-65467891a5a9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Aug 31 00:38:27.230760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 449/970] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:27 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:27.303777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2fd54943-147b-4d04-90ff-bf24579de25a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:27.306480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2fd54943-147b-4d04-90ff-bf24579de25a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:27.312877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fd54943-147b-4d04-90ff-bf24579de25a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:27.313362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fd54943-147b-4d04-90ff-bf24579de25a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:27.313796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fd54943-147b-4d04-90ff-bf24579de25a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:27.314485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fd54943-147b-4d04-90ff-bf24579de25a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:27.314935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fd54943-147b-4d04-90ff-bf24579de25a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:27.315384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fd54943-147b-4d04-90ff-bf24579de25a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:27.345016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2fd54943-147b-4d04-90ff-bf24579de25a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045228 Aug 31 00:38:27.345567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 522/971] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:27.356421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-18a7f0d0-e94f-4817-a2ac-0593cee77a0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:27.358568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-18a7f0d0-e94f-4817-a2ac-0593cee77a0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:27.365515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18a7f0d0-e94f-4817-a2ac-0593cee77a0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:27.366003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18a7f0d0-e94f-4817-a2ac-0593cee77a0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:27.366446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18a7f0d0-e94f-4817-a2ac-0593cee77a0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:27.367165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18a7f0d0-e94f-4817-a2ac-0593cee77a0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:27.367617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18a7f0d0-e94f-4817-a2ac-0593cee77a0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:27.368665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18a7f0d0-e94f-4817-a2ac-0593cee77a0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:27.398371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-18a7f0d0-e94f-4817-a2ac-0593cee77a0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046133 Aug 31 00:38:27.398920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 450/972] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:27 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:28.242077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e5b9958a-e009-40ac-af50-c60f35b48ac5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:28.244455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e5b9958a-e009-40ac-af50-c60f35b48ac5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:28.250381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5b9958a-e009-40ac-af50-c60f35b48ac5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:28.250853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5b9958a-e009-40ac-af50-c60f35b48ac5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:28.251322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5b9958a-e009-40ac-af50-c60f35b48ac5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:28.251998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5b9958a-e009-40ac-af50-c60f35b48ac5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:28.252442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5b9958a-e009-40ac-af50-c60f35b48ac5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:28.252854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5b9958a-e009-40ac-af50-c60f35b48ac5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:28.283990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e5b9958a-e009-40ac-af50-c60f35b48ac5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Aug 31 00:38:28.284539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 523/973] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:28 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:28.358113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c2561139-c67c-4bb5-a78c-ad1dbe0f8556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:28.360659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c2561139-c67c-4bb5-a78c-ad1dbe0f8556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:28.366957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2561139-c67c-4bb5-a78c-ad1dbe0f8556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:28.367465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2561139-c67c-4bb5-a78c-ad1dbe0f8556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:28.367902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2561139-c67c-4bb5-a78c-ad1dbe0f8556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:28.368633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2561139-c67c-4bb5-a78c-ad1dbe0f8556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:28.369114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2561139-c67c-4bb5-a78c-ad1dbe0f8556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:28.369533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2561139-c67c-4bb5-a78c-ad1dbe0f8556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:28.398765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c2561139-c67c-4bb5-a78c-ad1dbe0f8556 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044583 Aug 31 00:38:28.399960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 451/974] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:28.409666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a55294c1-db71-4ff7-b98f-e2277fcc7fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:28.411915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a55294c1-db71-4ff7-b98f-e2277fcc7fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:28.418347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a55294c1-db71-4ff7-b98f-e2277fcc7fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:28.418826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a55294c1-db71-4ff7-b98f-e2277fcc7fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:28.419287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a55294c1-db71-4ff7-b98f-e2277fcc7fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:28.419969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a55294c1-db71-4ff7-b98f-e2277fcc7fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:28.420411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a55294c1-db71-4ff7-b98f-e2277fcc7fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:28.420824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a55294c1-db71-4ff7-b98f-e2277fcc7fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:28.450351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a55294c1-db71-4ff7-b98f-e2277fcc7fac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Aug 31 00:38:28.450905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 524/975] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:29.296733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-213b3634-18a1-42f9-b66c-3bab5ab9236c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:29.298821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-213b3634-18a1-42f9-b66c-3bab5ab9236c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:29.304973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-213b3634-18a1-42f9-b66c-3bab5ab9236c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:29.305577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-213b3634-18a1-42f9-b66c-3bab5ab9236c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:29.306560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-213b3634-18a1-42f9-b66c-3bab5ab9236c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:29.307282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-213b3634-18a1-42f9-b66c-3bab5ab9236c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:29.307732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-213b3634-18a1-42f9-b66c-3bab5ab9236c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:29.308151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-213b3634-18a1-42f9-b66c-3bab5ab9236c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:29.337338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-213b3634-18a1-42f9-b66c-3bab5ab9236c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044501 Aug 31 00:38:29.337890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 452/976] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:29 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:29.411993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fda716b5-e77c-477e-8068-395ad76b169b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:29.414109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fda716b5-e77c-477e-8068-395ad76b169b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:29.421215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fda716b5-e77c-477e-8068-395ad76b169b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:29.421689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fda716b5-e77c-477e-8068-395ad76b169b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:29.422117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fda716b5-e77c-477e-8068-395ad76b169b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:29.422798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fda716b5-e77c-477e-8068-395ad76b169b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:29.423275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fda716b5-e77c-477e-8068-395ad76b169b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:29.423691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fda716b5-e77c-477e-8068-395ad76b169b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:29.453416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fda716b5-e77c-477e-8068-395ad76b169b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045295 Aug 31 00:38:29.453889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 525/977] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:29.462041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d9be34e2-ae3e-4945-a314-c4de830bcd26 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:29.464224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d9be34e2-ae3e-4945-a314-c4de830bcd26 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:29.470594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9be34e2-ae3e-4945-a314-c4de830bcd26 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:29.471105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9be34e2-ae3e-4945-a314-c4de830bcd26 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:29.471543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9be34e2-ae3e-4945-a314-c4de830bcd26 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:29.472233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9be34e2-ae3e-4945-a314-c4de830bcd26 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:29.472773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9be34e2-ae3e-4945-a314-c4de830bcd26 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:29.473193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9be34e2-ae3e-4945-a314-c4de830bcd26 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:29.503354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d9be34e2-ae3e-4945-a314-c4de830bcd26 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045385 Aug 31 00:38:29.503916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 453/978] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:30.349813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b3bc5c6a-35f7-458a-8c95-20cccc1a7715 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:30.352007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b3bc5c6a-35f7-458a-8c95-20cccc1a7715 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:30.358334 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3bc5c6a-35f7-458a-8c95-20cccc1a7715 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:30.358819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3bc5c6a-35f7-458a-8c95-20cccc1a7715 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:30.359249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3bc5c6a-35f7-458a-8c95-20cccc1a7715 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:30.359934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3bc5c6a-35f7-458a-8c95-20cccc1a7715 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:30.360383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3bc5c6a-35f7-458a-8c95-20cccc1a7715 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:30.360802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3bc5c6a-35f7-458a-8c95-20cccc1a7715 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:30.391030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b3bc5c6a-35f7-458a-8c95-20cccc1a7715 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Aug 31 00:38:30.391610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 526/979] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:30 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:30.465992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3e77961a-f1cc-4f3e-b54b-d8c1e089f90a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:30.468138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3e77961a-f1cc-4f3e-b54b-d8c1e089f90a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:30.480714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e77961a-f1cc-4f3e-b54b-d8c1e089f90a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:30.481210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e77961a-f1cc-4f3e-b54b-d8c1e089f90a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:30.481641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e77961a-f1cc-4f3e-b54b-d8c1e089f90a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:30.482334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e77961a-f1cc-4f3e-b54b-d8c1e089f90a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:30.482782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e77961a-f1cc-4f3e-b54b-d8c1e089f90a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:30.483252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e77961a-f1cc-4f3e-b54b-d8c1e089f90a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:30.514001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3e77961a-f1cc-4f3e-b54b-d8c1e089f90a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052321 Aug 31 00:38:30.514559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 454/980] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:30.516324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-086b7cee-8358-42d9-b54a-5e5b608a5c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:30.518434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-086b7cee-8358-42d9-b54a-5e5b608a5c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:30.524844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-086b7cee-8358-42d9-b54a-5e5b608a5c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:30.525310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-086b7cee-8358-42d9-b54a-5e5b608a5c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:30.525733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-086b7cee-8358-42d9-b54a-5e5b608a5c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:30.526413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-086b7cee-8358-42d9-b54a-5e5b608a5c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:30.526853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-086b7cee-8358-42d9-b54a-5e5b608a5c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:30.527298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-086b7cee-8358-42d9-b54a-5e5b608a5c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:30.556397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-086b7cee-8358-42d9-b54a-5e5b608a5c5f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043538 Aug 31 00:38:30.556939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 527/981] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:31.404151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6fae0366-c86d-46b6-bebe-2b22a0dc427c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:31.406286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6fae0366-c86d-46b6-bebe-2b22a0dc427c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:31.412265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6fae0366-c86d-46b6-bebe-2b22a0dc427c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:31.412732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6fae0366-c86d-46b6-bebe-2b22a0dc427c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:31.413158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6fae0366-c86d-46b6-bebe-2b22a0dc427c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:31.413826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6fae0366-c86d-46b6-bebe-2b22a0dc427c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:31.414267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6fae0366-c86d-46b6-bebe-2b22a0dc427c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:31.414708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6fae0366-c86d-46b6-bebe-2b22a0dc427c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:31.443646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6fae0366-c86d-46b6-bebe-2b22a0dc427c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Aug 31 00:38:31.444195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 455/982] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:31 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:31.526983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8000f7da-5cd5-4f74-80ec-b6bc2e80d9c8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:31.529139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8000f7da-5cd5-4f74-80ec-b6bc2e80d9c8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:31.535687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8000f7da-5cd5-4f74-80ec-b6bc2e80d9c8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:31.536085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8000f7da-5cd5-4f74-80ec-b6bc2e80d9c8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:31.536510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8000f7da-5cd5-4f74-80ec-b6bc2e80d9c8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:31.537195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8000f7da-5cd5-4f74-80ec-b6bc2e80d9c8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:31.537648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8000f7da-5cd5-4f74-80ec-b6bc2e80d9c8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:31.538067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8000f7da-5cd5-4f74-80ec-b6bc2e80d9c8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:31.567694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8000f7da-5cd5-4f74-80ec-b6bc2e80d9c8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045303 Aug 31 00:38:31.568251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 528/983] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:31.568774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-18042766-9c56-4405-8819-0080dadfd5ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:31.571565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-18042766-9c56-4405-8819-0080dadfd5ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:31.578007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18042766-9c56-4405-8819-0080dadfd5ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:31.578485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18042766-9c56-4405-8819-0080dadfd5ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:31.578916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18042766-9c56-4405-8819-0080dadfd5ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:31.579629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18042766-9c56-4405-8819-0080dadfd5ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:31.580079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18042766-9c56-4405-8819-0080dadfd5ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:31.580496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18042766-9c56-4405-8819-0080dadfd5ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:31.610578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-18042766-9c56-4405-8819-0080dadfd5ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 Aug 31 00:38:31.611164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 456/984] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:32.456727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-691d1735-c051-444d-bccc-86285955b94f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:32.458870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-691d1735-c051-444d-bccc-86285955b94f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:32.464834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-691d1735-c051-444d-bccc-86285955b94f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:32.465306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-691d1735-c051-444d-bccc-86285955b94f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:32.465732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-691d1735-c051-444d-bccc-86285955b94f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:32.466403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-691d1735-c051-444d-bccc-86285955b94f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:32.466844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-691d1735-c051-444d-bccc-86285955b94f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:32.467290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-691d1735-c051-444d-bccc-86285955b94f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:32.497773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-691d1735-c051-444d-bccc-86285955b94f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045021 Aug 31 00:38:32.498323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 529/985] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:32 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:32.580725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d184fb56-3128-4c60-8af5-0c6cf250434c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:32.583188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d184fb56-3128-4c60-8af5-0c6cf250434c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:32.590613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d184fb56-3128-4c60-8af5-0c6cf250434c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:32.591119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d184fb56-3128-4c60-8af5-0c6cf250434c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:32.591552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d184fb56-3128-4c60-8af5-0c6cf250434c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:32.592241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d184fb56-3128-4c60-8af5-0c6cf250434c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:32.592685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d184fb56-3128-4c60-8af5-0c6cf250434c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:32.593133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d184fb56-3128-4c60-8af5-0c6cf250434c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:32.622301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a93b157c-5f2f-4325-8561-536ab96b1777 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:32.624814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a93b157c-5f2f-4325-8561-536ab96b1777 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:32.626187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d184fb56-3128-4c60-8af5-0c6cf250434c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049320 Aug 31 00:38:32.627218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 457/986] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:32.636054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a93b157c-5f2f-4325-8561-536ab96b1777 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:32.636054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a93b157c-5f2f-4325-8561-536ab96b1777 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:32.636443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a93b157c-5f2f-4325-8561-536ab96b1777 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:32.637138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a93b157c-5f2f-4325-8561-536ab96b1777 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:32.637654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a93b157c-5f2f-4325-8561-536ab96b1777 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:32.638049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a93b157c-5f2f-4325-8561-536ab96b1777 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:32.670551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a93b157c-5f2f-4325-8561-536ab96b1777 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052195 Aug 31 00:38:32.671131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 530/987] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:33.510733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1b4ecbc1-2b84-46e1-a654-c370b26e6963 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:33.512795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1b4ecbc1-2b84-46e1-a654-c370b26e6963 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:33.518818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b4ecbc1-2b84-46e1-a654-c370b26e6963 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:33.519328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b4ecbc1-2b84-46e1-a654-c370b26e6963 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:33.519763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b4ecbc1-2b84-46e1-a654-c370b26e6963 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:33.520443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b4ecbc1-2b84-46e1-a654-c370b26e6963 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:33.520891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b4ecbc1-2b84-46e1-a654-c370b26e6963 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:33.521310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b4ecbc1-2b84-46e1-a654-c370b26e6963 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:33.550799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1b4ecbc1-2b84-46e1-a654-c370b26e6963 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044874 Aug 31 00:38:33.551381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 458/988] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:33 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:33.639298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-29c80bdf-12cc-47da-80a7-27178d57a1f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:33.641435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-29c80bdf-12cc-47da-80a7-27178d57a1f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:33.647782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29c80bdf-12cc-47da-80a7-27178d57a1f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:33.648258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29c80bdf-12cc-47da-80a7-27178d57a1f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:33.648688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29c80bdf-12cc-47da-80a7-27178d57a1f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:33.649421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29c80bdf-12cc-47da-80a7-27178d57a1f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:33.649867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29c80bdf-12cc-47da-80a7-27178d57a1f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:33.650282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29c80bdf-12cc-47da-80a7-27178d57a1f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:33.679872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-29c80bdf-12cc-47da-80a7-27178d57a1f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044518 Aug 31 00:38:33.680568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 531/989] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:33 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:38:33.683533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e0f0757a-e372-40da-8a74-18687e2c6775 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:33.685663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e0f0757a-e372-40da-8a74-18687e2c6775 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:33.692013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0f0757a-e372-40da-8a74-18687e2c6775 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:33.692486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0f0757a-e372-40da-8a74-18687e2c6775 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:33.692910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0f0757a-e372-40da-8a74-18687e2c6775 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:33.693583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0f0757a-e372-40da-8a74-18687e2c6775 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:33.694024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0f0757a-e372-40da-8a74-18687e2c6775 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:33.694436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0f0757a-e372-40da-8a74-18687e2c6775 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:33.724579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e0f0757a-e372-40da-8a74-18687e2c6775 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Aug 31 00:38:33.725136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 459/990] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:33 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:34.563679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0a30cf51-05bc-4548-a272-d60fa0a734ab tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:34.565709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0a30cf51-05bc-4548-a272-d60fa0a734ab tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:34.572443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a30cf51-05bc-4548-a272-d60fa0a734ab tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:34.572917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a30cf51-05bc-4548-a272-d60fa0a734ab tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:34.573352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a30cf51-05bc-4548-a272-d60fa0a734ab tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:34.574020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a30cf51-05bc-4548-a272-d60fa0a734ab tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:34.574466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a30cf51-05bc-4548-a272-d60fa0a734ab tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:34.574882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a30cf51-05bc-4548-a272-d60fa0a734ab tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:34.604259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0a30cf51-05bc-4548-a272-d60fa0a734ab tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Aug 31 00:38:34.604816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 532/991] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:34.692038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-81f2c085-95d4-4701-b184-53459ddd029c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:34.694114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-81f2c085-95d4-4701-b184-53459ddd029c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:34.701165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81f2c085-95d4-4701-b184-53459ddd029c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:34.701638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81f2c085-95d4-4701-b184-53459ddd029c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:34.702060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81f2c085-95d4-4701-b184-53459ddd029c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:34.702783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81f2c085-95d4-4701-b184-53459ddd029c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:34.703228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81f2c085-95d4-4701-b184-53459ddd029c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:34.703640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81f2c085-95d4-4701-b184-53459ddd029c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:34.733233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-81f2c085-95d4-4701-b184-53459ddd029c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045142 Aug 31 00:38:34.734225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 460/992] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:34.737546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3ff0dd3c-3c95-4d42-b0a5-026dbdd9def1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:34.739753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3ff0dd3c-3c95-4d42-b0a5-026dbdd9def1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:34.746215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ff0dd3c-3c95-4d42-b0a5-026dbdd9def1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:34.746693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ff0dd3c-3c95-4d42-b0a5-026dbdd9def1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:34.747158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ff0dd3c-3c95-4d42-b0a5-026dbdd9def1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:34.747846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ff0dd3c-3c95-4d42-b0a5-026dbdd9def1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:34.748295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ff0dd3c-3c95-4d42-b0a5-026dbdd9def1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:34.748742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ff0dd3c-3c95-4d42-b0a5-026dbdd9def1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:34.778976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3ff0dd3c-3c95-4d42-b0a5-026dbdd9def1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045583 Aug 31 00:38:34.779557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 533/993] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:34 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:35.616869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f0c23bfa-fe6b-4719-ab57-1b3401735261 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:35.618985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f0c23bfa-fe6b-4719-ab57-1b3401735261 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:35.625198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c23bfa-fe6b-4719-ab57-1b3401735261 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:35.625669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c23bfa-fe6b-4719-ab57-1b3401735261 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:35.626095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c23bfa-fe6b-4719-ab57-1b3401735261 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:35.626768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c23bfa-fe6b-4719-ab57-1b3401735261 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:35.627240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c23bfa-fe6b-4719-ab57-1b3401735261 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:35.627654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c23bfa-fe6b-4719-ab57-1b3401735261 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:35.657010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f0c23bfa-fe6b-4719-ab57-1b3401735261 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Aug 31 00:38:35.657594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 461/994] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:35 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:35.746134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ccac0295-2901-4911-ab00-c49b965b928a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:35.748197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ccac0295-2901-4911-ab00-c49b965b928a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:35.754662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccac0295-2901-4911-ab00-c49b965b928a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:35.755172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccac0295-2901-4911-ab00-c49b965b928a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:35.755605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccac0295-2901-4911-ab00-c49b965b928a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:35.756284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccac0295-2901-4911-ab00-c49b965b928a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:35.756729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccac0295-2901-4911-ab00-c49b965b928a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:35.757144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccac0295-2901-4911-ab00-c49b965b928a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:35.787026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ccac0295-2901-4911-ab00-c49b965b928a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044891 Aug 31 00:38:35.787618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 534/995] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:35.793343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ed03bbb1-ae2e-44b0-a417-80fc67725360 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:35.795822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ed03bbb1-ae2e-44b0-a417-80fc67725360 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:35.802875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed03bbb1-ae2e-44b0-a417-80fc67725360 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:35.803402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed03bbb1-ae2e-44b0-a417-80fc67725360 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:35.803832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed03bbb1-ae2e-44b0-a417-80fc67725360 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:35.804521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed03bbb1-ae2e-44b0-a417-80fc67725360 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:35.804968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed03bbb1-ae2e-44b0-a417-80fc67725360 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:35.805492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed03bbb1-ae2e-44b0-a417-80fc67725360 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:35.833859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ed03bbb1-ae2e-44b0-a417-80fc67725360 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046565 Aug 31 00:38:35.834403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 462/996] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:36.670068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e037ce74-eccb-4461-9fef-68f50cc35f45 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:36.672227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e037ce74-eccb-4461-9fef-68f50cc35f45 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:36.678181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e037ce74-eccb-4461-9fef-68f50cc35f45 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:36.678655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e037ce74-eccb-4461-9fef-68f50cc35f45 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:36.679140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e037ce74-eccb-4461-9fef-68f50cc35f45 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:36.679828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e037ce74-eccb-4461-9fef-68f50cc35f45 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:36.680311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e037ce74-eccb-4461-9fef-68f50cc35f45 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:36.680722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e037ce74-eccb-4461-9fef-68f50cc35f45 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:36.706419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:36.712893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e037ce74-eccb-4461-9fef-68f50cc35f45 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046802 Aug 31 00:38:36.713462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 535/997] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:36 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:36.799260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a95144f7-9682-4deb-8388-c63a316e3a7e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:36.801364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a95144f7-9682-4deb-8388-c63a316e3a7e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:36.808824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a95144f7-9682-4deb-8388-c63a316e3a7e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:36.809348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a95144f7-9682-4deb-8388-c63a316e3a7e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:36.809786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a95144f7-9682-4deb-8388-c63a316e3a7e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:36.810474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a95144f7-9682-4deb-8388-c63a316e3a7e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:36.810925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a95144f7-9682-4deb-8388-c63a316e3a7e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:36.811384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a95144f7-9682-4deb-8388-c63a316e3a7e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:36.840449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a95144f7-9682-4deb-8388-c63a316e3a7e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045206 Aug 31 00:38:36.841287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 463/998] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:36.846424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1b2fa08b-d1b1-4bb9-a951-5849b87a0add tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:36.848639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1b2fa08b-d1b1-4bb9-a951-5849b87a0add tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:36.855783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2fa08b-d1b1-4bb9-a951-5849b87a0add tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:36.856265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2fa08b-d1b1-4bb9-a951-5849b87a0add tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:36.856699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2fa08b-d1b1-4bb9-a951-5849b87a0add tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:36.857380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2fa08b-d1b1-4bb9-a951-5849b87a0add tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:36.857828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2fa08b-d1b1-4bb9-a951-5849b87a0add tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:36.858254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b2fa08b-d1b1-4bb9-a951-5849b87a0add tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:36.888680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1b2fa08b-d1b1-4bb9-a951-5849b87a0add tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046421 Aug 31 00:38:36.889237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 536/999] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:37.724398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1b59aa50-2c6b-4072-a9cb-98ef1abdd59d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:37.726549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1b59aa50-2c6b-4072-a9cb-98ef1abdd59d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:37.732450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b59aa50-2c6b-4072-a9cb-98ef1abdd59d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:37.732928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b59aa50-2c6b-4072-a9cb-98ef1abdd59d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:37.733601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b59aa50-2c6b-4072-a9cb-98ef1abdd59d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:37.734273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b59aa50-2c6b-4072-a9cb-98ef1abdd59d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:37.734715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b59aa50-2c6b-4072-a9cb-98ef1abdd59d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:37.735173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b59aa50-2c6b-4072-a9cb-98ef1abdd59d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:37.764411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1b59aa50-2c6b-4072-a9cb-98ef1abdd59d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Aug 31 00:38:37.764883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 464/1000] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:37 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:37.853186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eb8a3841-4730-4581-9083-00efe9bd2f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:37.855364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eb8a3841-4730-4581-9083-00efe9bd2f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:37.862111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb8a3841-4730-4581-9083-00efe9bd2f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:37.862577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb8a3841-4730-4581-9083-00efe9bd2f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:37.862999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb8a3841-4730-4581-9083-00efe9bd2f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:37.863697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb8a3841-4730-4581-9083-00efe9bd2f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:37.864137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb8a3841-4730-4581-9083-00efe9bd2f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:37.864547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb8a3841-4730-4581-9083-00efe9bd2f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:37.894701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eb8a3841-4730-4581-9083-00efe9bd2f69 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045624 Aug 31 00:38:37.895287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 537/1001] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:37.900831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2bb3256a-bf6f-4e41-8b32-94750464ec45 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:37.902926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2bb3256a-bf6f-4e41-8b32-94750464ec45 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:37.909238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bb3256a-bf6f-4e41-8b32-94750464ec45 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:37.909708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bb3256a-bf6f-4e41-8b32-94750464ec45 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:37.910128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bb3256a-bf6f-4e41-8b32-94750464ec45 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:37.910804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bb3256a-bf6f-4e41-8b32-94750464ec45 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:37.911338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bb3256a-bf6f-4e41-8b32-94750464ec45 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:37.911770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bb3256a-bf6f-4e41-8b32-94750464ec45 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:37.927962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:37.942211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2bb3256a-bf6f-4e41-8b32-94750464ec45 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045345 Aug 31 00:38:37.942760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 465/1002] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:37 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:38.776179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7477a23f-c676-4ac2-8f8c-e226e84f1aea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:38.778417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7477a23f-c676-4ac2-8f8c-e226e84f1aea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:38.784363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7477a23f-c676-4ac2-8f8c-e226e84f1aea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:38.784841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7477a23f-c676-4ac2-8f8c-e226e84f1aea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:38.785271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7477a23f-c676-4ac2-8f8c-e226e84f1aea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:38.785957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7477a23f-c676-4ac2-8f8c-e226e84f1aea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:38.786404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7477a23f-c676-4ac2-8f8c-e226e84f1aea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:38.786820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7477a23f-c676-4ac2-8f8c-e226e84f1aea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:38.818684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7477a23f-c676-4ac2-8f8c-e226e84f1aea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046455 Aug 31 00:38:38.819179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 538/1003] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:38 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:38.908609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6208fe57-552f-4a37-b883-df5fe83834fb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:38.910822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6208fe57-552f-4a37-b883-df5fe83834fb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:38.917495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6208fe57-552f-4a37-b883-df5fe83834fb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:38.917967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6208fe57-552f-4a37-b883-df5fe83834fb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:38.918395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6208fe57-552f-4a37-b883-df5fe83834fb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:38.919113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6208fe57-552f-4a37-b883-df5fe83834fb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:38.919563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6208fe57-552f-4a37-b883-df5fe83834fb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:38.919981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6208fe57-552f-4a37-b883-df5fe83834fb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:38.949276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6208fe57-552f-4a37-b883-df5fe83834fb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044806 Aug 31 00:38:38.950012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 466/1004] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:38.955180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f83d40ec-6dfb-4d50-883d-5e6f56d7bf0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:38.957332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f83d40ec-6dfb-4d50-883d-5e6f56d7bf0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:38.963994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f83d40ec-6dfb-4d50-883d-5e6f56d7bf0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:38.964470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f83d40ec-6dfb-4d50-883d-5e6f56d7bf0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:38.964900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f83d40ec-6dfb-4d50-883d-5e6f56d7bf0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:38.965581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f83d40ec-6dfb-4d50-883d-5e6f56d7bf0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:38.966030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f83d40ec-6dfb-4d50-883d-5e6f56d7bf0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:38.966449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f83d40ec-6dfb-4d50-883d-5e6f56d7bf0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:38.997592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f83d40ec-6dfb-4d50-883d-5e6f56d7bf0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Aug 31 00:38:38.998181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 539/1005] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:39.833900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-58a41e1f-a6e6-4b36-929b-31936b41861d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:39.836017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-58a41e1f-a6e6-4b36-929b-31936b41861d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:39.846856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58a41e1f-a6e6-4b36-929b-31936b41861d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:39.847357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58a41e1f-a6e6-4b36-929b-31936b41861d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:39.847787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58a41e1f-a6e6-4b36-929b-31936b41861d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:39.848466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58a41e1f-a6e6-4b36-929b-31936b41861d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:39.848911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58a41e1f-a6e6-4b36-929b-31936b41861d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:39.849326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58a41e1f-a6e6-4b36-929b-31936b41861d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:39.878380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-58a41e1f-a6e6-4b36-929b-31936b41861d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048418 Aug 31 00:38:39.878840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 467/1006] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:39 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:39.961352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cf4029f3-55d9-42f2-8a81-3520e78f272f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:39.964382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cf4029f3-55d9-42f2-8a81-3520e78f272f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:39.970819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf4029f3-55d9-42f2-8a81-3520e78f272f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:39.971342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf4029f3-55d9-42f2-8a81-3520e78f272f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:39.971783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf4029f3-55d9-42f2-8a81-3520e78f272f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:39.972482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf4029f3-55d9-42f2-8a81-3520e78f272f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:39.972931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf4029f3-55d9-42f2-8a81-3520e78f272f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:39.973354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf4029f3-55d9-42f2-8a81-3520e78f272f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:40.003477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cf4029f3-55d9-42f2-8a81-3520e78f272f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046099 Aug 31 00:38:40.004044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 540/1007] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:40.010515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6d71eee0-ec75-4c6a-8457-152afb719449 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:40.012721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6d71eee0-ec75-4c6a-8457-152afb719449 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:40.018951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d71eee0-ec75-4c6a-8457-152afb719449 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:40.019487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d71eee0-ec75-4c6a-8457-152afb719449 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:40.019914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d71eee0-ec75-4c6a-8457-152afb719449 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:40.020615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d71eee0-ec75-4c6a-8457-152afb719449 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:40.021070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d71eee0-ec75-4c6a-8457-152afb719449 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:40.021486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d71eee0-ec75-4c6a-8457-152afb719449 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:40.051734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6d71eee0-ec75-4c6a-8457-152afb719449 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045743 Aug 31 00:38:40.052280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 468/1008] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:40.890553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0d4d58ae-c7f7-40d2-9ca9-64c8f7f78f8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:40.892725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0d4d58ae-c7f7-40d2-9ca9-64c8f7f78f8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:40.898666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d4d58ae-c7f7-40d2-9ca9-64c8f7f78f8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:40.899539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d4d58ae-c7f7-40d2-9ca9-64c8f7f78f8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:40.900378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d4d58ae-c7f7-40d2-9ca9-64c8f7f78f8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:40.901625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d4d58ae-c7f7-40d2-9ca9-64c8f7f78f8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:40.902369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d4d58ae-c7f7-40d2-9ca9-64c8f7f78f8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:40.902844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d4d58ae-c7f7-40d2-9ca9-64c8f7f78f8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:40.932965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0d4d58ae-c7f7-40d2-9ca9-64c8f7f78f8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046349 Aug 31 00:38:40.933444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 541/1009] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:40 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:41.015768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e0e24816-52e7-434f-bb32-2411ed27b847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:41.017901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e0e24816-52e7-434f-bb32-2411ed27b847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:41.024338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0e24816-52e7-434f-bb32-2411ed27b847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.024801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0e24816-52e7-434f-bb32-2411ed27b847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.025222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0e24816-52e7-434f-bb32-2411ed27b847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.025904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0e24816-52e7-434f-bb32-2411ed27b847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.026345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0e24816-52e7-434f-bb32-2411ed27b847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.026760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0e24816-52e7-434f-bb32-2411ed27b847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.056087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e0e24816-52e7-434f-bb32-2411ed27b847 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043531 Aug 31 00:38:41.056637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 469/1010] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:41.064599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fb363b2b-482d-4834-919c-1ff269120c70 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:41.066743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fb363b2b-482d-4834-919c-1ff269120c70 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:41.073767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb363b2b-482d-4834-919c-1ff269120c70 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.074239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb363b2b-482d-4834-919c-1ff269120c70 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.074664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb363b2b-482d-4834-919c-1ff269120c70 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.075444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb363b2b-482d-4834-919c-1ff269120c70 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.075890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb363b2b-482d-4834-919c-1ff269120c70 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.076304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb363b2b-482d-4834-919c-1ff269120c70 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.104754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fb363b2b-482d-4834-919c-1ff269120c70 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044064 Aug 31 00:38:41.105302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 542/1011] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:41 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:41.945000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-118a8f94-c2c1-42c7-8696-c206b7d4f8f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:41.948138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-118a8f94-c2c1-42c7-8696-c206b7d4f8f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:41.954021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-118a8f94-c2c1-42c7-8696-c206b7d4f8f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.954492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-118a8f94-c2c1-42c7-8696-c206b7d4f8f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.954918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-118a8f94-c2c1-42c7-8696-c206b7d4f8f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.955624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-118a8f94-c2c1-42c7-8696-c206b7d4f8f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.956067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-118a8f94-c2c1-42c7-8696-c206b7d4f8f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.956479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-118a8f94-c2c1-42c7-8696-c206b7d4f8f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.987331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-118a8f94-c2c1-42c7-8696-c206b7d4f8f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046243 Aug 31 00:38:41.987812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 470/1012] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:41 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:42.067533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b96dcc0d-fe98-4049-9a8d-297af72ccd77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:42.069684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b96dcc0d-fe98-4049-9a8d-297af72ccd77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:42.076877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b96dcc0d-fe98-4049-9a8d-297af72ccd77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:42.077456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b96dcc0d-fe98-4049-9a8d-297af72ccd77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:42.077975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b96dcc0d-fe98-4049-9a8d-297af72ccd77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:42.078808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b96dcc0d-fe98-4049-9a8d-297af72ccd77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:42.079387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b96dcc0d-fe98-4049-9a8d-297af72ccd77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:42.079895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b96dcc0d-fe98-4049-9a8d-297af72ccd77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:42.109057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b96dcc0d-fe98-4049-9a8d-297af72ccd77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045451 Aug 31 00:38:42.109604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 543/1013] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:42.117020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5dbc77a8-3bfe-4355-89ed-51002cdb5d1d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:42.119282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5dbc77a8-3bfe-4355-89ed-51002cdb5d1d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:42.125683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbc77a8-3bfe-4355-89ed-51002cdb5d1d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:42.126165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbc77a8-3bfe-4355-89ed-51002cdb5d1d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:42.126593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbc77a8-3bfe-4355-89ed-51002cdb5d1d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:42.127312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbc77a8-3bfe-4355-89ed-51002cdb5d1d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:42.127764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbc77a8-3bfe-4355-89ed-51002cdb5d1d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:42.128182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbc77a8-3bfe-4355-89ed-51002cdb5d1d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:42.158480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5dbc77a8-3bfe-4355-89ed-51002cdb5d1d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045333 Aug 31 00:38:42.159052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 471/1014] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:42 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:43.000168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5ae70569-aa42-4a29-b7b2-05c3ee3e81e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:43.002290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5ae70569-aa42-4a29-b7b2-05c3ee3e81e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:43.008418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ae70569-aa42-4a29-b7b2-05c3ee3e81e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:43.008894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ae70569-aa42-4a29-b7b2-05c3ee3e81e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:43.009326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ae70569-aa42-4a29-b7b2-05c3ee3e81e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:43.010001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ae70569-aa42-4a29-b7b2-05c3ee3e81e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:43.010451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ae70569-aa42-4a29-b7b2-05c3ee3e81e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:43.010868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ae70569-aa42-4a29-b7b2-05c3ee3e81e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:43.040878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5ae70569-aa42-4a29-b7b2-05c3ee3e81e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Aug 31 00:38:43.041369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 544/1015] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:42 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:43.121464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-015989f9-85e1-4cf6-a26e-e1b0da145b10 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:43.123590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-015989f9-85e1-4cf6-a26e-e1b0da145b10 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:43.129913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-015989f9-85e1-4cf6-a26e-e1b0da145b10 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:43.130390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-015989f9-85e1-4cf6-a26e-e1b0da145b10 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:43.130819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-015989f9-85e1-4cf6-a26e-e1b0da145b10 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:43.131533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-015989f9-85e1-4cf6-a26e-e1b0da145b10 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:43.131983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-015989f9-85e1-4cf6-a26e-e1b0da145b10 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:43.132402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-015989f9-85e1-4cf6-a26e-e1b0da145b10 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:43.161732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-015989f9-85e1-4cf6-a26e-e1b0da145b10 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044201 Aug 31 00:38:43.162274 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 472/1016] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:43.171870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-25bb211d-72ee-4e1f-a86d-e578619dde0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:43.174010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-25bb211d-72ee-4e1f-a86d-e578619dde0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:43.180837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25bb211d-72ee-4e1f-a86d-e578619dde0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:43.181329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25bb211d-72ee-4e1f-a86d-e578619dde0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:43.181769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25bb211d-72ee-4e1f-a86d-e578619dde0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:43.182457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25bb211d-72ee-4e1f-a86d-e578619dde0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:43.182914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25bb211d-72ee-4e1f-a86d-e578619dde0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:43.183370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25bb211d-72ee-4e1f-a86d-e578619dde0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:43.213703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-25bb211d-72ee-4e1f-a86d-e578619dde0a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045764 Aug 31 00:38:43.214265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 545/1017] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:44.052564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ba23be54-12a8-4a33-9c18-4fe227c9203a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:44.054704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ba23be54-12a8-4a33-9c18-4fe227c9203a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:44.061396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba23be54-12a8-4a33-9c18-4fe227c9203a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:44.061877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba23be54-12a8-4a33-9c18-4fe227c9203a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:44.062312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba23be54-12a8-4a33-9c18-4fe227c9203a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:44.062995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba23be54-12a8-4a33-9c18-4fe227c9203a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:44.063472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba23be54-12a8-4a33-9c18-4fe227c9203a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:44.063893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba23be54-12a8-4a33-9c18-4fe227c9203a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:44.093280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ba23be54-12a8-4a33-9c18-4fe227c9203a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Aug 31 00:38:44.093745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 473/1018] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:44 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:44.173970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5f13bd04-df34-4e9c-87ed-dba47426f4d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:44.176153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5f13bd04-df34-4e9c-87ed-dba47426f4d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:44.183395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f13bd04-df34-4e9c-87ed-dba47426f4d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:44.183863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f13bd04-df34-4e9c-87ed-dba47426f4d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:44.184286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f13bd04-df34-4e9c-87ed-dba47426f4d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:44.184968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f13bd04-df34-4e9c-87ed-dba47426f4d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:44.185407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f13bd04-df34-4e9c-87ed-dba47426f4d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:44.185819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f13bd04-df34-4e9c-87ed-dba47426f4d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:44.214512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5f13bd04-df34-4e9c-87ed-dba47426f4d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044537 Aug 31 00:38:44.215077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 546/1019] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:44.225646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3fb54cce-5da8-466d-bb02-ea52a1108fb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:44.228415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3fb54cce-5da8-466d-bb02-ea52a1108fb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:44.235160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb54cce-5da8-466d-bb02-ea52a1108fb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:44.235642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb54cce-5da8-466d-bb02-ea52a1108fb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:44.236065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb54cce-5da8-466d-bb02-ea52a1108fb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:44.236747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb54cce-5da8-466d-bb02-ea52a1108fb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:44.237223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb54cce-5da8-466d-bb02-ea52a1108fb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:44.237642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb54cce-5da8-466d-bb02-ea52a1108fb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:44.274695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3fb54cce-5da8-466d-bb02-ea52a1108fb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052655 Aug 31 00:38:44.275295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 474/1020] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:45.106798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-996a3908-5044-4fad-9b32-c10ce4da416a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:45.109313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-996a3908-5044-4fad-9b32-c10ce4da416a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:45.115307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-996a3908-5044-4fad-9b32-c10ce4da416a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.115784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-996a3908-5044-4fad-9b32-c10ce4da416a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.116216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-996a3908-5044-4fad-9b32-c10ce4da416a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.116892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-996a3908-5044-4fad-9b32-c10ce4da416a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.118083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-996a3908-5044-4fad-9b32-c10ce4da416a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.118590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-996a3908-5044-4fad-9b32-c10ce4da416a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.147762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-996a3908-5044-4fad-9b32-c10ce4da416a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Aug 31 00:38:45.148420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 547/1021] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:45 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:45.227478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3e5c47a3-aed2-413e-9b74-2f243503f356 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:45.229596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3e5c47a3-aed2-413e-9b74-2f243503f356 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:45.236527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5c47a3-aed2-413e-9b74-2f243503f356 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.237011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5c47a3-aed2-413e-9b74-2f243503f356 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.237443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5c47a3-aed2-413e-9b74-2f243503f356 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.238501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5c47a3-aed2-413e-9b74-2f243503f356 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.238953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5c47a3-aed2-413e-9b74-2f243503f356 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.239405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5c47a3-aed2-413e-9b74-2f243503f356 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.269384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3e5c47a3-aed2-413e-9b74-2f243503f356 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046330 Aug 31 00:38:45.269933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 475/1022] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:38:45.286524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-99c224ec-aaf0-4032-af0a-62fd325bfe38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:45.288702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-99c224ec-aaf0-4032-af0a-62fd325bfe38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:45.295331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c224ec-aaf0-4032-af0a-62fd325bfe38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.295809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c224ec-aaf0-4032-af0a-62fd325bfe38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.296239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c224ec-aaf0-4032-af0a-62fd325bfe38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.296916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c224ec-aaf0-4032-af0a-62fd325bfe38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.297367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c224ec-aaf0-4032-af0a-62fd325bfe38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.297784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c224ec-aaf0-4032-af0a-62fd325bfe38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.327935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-99c224ec-aaf0-4032-af0a-62fd325bfe38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045427 Aug 31 00:38:45.328485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 548/1023] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:46.160375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fe1772d1-6f8d-47e6-bba6-4b2360003549 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:46.162490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fe1772d1-6f8d-47e6-bba6-4b2360003549 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:46.169670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe1772d1-6f8d-47e6-bba6-4b2360003549 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:46.170146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe1772d1-6f8d-47e6-bba6-4b2360003549 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:46.170574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe1772d1-6f8d-47e6-bba6-4b2360003549 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:46.171283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe1772d1-6f8d-47e6-bba6-4b2360003549 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:46.171733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe1772d1-6f8d-47e6-bba6-4b2360003549 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:46.172154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe1772d1-6f8d-47e6-bba6-4b2360003549 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:46.201320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fe1772d1-6f8d-47e6-bba6-4b2360003549 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Aug 31 00:38:46.201882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 476/1024] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:46 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:46.282199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8e176cea-2ed5-4d0d-a680-655e923236df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:46.284319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8e176cea-2ed5-4d0d-a680-655e923236df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:46.291533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e176cea-2ed5-4d0d-a680-655e923236df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:46.292383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e176cea-2ed5-4d0d-a680-655e923236df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:46.292517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e176cea-2ed5-4d0d-a680-655e923236df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:46.293374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e176cea-2ed5-4d0d-a680-655e923236df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:46.293830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e176cea-2ed5-4d0d-a680-655e923236df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:46.294255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e176cea-2ed5-4d0d-a680-655e923236df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:46.324930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8e176cea-2ed5-4d0d-a680-655e923236df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046823 Aug 31 00:38:46.325484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 549/1025] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:46.340644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1f0023bb-6b2e-4850-b8c3-a95d28264a65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:46.342738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1f0023bb-6b2e-4850-b8c3-a95d28264a65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:46.349059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f0023bb-6b2e-4850-b8c3-a95d28264a65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:46.349528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f0023bb-6b2e-4850-b8c3-a95d28264a65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:46.349948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f0023bb-6b2e-4850-b8c3-a95d28264a65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:46.350617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f0023bb-6b2e-4850-b8c3-a95d28264a65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:46.351069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f0023bb-6b2e-4850-b8c3-a95d28264a65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:46.351486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f0023bb-6b2e-4850-b8c3-a95d28264a65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:46.380794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1f0023bb-6b2e-4850-b8c3-a95d28264a65 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Aug 31 00:38:46.381336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 477/1026] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:46 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:47.213676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ee1cac13-917f-4146-84ce-2fcd1e7dd29c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:47.215868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ee1cac13-917f-4146-84ce-2fcd1e7dd29c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:47.221825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee1cac13-917f-4146-84ce-2fcd1e7dd29c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:47.222302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee1cac13-917f-4146-84ce-2fcd1e7dd29c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:47.222733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee1cac13-917f-4146-84ce-2fcd1e7dd29c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:47.223448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee1cac13-917f-4146-84ce-2fcd1e7dd29c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:47.223895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee1cac13-917f-4146-84ce-2fcd1e7dd29c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:47.224314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee1cac13-917f-4146-84ce-2fcd1e7dd29c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:47.259572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ee1cac13-917f-4146-84ce-2fcd1e7dd29c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049786 Aug 31 00:38:47.260041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 550/1027] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:47 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:47.337630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d60f0fe8-5b8f-4b13-84fc-44152a4b3ae9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:47.339767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d60f0fe8-5b8f-4b13-84fc-44152a4b3ae9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:47.346163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d60f0fe8-5b8f-4b13-84fc-44152a4b3ae9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:47.346758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d60f0fe8-5b8f-4b13-84fc-44152a4b3ae9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:47.347079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d60f0fe8-5b8f-4b13-84fc-44152a4b3ae9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:47.347767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d60f0fe8-5b8f-4b13-84fc-44152a4b3ae9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:47.348216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d60f0fe8-5b8f-4b13-84fc-44152a4b3ae9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:47.348639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d60f0fe8-5b8f-4b13-84fc-44152a4b3ae9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:47.378905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d60f0fe8-5b8f-4b13-84fc-44152a4b3ae9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045826 Aug 31 00:38:47.379572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 478/1028] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:47.393412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f3c5d728-468c-45b7-8d85-cffe9603882f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:47.395585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f3c5d728-468c-45b7-8d85-cffe9603882f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:47.402154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c5d728-468c-45b7-8d85-cffe9603882f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:47.402630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c5d728-468c-45b7-8d85-cffe9603882f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:47.403081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c5d728-468c-45b7-8d85-cffe9603882f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:47.403768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c5d728-468c-45b7-8d85-cffe9603882f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:47.404217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c5d728-468c-45b7-8d85-cffe9603882f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:47.404632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3c5d728-468c-45b7-8d85-cffe9603882f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:47.435622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f3c5d728-468c-45b7-8d85-cffe9603882f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046059 Aug 31 00:38:47.436186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 551/1029] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:47 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:48.272033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8acd2fb6-5f36-404e-ae2b-68462b9749aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:48.274493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8acd2fb6-5f36-404e-ae2b-68462b9749aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:48.280385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8acd2fb6-5f36-404e-ae2b-68462b9749aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.280857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8acd2fb6-5f36-404e-ae2b-68462b9749aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.281280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8acd2fb6-5f36-404e-ae2b-68462b9749aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:48.281954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8acd2fb6-5f36-404e-ae2b-68462b9749aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.282397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8acd2fb6-5f36-404e-ae2b-68462b9749aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.282811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8acd2fb6-5f36-404e-ae2b-68462b9749aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:48.311510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8acd2fb6-5f36-404e-ae2b-68462b9749aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Aug 31 00:38:48.312058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 479/1030] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:48 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:48.391409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cf7f2419-b2c9-4634-bca9-9e52da0f4959 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:48.393545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cf7f2419-b2c9-4634-bca9-9e52da0f4959 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:48.400341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf7f2419-b2c9-4634-bca9-9e52da0f4959 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.400824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf7f2419-b2c9-4634-bca9-9e52da0f4959 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.401260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf7f2419-b2c9-4634-bca9-9e52da0f4959 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:48.401947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf7f2419-b2c9-4634-bca9-9e52da0f4959 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.402399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf7f2419-b2c9-4634-bca9-9e52da0f4959 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.402827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf7f2419-b2c9-4634-bca9-9e52da0f4959 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:48.419521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:48.434091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cf7f2419-b2c9-4634-bca9-9e52da0f4959 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046678 Aug 31 00:38:48.434655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 552/1031] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:48.448220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6d804e49-059c-47ec-8fe3-4c0958830f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:48.450335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6d804e49-059c-47ec-8fe3-4c0958830f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:48.456717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d804e49-059c-47ec-8fe3-4c0958830f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.457201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d804e49-059c-47ec-8fe3-4c0958830f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.457636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d804e49-059c-47ec-8fe3-4c0958830f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:48.458322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d804e49-059c-47ec-8fe3-4c0958830f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.458774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d804e49-059c-47ec-8fe3-4c0958830f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.459228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d804e49-059c-47ec-8fe3-4c0958830f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:48.488848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6d804e49-059c-47ec-8fe3-4c0958830f7b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Aug 31 00:38:48.489403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 480/1032] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:49.324128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cb491555-add6-404f-932e-13121077af6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:49.326212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cb491555-add6-404f-932e-13121077af6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:49.332206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb491555-add6-404f-932e-13121077af6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:49.332688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb491555-add6-404f-932e-13121077af6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:49.333119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb491555-add6-404f-932e-13121077af6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:49.333809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb491555-add6-404f-932e-13121077af6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:49.334260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb491555-add6-404f-932e-13121077af6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:49.334680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb491555-add6-404f-932e-13121077af6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:49.368029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cb491555-add6-404f-932e-13121077af6c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047927 Aug 31 00:38:49.368587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 553/1033] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:49 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:49.446404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-717dcbda-4469-4735-88d1-eb6c10f11acd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:49.448518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-717dcbda-4469-4735-88d1-eb6c10f11acd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:49.454776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-717dcbda-4469-4735-88d1-eb6c10f11acd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:49.455293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-717dcbda-4469-4735-88d1-eb6c10f11acd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:49.455724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-717dcbda-4469-4735-88d1-eb6c10f11acd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:49.456405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-717dcbda-4469-4735-88d1-eb6c10f11acd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:49.456851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-717dcbda-4469-4735-88d1-eb6c10f11acd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:49.457267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-717dcbda-4469-4735-88d1-eb6c10f11acd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:49.486530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-717dcbda-4469-4735-88d1-eb6c10f11acd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044661 Aug 31 00:38:49.487094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 481/1034] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:49.500847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f5d2db87-2593-4222-bd4b-5d2833c981f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:49.502993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f5d2db87-2593-4222-bd4b-5d2833c981f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:49.510186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5d2db87-2593-4222-bd4b-5d2833c981f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:49.510662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5d2db87-2593-4222-bd4b-5d2833c981f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:49.511120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5d2db87-2593-4222-bd4b-5d2833c981f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:49.511802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5d2db87-2593-4222-bd4b-5d2833c981f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:49.512239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5d2db87-2593-4222-bd4b-5d2833c981f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:49.512660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5d2db87-2593-4222-bd4b-5d2833c981f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:49.542080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f5d2db87-2593-4222-bd4b-5d2833c981f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Aug 31 00:38:49.542626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 554/1035] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:50.380342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d0d62a4-ccfb-4537-8080-dfcb07da2189 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:50.382524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0d0d62a4-ccfb-4537-8080-dfcb07da2189 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:50.388588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d0d62a4-ccfb-4537-8080-dfcb07da2189 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:50.389065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d0d62a4-ccfb-4537-8080-dfcb07da2189 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:50.389490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d0d62a4-ccfb-4537-8080-dfcb07da2189 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:50.390156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d0d62a4-ccfb-4537-8080-dfcb07da2189 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:50.390597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d0d62a4-ccfb-4537-8080-dfcb07da2189 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:50.391009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d0d62a4-ccfb-4537-8080-dfcb07da2189 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:50.394592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:50.420150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0d0d62a4-ccfb-4537-8080-dfcb07da2189 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Aug 31 00:38:50.420698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 482/1036] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:50 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:50.499687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1970e968-7b74-4159-824c-64133084da3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:50.501828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1970e968-7b74-4159-824c-64133084da3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:50.507998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1970e968-7b74-4159-824c-64133084da3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:50.508478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1970e968-7b74-4159-824c-64133084da3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:50.508903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1970e968-7b74-4159-824c-64133084da3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:50.509592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1970e968-7b74-4159-824c-64133084da3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:50.510039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1970e968-7b74-4159-824c-64133084da3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:50.510458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1970e968-7b74-4159-824c-64133084da3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:50.542903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1970e968-7b74-4159-824c-64133084da3d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047385 Aug 31 00:38:50.543503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 555/1037] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:50.553655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3ad5f84-f582-4532-b564-ebcf95ebb10d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:50.556114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3ad5f84-f582-4532-b564-ebcf95ebb10d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:50.562406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ad5f84-f582-4532-b564-ebcf95ebb10d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:50.562910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ad5f84-f582-4532-b564-ebcf95ebb10d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:50.563373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ad5f84-f582-4532-b564-ebcf95ebb10d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:50.564051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ad5f84-f582-4532-b564-ebcf95ebb10d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:50.564496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ad5f84-f582-4532-b564-ebcf95ebb10d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:50.564912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ad5f84-f582-4532-b564-ebcf95ebb10d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:50.595906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3ad5f84-f582-4532-b564-ebcf95ebb10d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046101 Aug 31 00:38:50.596456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 483/1038] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:51.433081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c41531e4-e71c-4fe8-8d21-20ddf675b114 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:51.435246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c41531e4-e71c-4fe8-8d21-20ddf675b114 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:51.441119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c41531e4-e71c-4fe8-8d21-20ddf675b114 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:51.441595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c41531e4-e71c-4fe8-8d21-20ddf675b114 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:51.442022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c41531e4-e71c-4fe8-8d21-20ddf675b114 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:51.442724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c41531e4-e71c-4fe8-8d21-20ddf675b114 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:51.443198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c41531e4-e71c-4fe8-8d21-20ddf675b114 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:51.443615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c41531e4-e71c-4fe8-8d21-20ddf675b114 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:51.473173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c41531e4-e71c-4fe8-8d21-20ddf675b114 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044726 Aug 31 00:38:51.473718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 556/1039] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:51 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:51.556303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-72544e8c-fc18-4b70-9466-6bb0f205c425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:51.558310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-72544e8c-fc18-4b70-9466-6bb0f205c425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:51.564629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72544e8c-fc18-4b70-9466-6bb0f205c425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:51.565100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72544e8c-fc18-4b70-9466-6bb0f205c425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:51.565524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72544e8c-fc18-4b70-9466-6bb0f205c425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:51.566202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72544e8c-fc18-4b70-9466-6bb0f205c425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:51.566640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72544e8c-fc18-4b70-9466-6bb0f205c425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:51.567072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72544e8c-fc18-4b70-9466-6bb0f205c425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:51.605098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-72544e8c-fc18-4b70-9466-6bb0f205c425 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050938 Aug 31 00:38:51.606016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 484/1040] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:51.609625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e1e343f6-97aa-4cda-b4e7-02e003dde0b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:51.611882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e1e343f6-97aa-4cda-b4e7-02e003dde0b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:51.619758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e343f6-97aa-4cda-b4e7-02e003dde0b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:51.620333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e343f6-97aa-4cda-b4e7-02e003dde0b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:51.620841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e343f6-97aa-4cda-b4e7-02e003dde0b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:51.621613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e343f6-97aa-4cda-b4e7-02e003dde0b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:51.622202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e343f6-97aa-4cda-b4e7-02e003dde0b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:51.622707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1e343f6-97aa-4cda-b4e7-02e003dde0b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:51.659200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e1e343f6-97aa-4cda-b4e7-02e003dde0b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054554 Aug 31 00:38:51.659774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 557/1041] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:52.486006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-461526d5-5183-494a-a007-d145c2cb2fd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:52.488204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-461526d5-5183-494a-a007-d145c2cb2fd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:52.490069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=85 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:52.496053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-461526d5-5183-494a-a007-d145c2cb2fd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:52.496537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-461526d5-5183-494a-a007-d145c2cb2fd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:52.496973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-461526d5-5183-494a-a007-d145c2cb2fd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.497653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-461526d5-5183-494a-a007-d145c2cb2fd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:52.498108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-461526d5-5183-494a-a007-d145c2cb2fd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:52.498528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-461526d5-5183-494a-a007-d145c2cb2fd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.529704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-461526d5-5183-494a-a007-d145c2cb2fd1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047903 Aug 31 00:38:52.530258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 485/1042] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:52 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:52.618200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b62dcbbe-9bb0-4c11-939c-2e0fb9010aba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:52.620505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b62dcbbe-9bb0-4c11-939c-2e0fb9010aba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:52.626924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b62dcbbe-9bb0-4c11-939c-2e0fb9010aba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:52.627434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b62dcbbe-9bb0-4c11-939c-2e0fb9010aba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:52.627895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b62dcbbe-9bb0-4c11-939c-2e0fb9010aba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.628577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b62dcbbe-9bb0-4c11-939c-2e0fb9010aba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:52.629023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b62dcbbe-9bb0-4c11-939c-2e0fb9010aba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:52.629443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b62dcbbe-9bb0-4c11-939c-2e0fb9010aba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.660034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b62dcbbe-9bb0-4c11-939c-2e0fb9010aba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045984 Aug 31 00:38:52.660602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 558/1043] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:52.671533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5d07d86d-a8d3-4ff6-86e3-d9e82ef60ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:52.673685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5d07d86d-a8d3-4ff6-86e3-d9e82ef60ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:52.680218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d07d86d-a8d3-4ff6-86e3-d9e82ef60ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:52.680703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d07d86d-a8d3-4ff6-86e3-d9e82ef60ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:52.681140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d07d86d-a8d3-4ff6-86e3-d9e82ef60ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.681833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d07d86d-a8d3-4ff6-86e3-d9e82ef60ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:52.682284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d07d86d-a8d3-4ff6-86e3-d9e82ef60ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:52.682706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d07d86d-a8d3-4ff6-86e3-d9e82ef60ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.713298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5d07d86d-a8d3-4ff6-86e3-d9e82ef60ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045925 Aug 31 00:38:52.713853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 486/1044] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:53.543828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eef232bd-8ee5-4379-8efe-97bc74a4c1b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:53.545956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eef232bd-8ee5-4379-8efe-97bc74a4c1b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:53.551973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eef232bd-8ee5-4379-8efe-97bc74a4c1b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:53.552458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eef232bd-8ee5-4379-8efe-97bc74a4c1b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:53.552873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eef232bd-8ee5-4379-8efe-97bc74a4c1b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:53.553557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eef232bd-8ee5-4379-8efe-97bc74a4c1b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:53.554003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eef232bd-8ee5-4379-8efe-97bc74a4c1b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:53.554461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eef232bd-8ee5-4379-8efe-97bc74a4c1b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:53.583426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eef232bd-8ee5-4379-8efe-97bc74a4c1b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Aug 31 00:38:53.583977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 559/1045] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:53 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:53.673239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-76e4d42f-cb65-4e8b-8b29-8a4ea746a1f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:53.675296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-76e4d42f-cb65-4e8b-8b29-8a4ea746a1f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:53.681844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76e4d42f-cb65-4e8b-8b29-8a4ea746a1f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:53.682299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76e4d42f-cb65-4e8b-8b29-8a4ea746a1f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:53.682731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76e4d42f-cb65-4e8b-8b29-8a4ea746a1f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:53.683757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76e4d42f-cb65-4e8b-8b29-8a4ea746a1f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:53.684544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76e4d42f-cb65-4e8b-8b29-8a4ea746a1f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:53.684978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76e4d42f-cb65-4e8b-8b29-8a4ea746a1f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:53.725496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-76e4d42f-cb65-4e8b-8b29-8a4ea746a1f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056220 Aug 31 00:38:53.725756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4bc3c4b7-4b07-402a-9661-45d2293ba928 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:53.727989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 487/1046] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:53 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:53.728422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4bc3c4b7-4b07-402a-9661-45d2293ba928 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:53.735104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bc3c4b7-4b07-402a-9661-45d2293ba928 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:53.735581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bc3c4b7-4b07-402a-9661-45d2293ba928 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:53.736009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bc3c4b7-4b07-402a-9661-45d2293ba928 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:53.736696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bc3c4b7-4b07-402a-9661-45d2293ba928 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:53.737141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bc3c4b7-4b07-402a-9661-45d2293ba928 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:53.737556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bc3c4b7-4b07-402a-9661-45d2293ba928 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:53.767743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4bc3c4b7-4b07-402a-9661-45d2293ba928 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Aug 31 00:38:53.768294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 560/1047] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:53 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:54.595940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-37a55beb-1efc-4561-943c-58190fd686d7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:54.598018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-37a55beb-1efc-4561-943c-58190fd686d7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:54.604127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a55beb-1efc-4561-943c-58190fd686d7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.604599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a55beb-1efc-4561-943c-58190fd686d7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.605023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a55beb-1efc-4561-943c-58190fd686d7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.605696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a55beb-1efc-4561-943c-58190fd686d7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.606135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a55beb-1efc-4561-943c-58190fd686d7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.606543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a55beb-1efc-4561-943c-58190fd686d7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.636721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-37a55beb-1efc-4561-943c-58190fd686d7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044663 Aug 31 00:38:54.637265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 488/1048] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:54 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:54.739636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f3d7e753-8c32-433a-b334-84a7209ac681 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:54.741702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f3d7e753-8c32-433a-b334-84a7209ac681 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:54.749152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3d7e753-8c32-433a-b334-84a7209ac681 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.749634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3d7e753-8c32-433a-b334-84a7209ac681 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.750057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3d7e753-8c32-433a-b334-84a7209ac681 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.750741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3d7e753-8c32-433a-b334-84a7209ac681 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.751231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3d7e753-8c32-433a-b334-84a7209ac681 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.751648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3d7e753-8c32-433a-b334-84a7209ac681 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.779980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1f5269cd-ff89-4a78-80ff-c1cfc0db4c75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:54.781574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f3d7e753-8c32-433a-b334-84a7209ac681 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045960 Aug 31 00:38:54.782146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 561/1049] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:54.782276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1f5269cd-ff89-4a78-80ff-c1cfc0db4c75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:54.789913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f5269cd-ff89-4a78-80ff-c1cfc0db4c75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.790692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f5269cd-ff89-4a78-80ff-c1cfc0db4c75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.791162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f5269cd-ff89-4a78-80ff-c1cfc0db4c75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.791862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f5269cd-ff89-4a78-80ff-c1cfc0db4c75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.792339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f5269cd-ff89-4a78-80ff-c1cfc0db4c75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.792756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f5269cd-ff89-4a78-80ff-c1cfc0db4c75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.824399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1f5269cd-ff89-4a78-80ff-c1cfc0db4c75 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048229 Aug 31 00:38:54.824973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 489/1050] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:54 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:55.649563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-48293c95-bd55-4bd5-a5de-7a54dde7c1d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:55.651749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-48293c95-bd55-4bd5-a5de-7a54dde7c1d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:55.653618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=85 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:55.658708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48293c95-bd55-4bd5-a5de-7a54dde7c1d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:55.659216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48293c95-bd55-4bd5-a5de-7a54dde7c1d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:55.659651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48293c95-bd55-4bd5-a5de-7a54dde7c1d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:55.660355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48293c95-bd55-4bd5-a5de-7a54dde7c1d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:55.660809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48293c95-bd55-4bd5-a5de-7a54dde7c1d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:55.661224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48293c95-bd55-4bd5-a5de-7a54dde7c1d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:55.690767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-48293c95-bd55-4bd5-a5de-7a54dde7c1d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045801 Aug 31 00:38:55.691349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 562/1051] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:55 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:55.793539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-51a0ccc7-a9dd-4be2-8042-f088683d22c6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:55.795573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-51a0ccc7-a9dd-4be2-8042-f088683d22c6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:55.801897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51a0ccc7-a9dd-4be2-8042-f088683d22c6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:55.802373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51a0ccc7-a9dd-4be2-8042-f088683d22c6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:55.802798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51a0ccc7-a9dd-4be2-8042-f088683d22c6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:55.803490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51a0ccc7-a9dd-4be2-8042-f088683d22c6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:55.803932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51a0ccc7-a9dd-4be2-8042-f088683d22c6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:55.804887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51a0ccc7-a9dd-4be2-8042-f088683d22c6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:55.833999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-51a0ccc7-a9dd-4be2-8042-f088683d22c6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044511 Aug 31 00:38:55.834545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 490/1052] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:55.836942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-295bbe22-316e-4581-859e-e5c4e54b3aa4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:55.839397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-295bbe22-316e-4581-859e-e5c4e54b3aa4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:55.845858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-295bbe22-316e-4581-859e-e5c4e54b3aa4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:55.846354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-295bbe22-316e-4581-859e-e5c4e54b3aa4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:55.846767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-295bbe22-316e-4581-859e-e5c4e54b3aa4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:55.847486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-295bbe22-316e-4581-859e-e5c4e54b3aa4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:55.847937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-295bbe22-316e-4581-859e-e5c4e54b3aa4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:55.848356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-295bbe22-316e-4581-859e-e5c4e54b3aa4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:55.877876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-295bbe22-316e-4581-859e-e5c4e54b3aa4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Aug 31 00:38:55.878447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 563/1053] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:55 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:56.703542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bc3a5445-24fa-4c49-8da1-8b31466c7391 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:56.705656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bc3a5445-24fa-4c49-8da1-8b31466c7391 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:56.712534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc3a5445-24fa-4c49-8da1-8b31466c7391 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:56.713012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc3a5445-24fa-4c49-8da1-8b31466c7391 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:56.713449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc3a5445-24fa-4c49-8da1-8b31466c7391 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:56.714133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc3a5445-24fa-4c49-8da1-8b31466c7391 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:56.714591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc3a5445-24fa-4c49-8da1-8b31466c7391 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:56.715012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc3a5445-24fa-4c49-8da1-8b31466c7391 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:56.745324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bc3a5445-24fa-4c49-8da1-8b31466c7391 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045645 Aug 31 00:38:56.745881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 491/1054] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:56 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:56.849318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-58f4cdd1-cf08-4a49-8778-bc5dddf08004 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:56.852805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-58f4cdd1-cf08-4a49-8778-bc5dddf08004 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:56.859557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f4cdd1-cf08-4a49-8778-bc5dddf08004 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:56.860033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f4cdd1-cf08-4a49-8778-bc5dddf08004 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:56.860466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f4cdd1-cf08-4a49-8778-bc5dddf08004 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:56.861150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f4cdd1-cf08-4a49-8778-bc5dddf08004 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:56.861601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f4cdd1-cf08-4a49-8778-bc5dddf08004 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:56.862016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f4cdd1-cf08-4a49-8778-bc5dddf08004 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:56.889991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7891a8ed-5773-43bc-bf59-89353a16c816 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:56.892356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-58f4cdd1-cf08-4a49-8778-bc5dddf08004 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048363 Aug 31 00:38:56.892774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7891a8ed-5773-43bc-bf59-89353a16c816 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:56.896885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 564/1055] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:56.899918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7891a8ed-5773-43bc-bf59-89353a16c816 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:56.900401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7891a8ed-5773-43bc-bf59-89353a16c816 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:56.900838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7891a8ed-5773-43bc-bf59-89353a16c816 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:56.901528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7891a8ed-5773-43bc-bf59-89353a16c816 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:56.901977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7891a8ed-5773-43bc-bf59-89353a16c816 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:56.902395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7891a8ed-5773-43bc-bf59-89353a16c816 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:56.931888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7891a8ed-5773-43bc-bf59-89353a16c816 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045883 Aug 31 00:38:56.932444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 492/1056] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:57.757569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-53235856-e75e-46e0-aeb9-e434ebffdec5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:57.759812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-53235856-e75e-46e0-aeb9-e434ebffdec5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:57.765770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53235856-e75e-46e0-aeb9-e434ebffdec5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:57.766245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53235856-e75e-46e0-aeb9-e434ebffdec5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:57.766675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53235856-e75e-46e0-aeb9-e434ebffdec5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:57.767382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53235856-e75e-46e0-aeb9-e434ebffdec5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:57.767826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53235856-e75e-46e0-aeb9-e434ebffdec5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:57.768240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53235856-e75e-46e0-aeb9-e434ebffdec5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:57.797953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-53235856-e75e-46e0-aeb9-e434ebffdec5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Aug 31 00:38:57.798500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 565/1057] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:57 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:57.905078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e9adc33a-7136-41d2-b525-52a915296c93 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:57.907153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e9adc33a-7136-41d2-b525-52a915296c93 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:57.913467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9adc33a-7136-41d2-b525-52a915296c93 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:57.914597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9adc33a-7136-41d2-b525-52a915296c93 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:57.915022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9adc33a-7136-41d2-b525-52a915296c93 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:57.915731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9adc33a-7136-41d2-b525-52a915296c93 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:57.916177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9adc33a-7136-41d2-b525-52a915296c93 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:57.916591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9adc33a-7136-41d2-b525-52a915296c93 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:57.944199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c84a3755-1f52-4400-9b79-9e7b39db92a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:57.946468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c84a3755-1f52-4400-9b79-9e7b39db92a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:57.946828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e9adc33a-7136-41d2-b525-52a915296c93 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045863 Aug 31 00:38:57.947414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 493/1058] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:57.952882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c84a3755-1f52-4400-9b79-9e7b39db92a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:57.953362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c84a3755-1f52-4400-9b79-9e7b39db92a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:57.953796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c84a3755-1f52-4400-9b79-9e7b39db92a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:57.954484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c84a3755-1f52-4400-9b79-9e7b39db92a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:57.954968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c84a3755-1f52-4400-9b79-9e7b39db92a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:57.955413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c84a3755-1f52-4400-9b79-9e7b39db92a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:57.988320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c84a3755-1f52-4400-9b79-9e7b39db92a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047994 Aug 31 00:38:57.988883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 566/1059] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:58.809987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b92fc37a-65a5-4f53-852e-d08a0c1839eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:58.812129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b92fc37a-65a5-4f53-852e-d08a0c1839eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:58.818401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92fc37a-65a5-4f53-852e-d08a0c1839eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:58.818880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92fc37a-65a5-4f53-852e-d08a0c1839eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:58.819342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92fc37a-65a5-4f53-852e-d08a0c1839eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:58.820117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92fc37a-65a5-4f53-852e-d08a0c1839eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:58.820558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92fc37a-65a5-4f53-852e-d08a0c1839eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:58.820975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92fc37a-65a5-4f53-852e-d08a0c1839eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:58.850638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b92fc37a-65a5-4f53-852e-d08a0c1839eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Aug 31 00:38:58.851931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 494/1060] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:58 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:58.959144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2d7aeef2-eae0-421b-b66b-10e23fcfce6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:58.962050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2d7aeef2-eae0-421b-b66b-10e23fcfce6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:58.968607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d7aeef2-eae0-421b-b66b-10e23fcfce6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:58.969021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d7aeef2-eae0-421b-b66b-10e23fcfce6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:58.969461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d7aeef2-eae0-421b-b66b-10e23fcfce6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:58.970154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d7aeef2-eae0-421b-b66b-10e23fcfce6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:58.970600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d7aeef2-eae0-421b-b66b-10e23fcfce6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:58.971017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d7aeef2-eae0-421b-b66b-10e23fcfce6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:59.001238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e4d35c35-5408-4ace-9fe6-6127fd7d6b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:59.001901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2d7aeef2-eae0-421b-b66b-10e23fcfce6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046720 Aug 31 00:38:59.002619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 567/1061] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:38:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:38:59.003448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e4d35c35-5408-4ace-9fe6-6127fd7d6b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:59.009980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4d35c35-5408-4ace-9fe6-6127fd7d6b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:59.010456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4d35c35-5408-4ace-9fe6-6127fd7d6b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:59.010885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4d35c35-5408-4ace-9fe6-6127fd7d6b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:59.011635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4d35c35-5408-4ace-9fe6-6127fd7d6b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:59.012114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4d35c35-5408-4ace-9fe6-6127fd7d6b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:59.012534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4d35c35-5408-4ace-9fe6-6127fd7d6b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:59.042726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e4d35c35-5408-4ace-9fe6-6127fd7d6b63 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045438 Aug 31 00:38:59.043315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 495/1062] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:59.863969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-df978f00-00ae-4688-a77a-234f1d5315bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:59.866194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-df978f00-00ae-4688-a77a-234f1d5315bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:59.872913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df978f00-00ae-4688-a77a-234f1d5315bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:59.873397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df978f00-00ae-4688-a77a-234f1d5315bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:59.873837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df978f00-00ae-4688-a77a-234f1d5315bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:59.874535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df978f00-00ae-4688-a77a-234f1d5315bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:59.874989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df978f00-00ae-4688-a77a-234f1d5315bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:59.875443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df978f00-00ae-4688-a77a-234f1d5315bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:59.905412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-df978f00-00ae-4688-a77a-234f1d5315bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045293 Aug 31 00:38:59.905882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 568/1063] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:59 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:00.014489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ffe65c2e-4c8d-4b2e-8f99-d837d4db4530 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:00.016687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ffe65c2e-4c8d-4b2e-8f99-d837d4db4530 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:00.023112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffe65c2e-4c8d-4b2e-8f99-d837d4db4530 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:00.023594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffe65c2e-4c8d-4b2e-8f99-d837d4db4530 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:00.024026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffe65c2e-4c8d-4b2e-8f99-d837d4db4530 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:00.024704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffe65c2e-4c8d-4b2e-8f99-d837d4db4530 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:00.025395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffe65c2e-4c8d-4b2e-8f99-d837d4db4530 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:00.025570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffe65c2e-4c8d-4b2e-8f99-d837d4db4530 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:00.055050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-19cef86d-c9db-4c4e-97f6-cd691e7ba104 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:00.056250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ffe65c2e-4c8d-4b2e-8f99-d837d4db4530 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045588 Aug 31 00:39:00.056833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 496/1064] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:00.057456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-19cef86d-c9db-4c4e-97f6-cd691e7ba104 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:00.063935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19cef86d-c9db-4c4e-97f6-cd691e7ba104 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:00.064425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19cef86d-c9db-4c4e-97f6-cd691e7ba104 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:00.064838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19cef86d-c9db-4c4e-97f6-cd691e7ba104 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:00.065518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19cef86d-c9db-4c4e-97f6-cd691e7ba104 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:00.065960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19cef86d-c9db-4c4e-97f6-cd691e7ba104 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:00.066401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19cef86d-c9db-4c4e-97f6-cd691e7ba104 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:00.070119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:00.096133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-19cef86d-c9db-4c4e-97f6-cd691e7ba104 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045705 Aug 31 00:39:00.096878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 569/1065] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:00.916889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c1a112b3-d4e2-4a96-a7c9-334c082433a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:00.918987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c1a112b3-d4e2-4a96-a7c9-334c082433a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:00.925161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1a112b3-d4e2-4a96-a7c9-334c082433a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:00.925636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1a112b3-d4e2-4a96-a7c9-334c082433a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:00.926072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1a112b3-d4e2-4a96-a7c9-334c082433a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:00.926736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1a112b3-d4e2-4a96-a7c9-334c082433a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:00.927213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1a112b3-d4e2-4a96-a7c9-334c082433a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:00.927626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1a112b3-d4e2-4a96-a7c9-334c082433a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:00.956430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c1a112b3-d4e2-4a96-a7c9-334c082433a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043406 Aug 31 00:39:00.956964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 497/1066] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:01.068850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9b4d9b30-24c4-4c35-aed4-3d4932021f6c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:01.071160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9b4d9b30-24c4-4c35-aed4-3d4932021f6c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:01.077564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4d9b30-24c4-4c35-aed4-3d4932021f6c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:01.078045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4d9b30-24c4-4c35-aed4-3d4932021f6c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:01.078480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4d9b30-24c4-4c35-aed4-3d4932021f6c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:01.079207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4d9b30-24c4-4c35-aed4-3d4932021f6c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:01.079666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4d9b30-24c4-4c35-aed4-3d4932021f6c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:01.080088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4d9b30-24c4-4c35-aed4-3d4932021f6c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:01.108916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-70095157-b818-434b-8060-3b9a8e18ffc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:01.110734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9b4d9b30-24c4-4c35-aed4-3d4932021f6c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045876 Aug 31 00:39:01.110947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-70095157-b818-434b-8060-3b9a8e18ffc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:01.111341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 570/1067] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:01.117551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70095157-b818-434b-8060-3b9a8e18ffc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:01.118023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70095157-b818-434b-8060-3b9a8e18ffc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:01.118457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70095157-b818-434b-8060-3b9a8e18ffc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:01.119167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70095157-b818-434b-8060-3b9a8e18ffc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:01.119619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70095157-b818-434b-8060-3b9a8e18ffc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:01.120037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70095157-b818-434b-8060-3b9a8e18ffc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:01.144749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:01.150920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-70095157-b818-434b-8060-3b9a8e18ffc4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Aug 31 00:39:01.151511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 498/1068] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:01.969310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dbc71f20-a4ee-4b37-aa93-64e56db8e67a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:01.971492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dbc71f20-a4ee-4b37-aa93-64e56db8e67a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:01.979611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dbc71f20-a4ee-4b37-aa93-64e56db8e67a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:01.980318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dbc71f20-a4ee-4b37-aa93-64e56db8e67a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:01.980967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dbc71f20-a4ee-4b37-aa93-64e56db8e67a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:01.982135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dbc71f20-a4ee-4b37-aa93-64e56db8e67a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:01.983206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dbc71f20-a4ee-4b37-aa93-64e56db8e67a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:01.983639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dbc71f20-a4ee-4b37-aa93-64e56db8e67a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:02.015874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dbc71f20-a4ee-4b37-aa93-64e56db8e67a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050462 Aug 31 00:39:02.016440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 571/1069] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:01 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:02.123991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2669591a-493c-4e4d-80bd-b3fe63cdf702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:02.126101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2669591a-493c-4e4d-80bd-b3fe63cdf702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:02.133212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2669591a-493c-4e4d-80bd-b3fe63cdf702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:02.133701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2669591a-493c-4e4d-80bd-b3fe63cdf702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:02.134135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2669591a-493c-4e4d-80bd-b3fe63cdf702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:02.134823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2669591a-493c-4e4d-80bd-b3fe63cdf702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:02.135301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2669591a-493c-4e4d-80bd-b3fe63cdf702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:02.135721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2669591a-493c-4e4d-80bd-b3fe63cdf702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:02.163398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e095d804-6c78-4678-a907-f0bb94d5932f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:02.165635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2669591a-493c-4e4d-80bd-b3fe63cdf702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045766 Aug 31 00:39:02.166016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e095d804-6c78-4678-a907-f0bb94d5932f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:02.166490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 499/1070] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:02.172363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e095d804-6c78-4678-a907-f0bb94d5932f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:02.172838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e095d804-6c78-4678-a907-f0bb94d5932f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:02.173268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e095d804-6c78-4678-a907-f0bb94d5932f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:02.173949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e095d804-6c78-4678-a907-f0bb94d5932f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:02.174393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e095d804-6c78-4678-a907-f0bb94d5932f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:02.174806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e095d804-6c78-4678-a907-f0bb94d5932f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:02.204451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e095d804-6c78-4678-a907-f0bb94d5932f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Aug 31 00:39:02.205000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 572/1071] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:03.029912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-89edc822-fbfd-4d2b-adf4-bd8b6805b100 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:03.032120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-89edc822-fbfd-4d2b-adf4-bd8b6805b100 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:03.037961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89edc822-fbfd-4d2b-adf4-bd8b6805b100 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:03.038436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89edc822-fbfd-4d2b-adf4-bd8b6805b100 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:03.038863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89edc822-fbfd-4d2b-adf4-bd8b6805b100 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:03.039561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89edc822-fbfd-4d2b-adf4-bd8b6805b100 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:03.040005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89edc822-fbfd-4d2b-adf4-bd8b6805b100 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:03.040559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89edc822-fbfd-4d2b-adf4-bd8b6805b100 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:03.068896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-89edc822-fbfd-4d2b-adf4-bd8b6805b100 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 Aug 31 00:39:03.069428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 500/1072] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:03 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:03.178135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7d074943-4255-4385-868c-6893c2019f78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:03.180283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7d074943-4255-4385-868c-6893c2019f78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:03.186737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d074943-4255-4385-868c-6893c2019f78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:03.187242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d074943-4255-4385-868c-6893c2019f78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:03.187672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d074943-4255-4385-868c-6893c2019f78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:03.188349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d074943-4255-4385-868c-6893c2019f78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:03.188792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d074943-4255-4385-868c-6893c2019f78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:03.189206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d074943-4255-4385-868c-6893c2019f78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:03.217731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-92a09d50-a681-443d-ac1a-c2baa3a08fd8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:03.219761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7d074943-4255-4385-868c-6893c2019f78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045582 Aug 31 00:39:03.219893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-92a09d50-a681-443d-ac1a-c2baa3a08fd8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:03.220320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 573/1073] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:03.226144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92a09d50-a681-443d-ac1a-c2baa3a08fd8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:03.226630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92a09d50-a681-443d-ac1a-c2baa3a08fd8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:03.227086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92a09d50-a681-443d-ac1a-c2baa3a08fd8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:03.227851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92a09d50-a681-443d-ac1a-c2baa3a08fd8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:03.228335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92a09d50-a681-443d-ac1a-c2baa3a08fd8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:03.228753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92a09d50-a681-443d-ac1a-c2baa3a08fd8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:03.258460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-92a09d50-a681-443d-ac1a-c2baa3a08fd8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Aug 31 00:39:03.259800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 501/1074] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:04.081732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-61f5857a-afab-4bfe-876f-46b6294e1af8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:04.083918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-61f5857a-afab-4bfe-876f-46b6294e1af8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:04.090762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61f5857a-afab-4bfe-876f-46b6294e1af8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.091283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61f5857a-afab-4bfe-876f-46b6294e1af8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.091723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61f5857a-afab-4bfe-876f-46b6294e1af8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.092413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61f5857a-afab-4bfe-876f-46b6294e1af8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.092867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61f5857a-afab-4bfe-876f-46b6294e1af8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.093294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61f5857a-afab-4bfe-876f-46b6294e1af8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.123565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-61f5857a-afab-4bfe-876f-46b6294e1af8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Aug 31 00:39:04.124120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 574/1075] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:04 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:04.232209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e1fd7827-5770-4f6c-b5cb-3df123d647f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:04.234594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e1fd7827-5770-4f6c-b5cb-3df123d647f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:04.240988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1fd7827-5770-4f6c-b5cb-3df123d647f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.241459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1fd7827-5770-4f6c-b5cb-3df123d647f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.241882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1fd7827-5770-4f6c-b5cb-3df123d647f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.242550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1fd7827-5770-4f6c-b5cb-3df123d647f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.242988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1fd7827-5770-4f6c-b5cb-3df123d647f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.243472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1fd7827-5770-4f6c-b5cb-3df123d647f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.271571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cba70df3-cf6a-44ef-9e69-7c17044cb829 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:04.272071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e1fd7827-5770-4f6c-b5cb-3df123d647f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044426 Aug 31 00:39:04.272380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 502/1076] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:04.273692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cba70df3-cf6a-44ef-9e69-7c17044cb829 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:04.280683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba70df3-cf6a-44ef-9e69-7c17044cb829 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.281167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba70df3-cf6a-44ef-9e69-7c17044cb829 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.281601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba70df3-cf6a-44ef-9e69-7c17044cb829 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.282294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba70df3-cf6a-44ef-9e69-7c17044cb829 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.282750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba70df3-cf6a-44ef-9e69-7c17044cb829 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.283208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cba70df3-cf6a-44ef-9e69-7c17044cb829 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.313220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cba70df3-cf6a-44ef-9e69-7c17044cb829 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Aug 31 00:39:04.313783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 575/1077] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:05.136035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6b888665-96b0-4bff-bda8-0bd0f42bf613 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:05.138195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6b888665-96b0-4bff-bda8-0bd0f42bf613 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:05.144403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b888665-96b0-4bff-bda8-0bd0f42bf613 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:05.144877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b888665-96b0-4bff-bda8-0bd0f42bf613 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:05.145303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b888665-96b0-4bff-bda8-0bd0f42bf613 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.146012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b888665-96b0-4bff-bda8-0bd0f42bf613 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:05.146481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b888665-96b0-4bff-bda8-0bd0f42bf613 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:05.146895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b888665-96b0-4bff-bda8-0bd0f42bf613 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.176971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6b888665-96b0-4bff-bda8-0bd0f42bf613 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044995 Aug 31 00:39:05.177520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 503/1078] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:05 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:05.284696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-153e238c-ab35-4cd7-bf7b-2b5540b2a64d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:05.286830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-153e238c-ab35-4cd7-bf7b-2b5540b2a64d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:05.294005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-153e238c-ab35-4cd7-bf7b-2b5540b2a64d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:05.294482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-153e238c-ab35-4cd7-bf7b-2b5540b2a64d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:05.294912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-153e238c-ab35-4cd7-bf7b-2b5540b2a64d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.295624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-153e238c-ab35-4cd7-bf7b-2b5540b2a64d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:05.296073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-153e238c-ab35-4cd7-bf7b-2b5540b2a64d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:05.296492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-153e238c-ab35-4cd7-bf7b-2b5540b2a64d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.325684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c0921ba8-bf64-4a38-9155-ef592fca80ad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:05.326534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-153e238c-ab35-4cd7-bf7b-2b5540b2a64d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045826 Aug 31 00:39:05.327113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 576/1079] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:05.327875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c0921ba8-bf64-4a38-9155-ef592fca80ad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:05.333840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0921ba8-bf64-4a38-9155-ef592fca80ad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:05.334313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0921ba8-bf64-4a38-9155-ef592fca80ad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:05.334739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0921ba8-bf64-4a38-9155-ef592fca80ad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.335432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0921ba8-bf64-4a38-9155-ef592fca80ad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:05.335876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0921ba8-bf64-4a38-9155-ef592fca80ad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:05.336287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0921ba8-bf64-4a38-9155-ef592fca80ad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.366462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c0921ba8-bf64-4a38-9155-ef592fca80ad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Aug 31 00:39:05.367012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 504/1080] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:06.189757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7c345b62-67e7-4f21-9a07-7dc71c3ed6b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:06.191926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7c345b62-67e7-4f21-9a07-7dc71c3ed6b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:06.198479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c345b62-67e7-4f21-9a07-7dc71c3ed6b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:06.198955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c345b62-67e7-4f21-9a07-7dc71c3ed6b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:06.199499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c345b62-67e7-4f21-9a07-7dc71c3ed6b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:06.200101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c345b62-67e7-4f21-9a07-7dc71c3ed6b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:06.200553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c345b62-67e7-4f21-9a07-7dc71c3ed6b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:06.200970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c345b62-67e7-4f21-9a07-7dc71c3ed6b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:06.231310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7c345b62-67e7-4f21-9a07-7dc71c3ed6b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Aug 31 00:39:06.231861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 577/1081] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:06 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:06.339094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-23a701d6-233b-4231-9870-554676fef8fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:06.341272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-23a701d6-233b-4231-9870-554676fef8fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:06.347416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23a701d6-233b-4231-9870-554676fef8fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:06.347892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23a701d6-233b-4231-9870-554676fef8fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:06.348325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23a701d6-233b-4231-9870-554676fef8fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:06.349009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23a701d6-233b-4231-9870-554676fef8fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:06.349459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23a701d6-233b-4231-9870-554676fef8fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:06.349882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23a701d6-233b-4231-9870-554676fef8fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:06.379580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9ad15e95-7715-434d-8438-c43789c5fbcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:06.380428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-23a701d6-233b-4231-9870-554676fef8fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045567 Aug 31 00:39:06.380997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 505/1082] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:06.381871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9ad15e95-7715-434d-8438-c43789c5fbcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:06.389201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ad15e95-7715-434d-8438-c43789c5fbcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:06.389680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ad15e95-7715-434d-8438-c43789c5fbcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:06.390113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ad15e95-7715-434d-8438-c43789c5fbcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:06.390931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ad15e95-7715-434d-8438-c43789c5fbcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:06.391436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ad15e95-7715-434d-8438-c43789c5fbcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:06.391857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ad15e95-7715-434d-8438-c43789c5fbcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:06.425334 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9ad15e95-7715-434d-8438-c43789c5fbcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047777 Aug 31 00:39:06.425952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 578/1083] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:07.243918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6564bd36-c884-4537-a619-361a7d6d97c4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:07.246079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6564bd36-c884-4537-a619-361a7d6d97c4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:07.251933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6564bd36-c884-4537-a619-361a7d6d97c4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:07.252411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6564bd36-c884-4537-a619-361a7d6d97c4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:07.252847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6564bd36-c884-4537-a619-361a7d6d97c4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:07.253523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6564bd36-c884-4537-a619-361a7d6d97c4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:07.253971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6564bd36-c884-4537-a619-361a7d6d97c4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:07.254389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6564bd36-c884-4537-a619-361a7d6d97c4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:07.283881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6564bd36-c884-4537-a619-361a7d6d97c4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Aug 31 00:39:07.284427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 506/1084] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:07 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:07.393981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a4ca6d24-71ac-4c6e-8ac6-65232d09fb0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:07.396207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a4ca6d24-71ac-4c6e-8ac6-65232d09fb0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:07.403719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4ca6d24-71ac-4c6e-8ac6-65232d09fb0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:07.404207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4ca6d24-71ac-4c6e-8ac6-65232d09fb0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:07.404645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4ca6d24-71ac-4c6e-8ac6-65232d09fb0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:07.405335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4ca6d24-71ac-4c6e-8ac6-65232d09fb0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:07.405788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4ca6d24-71ac-4c6e-8ac6-65232d09fb0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:07.406211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4ca6d24-71ac-4c6e-8ac6-65232d09fb0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:07.437738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a4ca6d24-71ac-4c6e-8ac6-65232d09fb0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047669 Aug 31 00:39:07.437954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4296dcd6-d65f-44e9-81f7-3aa688b0f577 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:07.438389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 579/1085] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:07.440098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4296dcd6-d65f-44e9-81f7-3aa688b0f577 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:07.447811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4296dcd6-d65f-44e9-81f7-3aa688b0f577 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:07.448302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4296dcd6-d65f-44e9-81f7-3aa688b0f577 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:07.448742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4296dcd6-d65f-44e9-81f7-3aa688b0f577 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:07.449437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4296dcd6-d65f-44e9-81f7-3aa688b0f577 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:07.449890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4296dcd6-d65f-44e9-81f7-3aa688b0f577 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:07.450312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4296dcd6-d65f-44e9-81f7-3aa688b0f577 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:07.480164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4296dcd6-d65f-44e9-81f7-3aa688b0f577 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046065 Aug 31 00:39:07.480724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 507/1086] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:08.296093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3122a3da-f4d7-44d9-b43b-e819b6b9d988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:08.298224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3122a3da-f4d7-44d9-b43b-e819b6b9d988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:08.304106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3122a3da-f4d7-44d9-b43b-e819b6b9d988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.304581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3122a3da-f4d7-44d9-b43b-e819b6b9d988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.305005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3122a3da-f4d7-44d9-b43b-e819b6b9d988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.305680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3122a3da-f4d7-44d9-b43b-e819b6b9d988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.306124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3122a3da-f4d7-44d9-b43b-e819b6b9d988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.306534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3122a3da-f4d7-44d9-b43b-e819b6b9d988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.335754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3122a3da-f4d7-44d9-b43b-e819b6b9d988 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043513 Aug 31 00:39:08.336306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 580/1087] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:08 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:08.450668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-685e8b11-de8d-4132-8753-be3b645c912a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:08.454237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-685e8b11-de8d-4132-8753-be3b645c912a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:08.464762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-685e8b11-de8d-4132-8753-be3b645c912a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.465257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-685e8b11-de8d-4132-8753-be3b645c912a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.465696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-685e8b11-de8d-4132-8753-be3b645c912a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.466395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-685e8b11-de8d-4132-8753-be3b645c912a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.466849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-685e8b11-de8d-4132-8753-be3b645c912a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.467313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-685e8b11-de8d-4132-8753-be3b645c912a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.491852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f7ee0328-6a96-4729-98b4-2daaa0b81bc2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:08.494675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f7ee0328-6a96-4729-98b4-2daaa0b81bc2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:08.498503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-685e8b11-de8d-4132-8753-be3b645c912a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052539 Aug 31 00:39:08.499007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 508/1088] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:08.501074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7ee0328-6a96-4729-98b4-2daaa0b81bc2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.501558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7ee0328-6a96-4729-98b4-2daaa0b81bc2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.501996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7ee0328-6a96-4729-98b4-2daaa0b81bc2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.502695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7ee0328-6a96-4729-98b4-2daaa0b81bc2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.503168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7ee0328-6a96-4729-98b4-2daaa0b81bc2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.503593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7ee0328-6a96-4729-98b4-2daaa0b81bc2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.533856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f7ee0328-6a96-4729-98b4-2daaa0b81bc2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045923 Aug 31 00:39:08.534418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 581/1089] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:09.348740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-80a692c3-a0df-46a8-b1d5-dd7851847b2f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:09.350877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-80a692c3-a0df-46a8-b1d5-dd7851847b2f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:09.358312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80a692c3-a0df-46a8-b1d5-dd7851847b2f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:09.358798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80a692c3-a0df-46a8-b1d5-dd7851847b2f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:09.359265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80a692c3-a0df-46a8-b1d5-dd7851847b2f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:09.359956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80a692c3-a0df-46a8-b1d5-dd7851847b2f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:09.360415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80a692c3-a0df-46a8-b1d5-dd7851847b2f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:09.360834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80a692c3-a0df-46a8-b1d5-dd7851847b2f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:09.390953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-80a692c3-a0df-46a8-b1d5-dd7851847b2f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046287 Aug 31 00:39:09.391528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 509/1090] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:09 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:09.511931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c580fd7a-a9e7-43d2-aef3-7f439f5468d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:09.514144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c580fd7a-a9e7-43d2-aef3-7f439f5468d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:09.520567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c580fd7a-a9e7-43d2-aef3-7f439f5468d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:09.521059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c580fd7a-a9e7-43d2-aef3-7f439f5468d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:09.521486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c580fd7a-a9e7-43d2-aef3-7f439f5468d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:09.522165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c580fd7a-a9e7-43d2-aef3-7f439f5468d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:09.522607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c580fd7a-a9e7-43d2-aef3-7f439f5468d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:09.523020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c580fd7a-a9e7-43d2-aef3-7f439f5468d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:09.547711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-201b7cd0-6831-417b-a31a-aea13496fa50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:09.549848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-201b7cd0-6831-417b-a31a-aea13496fa50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:09.554099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c580fd7a-a9e7-43d2-aef3-7f439f5468d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046745 Aug 31 00:39:09.554668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 582/1091] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:09.556952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201b7cd0-6831-417b-a31a-aea13496fa50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:09.557491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201b7cd0-6831-417b-a31a-aea13496fa50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:09.557930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201b7cd0-6831-417b-a31a-aea13496fa50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:09.558633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201b7cd0-6831-417b-a31a-aea13496fa50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:09.559112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201b7cd0-6831-417b-a31a-aea13496fa50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:09.559605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-201b7cd0-6831-417b-a31a-aea13496fa50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:09.590415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-201b7cd0-6831-417b-a31a-aea13496fa50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047055 Aug 31 00:39:09.590966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 510/1092] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:10.403994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-65727a96-64b6-4576-9e3a-4cdc9dfdc2cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:10.406161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-65727a96-64b6-4576-9e3a-4cdc9dfdc2cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:10.412192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65727a96-64b6-4576-9e3a-4cdc9dfdc2cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:10.412672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65727a96-64b6-4576-9e3a-4cdc9dfdc2cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:10.413106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65727a96-64b6-4576-9e3a-4cdc9dfdc2cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:10.413791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65727a96-64b6-4576-9e3a-4cdc9dfdc2cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:10.414240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65727a96-64b6-4576-9e3a-4cdc9dfdc2cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:10.414659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65727a96-64b6-4576-9e3a-4cdc9dfdc2cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:10.443491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-65727a96-64b6-4576-9e3a-4cdc9dfdc2cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044045 Aug 31 00:39:10.444036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 583/1093] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:10 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:10.566943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ee1ab1d5-dc61-4f9b-84c4-c8976f10be17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:10.569077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ee1ab1d5-dc61-4f9b-84c4-c8976f10be17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:10.576084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee1ab1d5-dc61-4f9b-84c4-c8976f10be17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:10.576556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee1ab1d5-dc61-4f9b-84c4-c8976f10be17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:10.576982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee1ab1d5-dc61-4f9b-84c4-c8976f10be17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:10.577652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee1ab1d5-dc61-4f9b-84c4-c8976f10be17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:10.578090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee1ab1d5-dc61-4f9b-84c4-c8976f10be17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:10.578500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee1ab1d5-dc61-4f9b-84c4-c8976f10be17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:10.601853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e8df355c-cd91-4f8c-bd3b-655774990b80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:10.604307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e8df355c-cd91-4f8c-bd3b-655774990b80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:10.608801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ee1ab1d5-dc61-4f9b-84c4-c8976f10be17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045716 Aug 31 00:39:10.609539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 511/1094] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:10.610931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8df355c-cd91-4f8c-bd3b-655774990b80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:10.611499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8df355c-cd91-4f8c-bd3b-655774990b80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:10.611928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8df355c-cd91-4f8c-bd3b-655774990b80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:10.612667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8df355c-cd91-4f8c-bd3b-655774990b80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:10.613064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8df355c-cd91-4f8c-bd3b-655774990b80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:10.613512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8df355c-cd91-4f8c-bd3b-655774990b80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:10.643709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e8df355c-cd91-4f8c-bd3b-655774990b80 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045763 Aug 31 00:39:10.644260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 584/1095] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:11.457892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1c62548e-dbd2-4c5f-b7bc-899b8677b4ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:11.460085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1c62548e-dbd2-4c5f-b7bc-899b8677b4ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:11.466822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c62548e-dbd2-4c5f-b7bc-899b8677b4ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.467338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c62548e-dbd2-4c5f-b7bc-899b8677b4ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.467772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c62548e-dbd2-4c5f-b7bc-899b8677b4ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.468461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c62548e-dbd2-4c5f-b7bc-899b8677b4ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.468908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c62548e-dbd2-4c5f-b7bc-899b8677b4ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.469328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c62548e-dbd2-4c5f-b7bc-899b8677b4ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.499030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1c62548e-dbd2-4c5f-b7bc-899b8677b4ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046269 Aug 31 00:39:11.499628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 512/1096] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:11 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:11.621192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7769bb69-c264-4403-9d5a-d591b6b4d1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:11.623438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7769bb69-c264-4403-9d5a-d591b6b4d1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:11.632211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7769bb69-c264-4403-9d5a-d591b6b4d1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.632684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7769bb69-c264-4403-9d5a-d591b6b4d1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.633140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7769bb69-c264-4403-9d5a-d591b6b4d1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.633857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7769bb69-c264-4403-9d5a-d591b6b4d1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.634376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7769bb69-c264-4403-9d5a-d591b6b4d1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.634713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7769bb69-c264-4403-9d5a-d591b6b4d1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.659751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-58161b15-2b7b-4727-b839-2cbb960f26f2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:11.662183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:11.663913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-58161b15-2b7b-4727-b839-2cbb960f26f2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:11.669500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7769bb69-c264-4403-9d5a-d591b6b4d1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052921 Aug 31 00:39:11.670020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 585/1097] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:11.671751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58161b15-2b7b-4727-b839-2cbb960f26f2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.672525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58161b15-2b7b-4727-b839-2cbb960f26f2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.673038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58161b15-2b7b-4727-b839-2cbb960f26f2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.674071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58161b15-2b7b-4727-b839-2cbb960f26f2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.674982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58161b15-2b7b-4727-b839-2cbb960f26f2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.675562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58161b15-2b7b-4727-b839-2cbb960f26f2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.709767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-58161b15-2b7b-4727-b839-2cbb960f26f2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056545 Aug 31 00:39:11.710461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 513/1098] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:12.512308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b15d65bd-9b6f-42a3-930a-f495f5c4617a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:12.514734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b15d65bd-9b6f-42a3-930a-f495f5c4617a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:12.521109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b15d65bd-9b6f-42a3-930a-f495f5c4617a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.521607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b15d65bd-9b6f-42a3-930a-f495f5c4617a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.522043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b15d65bd-9b6f-42a3-930a-f495f5c4617a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.522744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b15d65bd-9b6f-42a3-930a-f495f5c4617a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.523229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b15d65bd-9b6f-42a3-930a-f495f5c4617a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.523652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b15d65bd-9b6f-42a3-930a-f495f5c4617a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.554699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b15d65bd-9b6f-42a3-930a-f495f5c4617a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046932 Aug 31 00:39:12.555297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 586/1099] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:12 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:12.682587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93d27f10-92b3-4837-a286-17a99a3cfe49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:12.684719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-93d27f10-92b3-4837-a286-17a99a3cfe49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:12.691095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d27f10-92b3-4837-a286-17a99a3cfe49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.691584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d27f10-92b3-4837-a286-17a99a3cfe49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.692011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d27f10-92b3-4837-a286-17a99a3cfe49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.693698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d27f10-92b3-4837-a286-17a99a3cfe49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.694154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d27f10-92b3-4837-a286-17a99a3cfe49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.694573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d27f10-92b3-4837-a286-17a99a3cfe49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.723202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bb90532f-d021-4294-a5b7-b0cef9f61c5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:12.723776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-93d27f10-92b3-4837-a286-17a99a3cfe49 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045733 Aug 31 00:39:12.724245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 514/1100] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:12.725473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bb90532f-d021-4294-a5b7-b0cef9f61c5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:12.733088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb90532f-d021-4294-a5b7-b0cef9f61c5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.733498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb90532f-d021-4294-a5b7-b0cef9f61c5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.733950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb90532f-d021-4294-a5b7-b0cef9f61c5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.734632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb90532f-d021-4294-a5b7-b0cef9f61c5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.735093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb90532f-d021-4294-a5b7-b0cef9f61c5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.735507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb90532f-d021-4294-a5b7-b0cef9f61c5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.765332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bb90532f-d021-4294-a5b7-b0cef9f61c5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046085 Aug 31 00:39:12.765899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 587/1101] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:13.567722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-24eb7957-db1e-48cd-8633-290944eb9763 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:13.569867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-24eb7957-db1e-48cd-8633-290944eb9763 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:13.578739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24eb7957-db1e-48cd-8633-290944eb9763 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.579255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24eb7957-db1e-48cd-8633-290944eb9763 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.579692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24eb7957-db1e-48cd-8633-290944eb9763 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.580385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24eb7957-db1e-48cd-8633-290944eb9763 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.580840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24eb7957-db1e-48cd-8633-290944eb9763 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.581259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24eb7957-db1e-48cd-8633-290944eb9763 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.599050 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:13.614303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-24eb7957-db1e-48cd-8633-290944eb9763 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050502 Aug 31 00:39:13.614856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 515/1102] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:13 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:13.736977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-83771826-2efa-436e-95bf-d2993d96449b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:13.739150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-83771826-2efa-436e-95bf-d2993d96449b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:13.745525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83771826-2efa-436e-95bf-d2993d96449b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.746003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83771826-2efa-436e-95bf-d2993d96449b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.746448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83771826-2efa-436e-95bf-d2993d96449b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.747203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83771826-2efa-436e-95bf-d2993d96449b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.747650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83771826-2efa-436e-95bf-d2993d96449b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.748063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83771826-2efa-436e-95bf-d2993d96449b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.777749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0ff62d42-507d-45b8-a54a-bb0261a71e84 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:13.778281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-83771826-2efa-436e-95bf-d2993d96449b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044948 Aug 31 00:39:13.779123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 588/1103] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:13.780106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0ff62d42-507d-45b8-a54a-bb0261a71e84 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:13.786484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ff62d42-507d-45b8-a54a-bb0261a71e84 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.786967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ff62d42-507d-45b8-a54a-bb0261a71e84 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.787435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ff62d42-507d-45b8-a54a-bb0261a71e84 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.788123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ff62d42-507d-45b8-a54a-bb0261a71e84 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.788599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ff62d42-507d-45b8-a54a-bb0261a71e84 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.789133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ff62d42-507d-45b8-a54a-bb0261a71e84 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.819296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0ff62d42-507d-45b8-a54a-bb0261a71e84 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045872 Aug 31 00:39:13.819770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 516/1104] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:14.626615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4a272c01-28d2-4c1e-81f3-ef852b1e2507 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:14.628766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4a272c01-28d2-4c1e-81f3-ef852b1e2507 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:14.635302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a272c01-28d2-4c1e-81f3-ef852b1e2507 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:14.635786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a272c01-28d2-4c1e-81f3-ef852b1e2507 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:14.636247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a272c01-28d2-4c1e-81f3-ef852b1e2507 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:14.636941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a272c01-28d2-4c1e-81f3-ef852b1e2507 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:14.637390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a272c01-28d2-4c1e-81f3-ef852b1e2507 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:14.637811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a272c01-28d2-4c1e-81f3-ef852b1e2507 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:14.668787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4a272c01-28d2-4c1e-81f3-ef852b1e2507 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045994 Aug 31 00:39:14.669333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 589/1105] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:14 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:14.790067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f55b841e-55aa-451f-a6fc-e5a60901bbc1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:14.792302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f55b841e-55aa-451f-a6fc-e5a60901bbc1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:14.798570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f55b841e-55aa-451f-a6fc-e5a60901bbc1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:14.799059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f55b841e-55aa-451f-a6fc-e5a60901bbc1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:14.799497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f55b841e-55aa-451f-a6fc-e5a60901bbc1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:14.800171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f55b841e-55aa-451f-a6fc-e5a60901bbc1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:14.800614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f55b841e-55aa-451f-a6fc-e5a60901bbc1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:14.801026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f55b841e-55aa-451f-a6fc-e5a60901bbc1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:14.831337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-02f25f2f-ef2f-4018-afde-43325412080b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:14.831905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f55b841e-55aa-451f-a6fc-e5a60901bbc1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045279 Aug 31 00:39:14.832183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 517/1106] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:14.833465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-02f25f2f-ef2f-4018-afde-43325412080b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:14.840160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02f25f2f-ef2f-4018-afde-43325412080b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:14.840638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02f25f2f-ef2f-4018-afde-43325412080b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:14.841067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02f25f2f-ef2f-4018-afde-43325412080b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:14.841779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02f25f2f-ef2f-4018-afde-43325412080b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:14.842231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02f25f2f-ef2f-4018-afde-43325412080b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:14.842647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02f25f2f-ef2f-4018-afde-43325412080b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:14.873198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-02f25f2f-ef2f-4018-afde-43325412080b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Aug 31 00:39:14.873675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 590/1107] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:15.681221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-82aba8ab-e1c5-43be-a416-f2cc6ebc1377 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:15.683423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-82aba8ab-e1c5-43be-a416-f2cc6ebc1377 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:15.689468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82aba8ab-e1c5-43be-a416-f2cc6ebc1377 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.689984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82aba8ab-e1c5-43be-a416-f2cc6ebc1377 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.690419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82aba8ab-e1c5-43be-a416-f2cc6ebc1377 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:15.691194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82aba8ab-e1c5-43be-a416-f2cc6ebc1377 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.691668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82aba8ab-e1c5-43be-a416-f2cc6ebc1377 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.692080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82aba8ab-e1c5-43be-a416-f2cc6ebc1377 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:15.722803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-82aba8ab-e1c5-43be-a416-f2cc6ebc1377 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045783 Aug 31 00:39:15.723374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 518/1108] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:15 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:15.843889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d0e3569-bfc0-4f2d-911e-cd48b237f192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:15.846138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d0e3569-bfc0-4f2d-911e-cd48b237f192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:15.852848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0e3569-bfc0-4f2d-911e-cd48b237f192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.853388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0e3569-bfc0-4f2d-911e-cd48b237f192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.853828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0e3569-bfc0-4f2d-911e-cd48b237f192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:15.854554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0e3569-bfc0-4f2d-911e-cd48b237f192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.855008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0e3569-bfc0-4f2d-911e-cd48b237f192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.855455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0e3569-bfc0-4f2d-911e-cd48b237f192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:15.885941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7475513e-ab90-4cff-9a73-8e797101001b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:15.888133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7475513e-ab90-4cff-9a73-8e797101001b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:15.892320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d0e3569-bfc0-4f2d-911e-cd48b237f192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051957 Aug 31 00:39:15.892910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 591/1109] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:15.894538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7475513e-ab90-4cff-9a73-8e797101001b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.895019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7475513e-ab90-4cff-9a73-8e797101001b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.895496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7475513e-ab90-4cff-9a73-8e797101001b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:15.896161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7475513e-ab90-4cff-9a73-8e797101001b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.896602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7475513e-ab90-4cff-9a73-8e797101001b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.897017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7475513e-ab90-4cff-9a73-8e797101001b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:15.927994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7475513e-ab90-4cff-9a73-8e797101001b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046434 Aug 31 00:39:15.928459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 519/1110] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:16.735450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ad80477f-0170-4236-8746-9a79173c9b4f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:16.737580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ad80477f-0170-4236-8746-9a79173c9b4f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:16.743544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad80477f-0170-4236-8746-9a79173c9b4f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:16.744115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad80477f-0170-4236-8746-9a79173c9b4f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:16.744556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad80477f-0170-4236-8746-9a79173c9b4f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:16.745252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad80477f-0170-4236-8746-9a79173c9b4f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:16.745703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad80477f-0170-4236-8746-9a79173c9b4f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:16.746121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad80477f-0170-4236-8746-9a79173c9b4f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:16.776690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ad80477f-0170-4236-8746-9a79173c9b4f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045411 Aug 31 00:39:16.777527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 592/1111] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:16 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:16.905115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e74948a5-81bd-4c2c-8ba5-cbbbde41fccb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:16.907261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e74948a5-81bd-4c2c-8ba5-cbbbde41fccb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:16.909209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:39:16.909350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:39:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments (ip 10.222.0.67) !!! Aug 31 00:39:16.910377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:39:16.910523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:39:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments (ip 10.222.0.67) !!! Aug 31 00:39:16.918315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e74948a5-81bd-4c2c-8ba5-cbbbde41fccb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:16.918798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e74948a5-81bd-4c2c-8ba5-cbbbde41fccb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:16.919254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e74948a5-81bd-4c2c-8ba5-cbbbde41fccb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:16.919943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e74948a5-81bd-4c2c-8ba5-cbbbde41fccb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:16.920384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e74948a5-81bd-4c2c-8ba5-cbbbde41fccb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:16.920799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e74948a5-81bd-4c2c-8ba5-cbbbde41fccb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:16.942135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4fcafb29-2b4e-4904-bd6c-8139961efe36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:16.945330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4fcafb29-2b4e-4904-bd6c-8139961efe36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:16.952284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fcafb29-2b4e-4904-bd6c-8139961efe36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:16.952771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fcafb29-2b4e-4904-bd6c-8139961efe36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:16.953208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fcafb29-2b4e-4904-bd6c-8139961efe36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:16.953910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fcafb29-2b4e-4904-bd6c-8139961efe36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:16.954365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fcafb29-2b4e-4904-bd6c-8139961efe36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:16.954785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fcafb29-2b4e-4904-bd6c-8139961efe36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:16.956169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e74948a5-81bd-4c2c-8ba5-cbbbde41fccb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054998 Aug 31 00:39:16.956907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 520/1112] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:16.986299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4fcafb29-2b4e-4904-bd6c-8139961efe36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048527 Aug 31 00:39:16.986775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 593/1113] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:17.788688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-77351507-40a7-4edb-9743-9aeb77119bee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:17.791188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-77351507-40a7-4edb-9743-9aeb77119bee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:17.797577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77351507-40a7-4edb-9743-9aeb77119bee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:17.798059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77351507-40a7-4edb-9743-9aeb77119bee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:17.798492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77351507-40a7-4edb-9743-9aeb77119bee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:17.799214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77351507-40a7-4edb-9743-9aeb77119bee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:17.799674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77351507-40a7-4edb-9743-9aeb77119bee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:17.800095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77351507-40a7-4edb-9743-9aeb77119bee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:17.831631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-77351507-40a7-4edb-9743-9aeb77119bee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046871 Aug 31 00:39:17.832189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 521/1114] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:17 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:17.968777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-84b2c0b5-5dfc-4fb1-9f39-77629441e00f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:17.970915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-84b2c0b5-5dfc-4fb1-9f39-77629441e00f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:17.973606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:39:17.973757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:39:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments (ip 10.222.0.67) !!! Aug 31 00:39:17.983339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b2c0b5-5dfc-4fb1-9f39-77629441e00f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:17.983824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b2c0b5-5dfc-4fb1-9f39-77629441e00f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:17.984261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b2c0b5-5dfc-4fb1-9f39-77629441e00f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:17.984956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b2c0b5-5dfc-4fb1-9f39-77629441e00f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:17.985405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b2c0b5-5dfc-4fb1-9f39-77629441e00f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:17.985827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b2c0b5-5dfc-4fb1-9f39-77629441e00f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:17.998551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9953341d-f3c0-4d7f-94fc-4a2f2c3f6e90 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:18.000720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9953341d-f3c0-4d7f-94fc-4a2f2c3f6e90 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:18.007011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9953341d-f3c0-4d7f-94fc-4a2f2c3f6e90 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.007519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9953341d-f3c0-4d7f-94fc-4a2f2c3f6e90 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.007944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9953341d-f3c0-4d7f-94fc-4a2f2c3f6e90 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.008880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9953341d-f3c0-4d7f-94fc-4a2f2c3f6e90 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.009338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9953341d-f3c0-4d7f-94fc-4a2f2c3f6e90 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.009756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9953341d-f3c0-4d7f-94fc-4a2f2c3f6e90 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.019137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-84b2c0b5-5dfc-4fb1-9f39-77629441e00f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054282 Aug 31 00:39:18.019705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 594/1115] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:18.038949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9953341d-f3c0-4d7f-94fc-4a2f2c3f6e90 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044315 Aug 31 00:39:18.039460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 522/1116] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:18.844266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cceb83fc-488a-4a63-91c4-1da299a4d2bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:18.846405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cceb83fc-488a-4a63-91c4-1da299a4d2bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:18.852925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cceb83fc-488a-4a63-91c4-1da299a4d2bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.853414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cceb83fc-488a-4a63-91c4-1da299a4d2bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.853851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cceb83fc-488a-4a63-91c4-1da299a4d2bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.854554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cceb83fc-488a-4a63-91c4-1da299a4d2bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.855010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cceb83fc-488a-4a63-91c4-1da299a4d2bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.855460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cceb83fc-488a-4a63-91c4-1da299a4d2bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.887293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cceb83fc-488a-4a63-91c4-1da299a4d2bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047102 Aug 31 00:39:18.887880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 595/1117] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:18 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:19.031605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e3bbcef-31d6-4a37-91a4-99be3ca6244f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:19.033834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7e3bbcef-31d6-4a37-91a4-99be3ca6244f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:19.040275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e3bbcef-31d6-4a37-91a4-99be3ca6244f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:19.040752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e3bbcef-31d6-4a37-91a4-99be3ca6244f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:19.041184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e3bbcef-31d6-4a37-91a4-99be3ca6244f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:19.042304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e3bbcef-31d6-4a37-91a4-99be3ca6244f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:19.042518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e3bbcef-31d6-4a37-91a4-99be3ca6244f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:19.042827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e3bbcef-31d6-4a37-91a4-99be3ca6244f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:19.051614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d8c7b233-f5ee-4316-8f85-dc919a7f9d2e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:19.053737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d8c7b233-f5ee-4316-8f85-dc919a7f9d2e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:19.060683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8c7b233-f5ee-4316-8f85-dc919a7f9d2e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:19.061160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8c7b233-f5ee-4316-8f85-dc919a7f9d2e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:19.061627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8c7b233-f5ee-4316-8f85-dc919a7f9d2e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:19.062313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8c7b233-f5ee-4316-8f85-dc919a7f9d2e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:19.062764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8c7b233-f5ee-4316-8f85-dc919a7f9d2e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:19.063217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8c7b233-f5ee-4316-8f85-dc919a7f9d2e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:19.073825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7e3bbcef-31d6-4a37-91a4-99be3ca6244f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046128 Aug 31 00:39:19.074401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 523/1118] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:19.093282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d8c7b233-f5ee-4316-8f85-dc919a7f9d2e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045471 Aug 31 00:39:19.093758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 596/1119] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:19.899479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a4ff9a34-b2ae-4b12-838e-c5ecbc4c57cd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:19.904080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a4ff9a34-b2ae-4b12-838e-c5ecbc4c57cd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:19.911355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4ff9a34-b2ae-4b12-838e-c5ecbc4c57cd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:19.911839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4ff9a34-b2ae-4b12-838e-c5ecbc4c57cd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:19.912270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4ff9a34-b2ae-4b12-838e-c5ecbc4c57cd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:19.912965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4ff9a34-b2ae-4b12-838e-c5ecbc4c57cd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:19.913418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4ff9a34-b2ae-4b12-838e-c5ecbc4c57cd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:19.913839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4ff9a34-b2ae-4b12-838e-c5ecbc4c57cd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:19.944672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a4ff9a34-b2ae-4b12-838e-c5ecbc4c57cd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049716 Aug 31 00:39:19.945224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 524/1120] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:19 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:20.086914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e874b6d7-0d95-4fea-bc89-0277725f8590 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:20.089045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e874b6d7-0d95-4fea-bc89-0277725f8590 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:20.095440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e874b6d7-0d95-4fea-bc89-0277725f8590 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:20.095917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e874b6d7-0d95-4fea-bc89-0277725f8590 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:20.096348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e874b6d7-0d95-4fea-bc89-0277725f8590 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:20.097030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e874b6d7-0d95-4fea-bc89-0277725f8590 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:20.097477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e874b6d7-0d95-4fea-bc89-0277725f8590 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:20.097896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e874b6d7-0d95-4fea-bc89-0277725f8590 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:20.105717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e5afa456-fb4d-4c56-ba14-ad8992f11652 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:20.108194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e5afa456-fb4d-4c56-ba14-ad8992f11652 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:20.114585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5afa456-fb4d-4c56-ba14-ad8992f11652 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:20.115083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5afa456-fb4d-4c56-ba14-ad8992f11652 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:20.115513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5afa456-fb4d-4c56-ba14-ad8992f11652 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:20.116188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5afa456-fb4d-4c56-ba14-ad8992f11652 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:20.116633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5afa456-fb4d-4c56-ba14-ad8992f11652 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:20.117043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5afa456-fb4d-4c56-ba14-ad8992f11652 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:20.131491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e874b6d7-0d95-4fea-bc89-0277725f8590 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048973 Aug 31 00:39:20.132042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 597/1121] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:20.151133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e5afa456-fb4d-4c56-ba14-ad8992f11652 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049994 Aug 31 00:39:20.151620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 525/1122] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:20.957066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e45a69df-7615-49a4-9887-542ae40f7910 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:20.959229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e45a69df-7615-49a4-9887-542ae40f7910 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:20.965322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e45a69df-7615-49a4-9887-542ae40f7910 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:20.965805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e45a69df-7615-49a4-9887-542ae40f7910 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:20.966233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e45a69df-7615-49a4-9887-542ae40f7910 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:20.966917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e45a69df-7615-49a4-9887-542ae40f7910 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:20.967402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e45a69df-7615-49a4-9887-542ae40f7910 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:20.967823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e45a69df-7615-49a4-9887-542ae40f7910 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:21.000738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e45a69df-7615-49a4-9887-542ae40f7910 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047763 Aug 31 00:39:21.001335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 598/1123] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:20 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:21.144308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9c96013b-91a8-405a-8859-9ebf40ea4cde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:21.146525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9c96013b-91a8-405a-8859-9ebf40ea4cde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:21.152946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c96013b-91a8-405a-8859-9ebf40ea4cde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:21.153423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c96013b-91a8-405a-8859-9ebf40ea4cde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:21.153851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c96013b-91a8-405a-8859-9ebf40ea4cde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:21.154528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c96013b-91a8-405a-8859-9ebf40ea4cde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:21.154987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c96013b-91a8-405a-8859-9ebf40ea4cde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:21.155424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c96013b-91a8-405a-8859-9ebf40ea4cde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:21.163382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-37fd8ea7-e2c2-4626-85f7-9dfe2a7fd784 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:21.166221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-37fd8ea7-e2c2-4626-85f7-9dfe2a7fd784 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:21.172271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37fd8ea7-e2c2-4626-85f7-9dfe2a7fd784 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:21.172754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37fd8ea7-e2c2-4626-85f7-9dfe2a7fd784 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:21.173193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37fd8ea7-e2c2-4626-85f7-9dfe2a7fd784 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:21.173887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37fd8ea7-e2c2-4626-85f7-9dfe2a7fd784 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:21.174341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37fd8ea7-e2c2-4626-85f7-9dfe2a7fd784 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:21.174760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37fd8ea7-e2c2-4626-85f7-9dfe2a7fd784 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:21.186530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9c96013b-91a8-405a-8859-9ebf40ea4cde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046043 Aug 31 00:39:21.187118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 526/1124] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:21.205106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-37fd8ea7-e2c2-4626-85f7-9dfe2a7fd784 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045601 Aug 31 00:39:21.205787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 599/1125] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:21 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:22.013916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-26ba5d8e-7e39-42fc-8103-56b76672d9c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:22.016107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-26ba5d8e-7e39-42fc-8103-56b76672d9c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:22.022484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26ba5d8e-7e39-42fc-8103-56b76672d9c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:22.022792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26ba5d8e-7e39-42fc-8103-56b76672d9c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:22.023264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26ba5d8e-7e39-42fc-8103-56b76672d9c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:22.024042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26ba5d8e-7e39-42fc-8103-56b76672d9c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:22.024806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26ba5d8e-7e39-42fc-8103-56b76672d9c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:22.025238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-26ba5d8e-7e39-42fc-8103-56b76672d9c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:22.056511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-26ba5d8e-7e39-42fc-8103-56b76672d9c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046287 Aug 31 00:39:22.057079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 527/1126] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:22 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:22.199541 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2f6599ad-3f60-4a62-a323-3ea483299617 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:22.201697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2f6599ad-3f60-4a62-a323-3ea483299617 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:22.208069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f6599ad-3f60-4a62-a323-3ea483299617 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:22.208542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f6599ad-3f60-4a62-a323-3ea483299617 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:22.208963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f6599ad-3f60-4a62-a323-3ea483299617 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:22.209641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f6599ad-3f60-4a62-a323-3ea483299617 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:22.210082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f6599ad-3f60-4a62-a323-3ea483299617 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:22.210492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f6599ad-3f60-4a62-a323-3ea483299617 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:22.217683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-36d944b1-65a7-4c34-9711-5512f22165b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:22.220056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-36d944b1-65a7-4c34-9711-5512f22165b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:22.226673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36d944b1-65a7-4c34-9711-5512f22165b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:22.227273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36d944b1-65a7-4c34-9711-5512f22165b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:22.227721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36d944b1-65a7-4c34-9711-5512f22165b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:22.228481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36d944b1-65a7-4c34-9711-5512f22165b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:22.228931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36d944b1-65a7-4c34-9711-5512f22165b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:22.229348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36d944b1-65a7-4c34-9711-5512f22165b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:22.242107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2f6599ad-3f60-4a62-a323-3ea483299617 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047230 Aug 31 00:39:22.243218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 600/1127] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:22.260524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-36d944b1-65a7-4c34-9711-5512f22165b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046658 Aug 31 00:39:22.261004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 528/1128] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:22 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:23.069020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-062003a7-a220-4c11-a3d4-40557f334f17 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:23.071840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-062003a7-a220-4c11-a3d4-40557f334f17 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:23.077880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-062003a7-a220-4c11-a3d4-40557f334f17 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:23.078361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-062003a7-a220-4c11-a3d4-40557f334f17 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:23.078793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-062003a7-a220-4c11-a3d4-40557f334f17 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:23.079529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-062003a7-a220-4c11-a3d4-40557f334f17 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:23.079976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-062003a7-a220-4c11-a3d4-40557f334f17 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:23.080398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-062003a7-a220-4c11-a3d4-40557f334f17 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:23.110966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-062003a7-a220-4c11-a3d4-40557f334f17 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Aug 31 00:39:23.111562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 601/1129] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:23 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:23.254078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ec07b631-298d-441e-82ed-1dbb9e784757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:23.256243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ec07b631-298d-441e-82ed-1dbb9e784757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:23.259331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=88 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:23.264672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec07b631-298d-441e-82ed-1dbb9e784757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:23.265155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec07b631-298d-441e-82ed-1dbb9e784757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:23.265585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec07b631-298d-441e-82ed-1dbb9e784757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:23.266313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec07b631-298d-441e-82ed-1dbb9e784757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:23.266789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec07b631-298d-441e-82ed-1dbb9e784757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:23.267311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec07b631-298d-441e-82ed-1dbb9e784757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:23.272720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0951abe8-f4eb-4991-b25a-8b9bdd35d966 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:23.274871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0951abe8-f4eb-4991-b25a-8b9bdd35d966 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:23.281293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-f4eb-4991-b25a-8b9bdd35d966 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:23.281773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-f4eb-4991-b25a-8b9bdd35d966 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:23.282203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-f4eb-4991-b25a-8b9bdd35d966 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:23.282882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-f4eb-4991-b25a-8b9bdd35d966 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:23.283429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-f4eb-4991-b25a-8b9bdd35d966 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:23.283847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0951abe8-f4eb-4991-b25a-8b9bdd35d966 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:23.301336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ec07b631-298d-441e-82ed-1dbb9e784757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050987 Aug 31 00:39:23.302217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 529/1130] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:23.302410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:23.316959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0951abe8-f4eb-4991-b25a-8b9bdd35d966 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048169 Aug 31 00:39:23.317510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 602/1131] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:24.123593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5baeeb9e-be56-4336-b9f0-8b25efb4a722 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:24.125767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5baeeb9e-be56-4336-b9f0-8b25efb4a722 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:24.131716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5baeeb9e-be56-4336-b9f0-8b25efb4a722 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:24.132192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5baeeb9e-be56-4336-b9f0-8b25efb4a722 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:24.132627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5baeeb9e-be56-4336-b9f0-8b25efb4a722 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:24.133864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5baeeb9e-be56-4336-b9f0-8b25efb4a722 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:24.134590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5baeeb9e-be56-4336-b9f0-8b25efb4a722 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:24.135024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5baeeb9e-be56-4336-b9f0-8b25efb4a722 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:24.166158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5baeeb9e-be56-4336-b9f0-8b25efb4a722 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046281 Aug 31 00:39:24.168125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 530/1132] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:24 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:24.316907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-23a12852-e956-44cf-a62d-89df790389dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:24.318958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-23a12852-e956-44cf-a62d-89df790389dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:24.326184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23a12852-e956-44cf-a62d-89df790389dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:24.326666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23a12852-e956-44cf-a62d-89df790389dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:24.327126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23a12852-e956-44cf-a62d-89df790389dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:24.327820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23a12852-e956-44cf-a62d-89df790389dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:24.328272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23a12852-e956-44cf-a62d-89df790389dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:24.328693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23a12852-e956-44cf-a62d-89df790389dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:24.329151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-284b3302-2499-4a67-b8ca-aaa1ea7ed934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:24.331292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-284b3302-2499-4a67-b8ca-aaa1ea7ed934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:24.337687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-284b3302-2499-4a67-b8ca-aaa1ea7ed934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:24.338166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-284b3302-2499-4a67-b8ca-aaa1ea7ed934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:24.338604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-284b3302-2499-4a67-b8ca-aaa1ea7ed934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:24.339316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-284b3302-2499-4a67-b8ca-aaa1ea7ed934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:24.339770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-284b3302-2499-4a67-b8ca-aaa1ea7ed934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:24.340188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-284b3302-2499-4a67-b8ca-aaa1ea7ed934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:24.358859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-23a12852-e956-44cf-a62d-89df790389dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046009 Aug 31 00:39:24.359454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 603/1133] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:24.370194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-284b3302-2499-4a67-b8ca-aaa1ea7ed934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Aug 31 00:39:24.370767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 531/1134] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:25.179745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2b54414a-3fa0-4a4c-9a7e-3962fea82c1f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:25.181995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2b54414a-3fa0-4a4c-9a7e-3962fea82c1f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:25.188005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b54414a-3fa0-4a4c-9a7e-3962fea82c1f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:25.188482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b54414a-3fa0-4a4c-9a7e-3962fea82c1f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:25.188914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b54414a-3fa0-4a4c-9a7e-3962fea82c1f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:25.189616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b54414a-3fa0-4a4c-9a7e-3962fea82c1f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:25.190067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b54414a-3fa0-4a4c-9a7e-3962fea82c1f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:25.190483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b54414a-3fa0-4a4c-9a7e-3962fea82c1f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:25.222589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2b54414a-3fa0-4a4c-9a7e-3962fea82c1f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046837 Aug 31 00:39:25.223170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 604/1135] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:25 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:25.371422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9486150c-967e-4a91-a01e-e7b062f51b35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:25.373521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9486150c-967e-4a91-a01e-e7b062f51b35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:25.379868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9486150c-967e-4a91-a01e-e7b062f51b35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:25.380341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9486150c-967e-4a91-a01e-e7b062f51b35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:25.380767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9486150c-967e-4a91-a01e-e7b062f51b35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:25.381445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9486150c-967e-4a91-a01e-e7b062f51b35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:25.381710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-73da5e79-c874-419b-acba-0bfbfedd12f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:25.382149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9486150c-967e-4a91-a01e-e7b062f51b35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:25.382267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9486150c-967e-4a91-a01e-e7b062f51b35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:25.384400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-73da5e79-c874-419b-acba-0bfbfedd12f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:25.386560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:25.390864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73da5e79-c874-419b-acba-0bfbfedd12f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:25.391378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73da5e79-c874-419b-acba-0bfbfedd12f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:25.391813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73da5e79-c874-419b-acba-0bfbfedd12f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:25.392503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73da5e79-c874-419b-acba-0bfbfedd12f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:25.392949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73da5e79-c874-419b-acba-0bfbfedd12f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:25.393366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73da5e79-c874-419b-acba-0bfbfedd12f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:25.412563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9486150c-967e-4a91-a01e-e7b062f51b35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045161 Aug 31 00:39:25.413203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 532/1136] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:25.424708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-73da5e79-c874-419b-acba-0bfbfedd12f7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046921 Aug 31 00:39:25.425259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 605/1137] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:26.236270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0269443b-e1a0-4d8c-a1eb-db5a1f2e38e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:26.238395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0269443b-e1a0-4d8c-a1eb-db5a1f2e38e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:26.245194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0269443b-e1a0-4d8c-a1eb-db5a1f2e38e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:26.245724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0269443b-e1a0-4d8c-a1eb-db5a1f2e38e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:26.246096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0269443b-e1a0-4d8c-a1eb-db5a1f2e38e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:26.246772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0269443b-e1a0-4d8c-a1eb-db5a1f2e38e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:26.247250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0269443b-e1a0-4d8c-a1eb-db5a1f2e38e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:26.247669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0269443b-e1a0-4d8c-a1eb-db5a1f2e38e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:26.278308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0269443b-e1a0-4d8c-a1eb-db5a1f2e38e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046213 Aug 31 00:39:26.278876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 533/1138] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:26 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:26.425514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-84b37ec5-aa47-4f54-9d96-5cef2c8b90bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:26.427674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-84b37ec5-aa47-4f54-9d96-5cef2c8b90bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:26.429964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=88 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:26.436073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b37ec5-aa47-4f54-9d96-5cef2c8b90bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:26.436557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b37ec5-aa47-4f54-9d96-5cef2c8b90bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:26.436986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b37ec5-aa47-4f54-9d96-5cef2c8b90bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:26.437676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b37ec5-aa47-4f54-9d96-5cef2c8b90bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:26.437776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3e4cadcf-0902-4dad-a7e7-11e278fef942 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:26.438200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b37ec5-aa47-4f54-9d96-5cef2c8b90bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:26.438528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84b37ec5-aa47-4f54-9d96-5cef2c8b90bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:26.439792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3e4cadcf-0902-4dad-a7e7-11e278fef942 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:26.446140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e4cadcf-0902-4dad-a7e7-11e278fef942 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:26.446690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e4cadcf-0902-4dad-a7e7-11e278fef942 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:26.447146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e4cadcf-0902-4dad-a7e7-11e278fef942 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:26.447828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e4cadcf-0902-4dad-a7e7-11e278fef942 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:26.448273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e4cadcf-0902-4dad-a7e7-11e278fef942 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:26.448749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e4cadcf-0902-4dad-a7e7-11e278fef942 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:26.469065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-84b37ec5-aa47-4f54-9d96-5cef2c8b90bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047556 Aug 31 00:39:26.469627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 606/1139] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:26.479244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3e4cadcf-0902-4dad-a7e7-11e278fef942 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Aug 31 00:39:26.479803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 534/1140] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:26 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:27.290865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7451a6b0-b76b-4d8f-986f-224bf441ff0f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:27.292975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7451a6b0-b76b-4d8f-986f-224bf441ff0f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:27.298935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7451a6b0-b76b-4d8f-986f-224bf441ff0f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:27.299448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7451a6b0-b76b-4d8f-986f-224bf441ff0f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:27.299888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7451a6b0-b76b-4d8f-986f-224bf441ff0f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:27.300572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7451a6b0-b76b-4d8f-986f-224bf441ff0f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:27.301020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7451a6b0-b76b-4d8f-986f-224bf441ff0f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:27.301438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7451a6b0-b76b-4d8f-986f-224bf441ff0f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:27.331978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7451a6b0-b76b-4d8f-986f-224bf441ff0f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045124 Aug 31 00:39:27.332543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 607/1141] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:27 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:27.481533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-01143fe4-c03d-4458-92a4-00171e914eef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:27.483955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-01143fe4-c03d-4458-92a4-00171e914eef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:27.490589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01143fe4-c03d-4458-92a4-00171e914eef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:27.490898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fb5b2c85-327a-429b-8f84-0e3e8d7cc682 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:27.491359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01143fe4-c03d-4458-92a4-00171e914eef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:27.491537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01143fe4-c03d-4458-92a4-00171e914eef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:27.492228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01143fe4-c03d-4458-92a4-00171e914eef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:27.492678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01143fe4-c03d-4458-92a4-00171e914eef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:27.493577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fb5b2c85-327a-429b-8f84-0e3e8d7cc682 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:27.493933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01143fe4-c03d-4458-92a4-00171e914eef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:27.501570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb5b2c85-327a-429b-8f84-0e3e8d7cc682 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:27.502052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb5b2c85-327a-429b-8f84-0e3e8d7cc682 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:27.502478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb5b2c85-327a-429b-8f84-0e3e8d7cc682 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:27.503198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb5b2c85-327a-429b-8f84-0e3e8d7cc682 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:27.503649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb5b2c85-327a-429b-8f84-0e3e8d7cc682 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:27.504062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb5b2c85-327a-429b-8f84-0e3e8d7cc682 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:27.524732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-01143fe4-c03d-4458-92a4-00171e914eef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047248 Aug 31 00:39:27.525287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 535/1142] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:27.534619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fb5b2c85-327a-429b-8f84-0e3e8d7cc682 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047573 Aug 31 00:39:27.535197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 608/1143] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:27 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:28.344387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1fb901c0-1e05-42c9-ae9f-a1a06b342f29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:28.346547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1fb901c0-1e05-42c9-ae9f-a1a06b342f29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:28.353059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fb901c0-1e05-42c9-ae9f-a1a06b342f29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:28.353773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fb901c0-1e05-42c9-ae9f-a1a06b342f29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:28.354209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fb901c0-1e05-42c9-ae9f-a1a06b342f29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:28.354902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fb901c0-1e05-42c9-ae9f-a1a06b342f29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:28.355394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fb901c0-1e05-42c9-ae9f-a1a06b342f29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:28.355820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fb901c0-1e05-42c9-ae9f-a1a06b342f29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:28.386716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1fb901c0-1e05-42c9-ae9f-a1a06b342f29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046248 Aug 31 00:39:28.387323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 536/1144] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:28 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:28.536431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f3896b45-67ae-4e6f-95f2-6ce77c3e6132 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:28.538680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f3896b45-67ae-4e6f-95f2-6ce77c3e6132 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:28.545350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3896b45-67ae-4e6f-95f2-6ce77c3e6132 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:28.545836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3896b45-67ae-4e6f-95f2-6ce77c3e6132 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:28.546270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3896b45-67ae-4e6f-95f2-6ce77c3e6132 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:28.546587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b0a77cde-c8ca-448e-91f6-618424ee597d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:28.547127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3896b45-67ae-4e6f-95f2-6ce77c3e6132 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:28.547618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3896b45-67ae-4e6f-95f2-6ce77c3e6132 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:28.548042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3896b45-67ae-4e6f-95f2-6ce77c3e6132 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:28.548749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b0a77cde-c8ca-448e-91f6-618424ee597d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:28.554971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a77cde-c8ca-448e-91f6-618424ee597d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:28.555507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a77cde-c8ca-448e-91f6-618424ee597d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:28.555967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a77cde-c8ca-448e-91f6-618424ee597d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:28.556642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a77cde-c8ca-448e-91f6-618424ee597d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:28.557082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a77cde-c8ca-448e-91f6-618424ee597d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:28.557493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a77cde-c8ca-448e-91f6-618424ee597d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:28.578878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f3896b45-67ae-4e6f-95f2-6ce77c3e6132 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046455 Aug 31 00:39:28.579481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 609/1145] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:28.589456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b0a77cde-c8ca-448e-91f6-618424ee597d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046659 Aug 31 00:39:28.590043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 537/1146] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:29.399027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-560bdc99-69c5-4926-a230-b57efa4b1713 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:29.401467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-560bdc99-69c5-4926-a230-b57efa4b1713 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:29.407457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560bdc99-69c5-4926-a230-b57efa4b1713 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.407942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560bdc99-69c5-4926-a230-b57efa4b1713 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.408380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560bdc99-69c5-4926-a230-b57efa4b1713 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:29.409065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560bdc99-69c5-4926-a230-b57efa4b1713 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.409520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560bdc99-69c5-4926-a230-b57efa4b1713 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.409943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560bdc99-69c5-4926-a230-b57efa4b1713 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:29.442143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-560bdc99-69c5-4926-a230-b57efa4b1713 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047027 Aug 31 00:39:29.442710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 610/1147] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:29 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:29.591855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c5288aef-e5e5-409e-bd1b-c6fb124c03b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:29.593945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c5288aef-e5e5-409e-bd1b-c6fb124c03b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:29.600344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5288aef-e5e5-409e-bd1b-c6fb124c03b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.601414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5288aef-e5e5-409e-bd1b-c6fb124c03b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.601552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-327c2c0b-1e0a-4369-864e-d71438f9f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:29.601977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5288aef-e5e5-409e-bd1b-c6fb124c03b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:29.603614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5288aef-e5e5-409e-bd1b-c6fb124c03b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.604063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5288aef-e5e5-409e-bd1b-c6fb124c03b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.604406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-327c2c0b-1e0a-4369-864e-d71438f9f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:29.604666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5288aef-e5e5-409e-bd1b-c6fb124c03b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:29.611373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-327c2c0b-1e0a-4369-864e-d71438f9f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.611857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-327c2c0b-1e0a-4369-864e-d71438f9f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.612293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-327c2c0b-1e0a-4369-864e-d71438f9f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:29.612987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-327c2c0b-1e0a-4369-864e-d71438f9f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.613443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-327c2c0b-1e0a-4369-864e-d71438f9f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.613866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-327c2c0b-1e0a-4369-864e-d71438f9f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:29.634585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c5288aef-e5e5-409e-bd1b-c6fb124c03b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046567 Aug 31 00:39:29.635360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 538/1148] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:29.644453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-327c2c0b-1e0a-4369-864e-d71438f9f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046742 Aug 31 00:39:29.645359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 611/1149] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:30.453978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-197c9d66-483f-4675-8292-e02e04cca2af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:30.456120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-197c9d66-483f-4675-8292-e02e04cca2af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:30.462282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197c9d66-483f-4675-8292-e02e04cca2af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:30.462754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197c9d66-483f-4675-8292-e02e04cca2af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:30.463216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197c9d66-483f-4675-8292-e02e04cca2af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:30.463905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197c9d66-483f-4675-8292-e02e04cca2af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:30.464356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197c9d66-483f-4675-8292-e02e04cca2af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:30.464774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-197c9d66-483f-4675-8292-e02e04cca2af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:30.496686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-197c9d66-483f-4675-8292-e02e04cca2af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046610 Aug 31 00:39:30.497252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 539/1150] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:30 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:30.647064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d71688eb-d1b1-4944-9576-5c8dfd0b75b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:30.649338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d71688eb-d1b1-4944-9576-5c8dfd0b75b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:30.655844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d71688eb-d1b1-4944-9576-5c8dfd0b75b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:30.656321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d71688eb-d1b1-4944-9576-5c8dfd0b75b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:30.656749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d71688eb-d1b1-4944-9576-5c8dfd0b75b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:30.656852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ea5af277-3b8f-43b2-975e-f5d79c0ed13a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:30.657477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d71688eb-d1b1-4944-9576-5c8dfd0b75b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:30.657922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d71688eb-d1b1-4944-9576-5c8dfd0b75b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:30.658337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d71688eb-d1b1-4944-9576-5c8dfd0b75b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:30.658837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ea5af277-3b8f-43b2-975e-f5d79c0ed13a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:30.665799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea5af277-3b8f-43b2-975e-f5d79c0ed13a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:30.666427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea5af277-3b8f-43b2-975e-f5d79c0ed13a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:30.666855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea5af277-3b8f-43b2-975e-f5d79c0ed13a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:30.667567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea5af277-3b8f-43b2-975e-f5d79c0ed13a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:30.668009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea5af277-3b8f-43b2-975e-f5d79c0ed13a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:30.668423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea5af277-3b8f-43b2-975e-f5d79c0ed13a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:30.690097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d71688eb-d1b1-4944-9576-5c8dfd0b75b7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047035 Aug 31 00:39:30.690656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 612/1151] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:30.699220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ea5af277-3b8f-43b2-975e-f5d79c0ed13a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046390 Aug 31 00:39:30.699766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 540/1152] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:31.509629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-053ad8b9-6c98-4cbe-b169-f35a677267b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:31.511686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-053ad8b9-6c98-4cbe-b169-f35a677267b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:31.517654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-053ad8b9-6c98-4cbe-b169-f35a677267b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:31.518134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-053ad8b9-6c98-4cbe-b169-f35a677267b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:31.518561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-053ad8b9-6c98-4cbe-b169-f35a677267b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:31.519273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-053ad8b9-6c98-4cbe-b169-f35a677267b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:31.519720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-053ad8b9-6c98-4cbe-b169-f35a677267b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:31.520138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-053ad8b9-6c98-4cbe-b169-f35a677267b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:31.549527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-053ad8b9-6c98-4cbe-b169-f35a677267b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Aug 31 00:39:31.550082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 613/1153] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:31 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:31.703144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e477df3b-cae4-4abb-bd0d-99308e18f3f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:31.705292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e477df3b-cae4-4abb-bd0d-99308e18f3f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:31.711016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0d7aca13-44fe-4ac2-bd8f-3a41d5958b77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:31.712386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e477df3b-cae4-4abb-bd0d-99308e18f3f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:31.713158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e477df3b-cae4-4abb-bd0d-99308e18f3f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:31.713597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e477df3b-cae4-4abb-bd0d-99308e18f3f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:31.713872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0d7aca13-44fe-4ac2-bd8f-3a41d5958b77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:31.714292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e477df3b-cae4-4abb-bd0d-99308e18f3f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:31.714743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e477df3b-cae4-4abb-bd0d-99308e18f3f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:31.715192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e477df3b-cae4-4abb-bd0d-99308e18f3f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:31.720570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d7aca13-44fe-4ac2-bd8f-3a41d5958b77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:31.721051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d7aca13-44fe-4ac2-bd8f-3a41d5958b77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:31.721486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d7aca13-44fe-4ac2-bd8f-3a41d5958b77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:31.722179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d7aca13-44fe-4ac2-bd8f-3a41d5958b77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:31.722631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d7aca13-44fe-4ac2-bd8f-3a41d5958b77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:31.723115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0d7aca13-44fe-4ac2-bd8f-3a41d5958b77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:31.745776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e477df3b-cae4-4abb-bd0d-99308e18f3f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046604 Aug 31 00:39:31.746348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 541/1154] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:31.753693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0d7aca13-44fe-4ac2-bd8f-3a41d5958b77 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046532 Aug 31 00:39:31.754244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 614/1155] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:32.561731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-452ec9a5-65f7-451d-8c7b-1db71de0a637 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:32.563955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-452ec9a5-65f7-451d-8c7b-1db71de0a637 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:32.569891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-452ec9a5-65f7-451d-8c7b-1db71de0a637 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:32.570368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-452ec9a5-65f7-451d-8c7b-1db71de0a637 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:32.570802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-452ec9a5-65f7-451d-8c7b-1db71de0a637 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:32.571669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-452ec9a5-65f7-451d-8c7b-1db71de0a637 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:32.572242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-452ec9a5-65f7-451d-8c7b-1db71de0a637 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:32.572663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-452ec9a5-65f7-451d-8c7b-1db71de0a637 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:32.604637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-452ec9a5-65f7-451d-8c7b-1db71de0a637 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046755 Aug 31 00:39:32.605215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 542/1156] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:32 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:32.760078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a92ac445-47cb-4ea7-94dd-abb2fdad966d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:32.763349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a92ac445-47cb-4ea7-94dd-abb2fdad966d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:32.767369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-56b4901c-a7e3-4c51-8623-bb23a9904c44 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:32.769945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a92ac445-47cb-4ea7-94dd-abb2fdad966d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:32.770094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-56b4901c-a7e3-4c51-8623-bb23a9904c44 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:32.770428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a92ac445-47cb-4ea7-94dd-abb2fdad966d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:32.770866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a92ac445-47cb-4ea7-94dd-abb2fdad966d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:32.771623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a92ac445-47cb-4ea7-94dd-abb2fdad966d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:32.772078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a92ac445-47cb-4ea7-94dd-abb2fdad966d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:32.772502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a92ac445-47cb-4ea7-94dd-abb2fdad966d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:32.777191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56b4901c-a7e3-4c51-8623-bb23a9904c44 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:32.777672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56b4901c-a7e3-4c51-8623-bb23a9904c44 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:32.778138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56b4901c-a7e3-4c51-8623-bb23a9904c44 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:32.778824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56b4901c-a7e3-4c51-8623-bb23a9904c44 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:32.779297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56b4901c-a7e3-4c51-8623-bb23a9904c44 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:32.780077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56b4901c-a7e3-4c51-8623-bb23a9904c44 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:32.805015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a92ac445-47cb-4ea7-94dd-abb2fdad966d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050859 Aug 31 00:39:32.805725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 615/1157] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:32.810967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-56b4901c-a7e3-4c51-8623-bb23a9904c44 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049514 Aug 31 00:39:32.811549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 543/1158] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:33.618083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f8377b69-99de-416d-93bb-f973c6d3cabf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:33.620876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f8377b69-99de-416d-93bb-f973c6d3cabf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:33.626827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8377b69-99de-416d-93bb-f973c6d3cabf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:33.627333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8377b69-99de-416d-93bb-f973c6d3cabf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:33.627762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8377b69-99de-416d-93bb-f973c6d3cabf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:33.628444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8377b69-99de-416d-93bb-f973c6d3cabf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:33.628892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8377b69-99de-416d-93bb-f973c6d3cabf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:33.629310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8377b69-99de-416d-93bb-f973c6d3cabf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:33.658422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f8377b69-99de-416d-93bb-f973c6d3cabf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Aug 31 00:39:33.658968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 616/1159] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:33 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:33.817597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a7859e24-9da6-4083-9f8e-7dbbc8199865 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:33.819766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a7859e24-9da6-4083-9f8e-7dbbc8199865 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:33.823696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c06c2edc-29cd-449d-a11c-2ffdcbd0a484 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:33.825831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c06c2edc-29cd-449d-a11c-2ffdcbd0a484 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:33.826258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7859e24-9da6-4083-9f8e-7dbbc8199865 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:33.826735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7859e24-9da6-4083-9f8e-7dbbc8199865 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:33.827198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7859e24-9da6-4083-9f8e-7dbbc8199865 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:33.828066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7859e24-9da6-4083-9f8e-7dbbc8199865 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:33.828518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7859e24-9da6-4083-9f8e-7dbbc8199865 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:33.828969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7859e24-9da6-4083-9f8e-7dbbc8199865 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:33.832115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c06c2edc-29cd-449d-a11c-2ffdcbd0a484 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:33.832588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c06c2edc-29cd-449d-a11c-2ffdcbd0a484 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:33.833022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c06c2edc-29cd-449d-a11c-2ffdcbd0a484 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:33.833702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c06c2edc-29cd-449d-a11c-2ffdcbd0a484 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:33.834145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c06c2edc-29cd-449d-a11c-2ffdcbd0a484 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:33.834561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c06c2edc-29cd-449d-a11c-2ffdcbd0a484 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:33.859005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a7859e24-9da6-4083-9f8e-7dbbc8199865 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045426 Aug 31 00:39:33.859595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 544/1160] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:33 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:33.865681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c06c2edc-29cd-449d-a11c-2ffdcbd0a484 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Aug 31 00:39:33.866237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 617/1161] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:33 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:34.671122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7c8f7e3d-2ad8-4864-84e3-3b6815fb0542 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:34.673232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7c8f7e3d-2ad8-4864-84e3-3b6815fb0542 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:34.679344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c8f7e3d-2ad8-4864-84e3-3b6815fb0542 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:34.679819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c8f7e3d-2ad8-4864-84e3-3b6815fb0542 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:34.680276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c8f7e3d-2ad8-4864-84e3-3b6815fb0542 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:34.680954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c8f7e3d-2ad8-4864-84e3-3b6815fb0542 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:34.681391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c8f7e3d-2ad8-4864-84e3-3b6815fb0542 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:34.681801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c8f7e3d-2ad8-4864-84e3-3b6815fb0542 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:34.710875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7c8f7e3d-2ad8-4864-84e3-3b6815fb0542 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 Aug 31 00:39:34.711507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 545/1162] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:34.871570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b46c15e9-46c4-4a22-a037-4079de2cd370 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:34.874228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b46c15e9-46c4-4a22-a037-4079de2cd370 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:34.878398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-70ad0a15-5f80-40cf-814c-6c5f6d43bbca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:34.880527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-70ad0a15-5f80-40cf-814c-6c5f6d43bbca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:34.880712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b46c15e9-46c4-4a22-a037-4079de2cd370 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:34.881187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b46c15e9-46c4-4a22-a037-4079de2cd370 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:34.881618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b46c15e9-46c4-4a22-a037-4079de2cd370 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:34.882302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b46c15e9-46c4-4a22-a037-4079de2cd370 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:34.882743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b46c15e9-46c4-4a22-a037-4079de2cd370 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:34.883187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b46c15e9-46c4-4a22-a037-4079de2cd370 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:34.887262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70ad0a15-5f80-40cf-814c-6c5f6d43bbca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:34.887767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70ad0a15-5f80-40cf-814c-6c5f6d43bbca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:34.888188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70ad0a15-5f80-40cf-814c-6c5f6d43bbca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:34.888877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70ad0a15-5f80-40cf-814c-6c5f6d43bbca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:34.889328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70ad0a15-5f80-40cf-814c-6c5f6d43bbca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:34.890244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70ad0a15-5f80-40cf-814c-6c5f6d43bbca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:34.914119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b46c15e9-46c4-4a22-a037-4079de2cd370 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047370 Aug 31 00:39:34.914906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 618/1163] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:34.921611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-70ad0a15-5f80-40cf-814c-6c5f6d43bbca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047035 Aug 31 00:39:34.922120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 546/1164] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:34 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:35.724102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-79679f38-ed3a-494e-b6bd-af983c094f35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:35.726234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-79679f38-ed3a-494e-b6bd-af983c094f35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:35.733033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79679f38-ed3a-494e-b6bd-af983c094f35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.733512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79679f38-ed3a-494e-b6bd-af983c094f35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.733940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79679f38-ed3a-494e-b6bd-af983c094f35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.734629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79679f38-ed3a-494e-b6bd-af983c094f35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.735100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79679f38-ed3a-494e-b6bd-af983c094f35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.735521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79679f38-ed3a-494e-b6bd-af983c094f35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.739062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:35.765017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-79679f38-ed3a-494e-b6bd-af983c094f35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044858 Aug 31 00:39:35.765573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 619/1165] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:35 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:35.925800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5e6e3e58-a991-41d5-af03-06f64bf703d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:35.927929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5e6e3e58-a991-41d5-af03-06f64bf703d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:35.933616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c6247f34-a074-46ff-b6e9-8870e6669d21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:35.934395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6e3e58-a991-41d5-af03-06f64bf703d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.934872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6e3e58-a991-41d5-af03-06f64bf703d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.935335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6e3e58-a991-41d5-af03-06f64bf703d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.935867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c6247f34-a074-46ff-b6e9-8870e6669d21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:35.936022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6e3e58-a991-41d5-af03-06f64bf703d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.936466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6e3e58-a991-41d5-af03-06f64bf703d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.936879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6e3e58-a991-41d5-af03-06f64bf703d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.942131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6247f34-a074-46ff-b6e9-8870e6669d21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.942602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6247f34-a074-46ff-b6e9-8870e6669d21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.943057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6247f34-a074-46ff-b6e9-8870e6669d21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.943749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6247f34-a074-46ff-b6e9-8870e6669d21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.944198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6247f34-a074-46ff-b6e9-8870e6669d21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.944607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6247f34-a074-46ff-b6e9-8870e6669d21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.967676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5e6e3e58-a991-41d5-af03-06f64bf703d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045416 Aug 31 00:39:35.968434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 547/1166] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:35.975608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c6247f34-a074-46ff-b6e9-8870e6669d21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045769 Aug 31 00:39:35.976104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 620/1167] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:36.777482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f437200a-0f4d-4b29-848b-444918f0aac0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:36.779654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f437200a-0f4d-4b29-848b-444918f0aac0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:36.785679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f437200a-0f4d-4b29-848b-444918f0aac0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:36.786146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f437200a-0f4d-4b29-848b-444918f0aac0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:36.786568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f437200a-0f4d-4b29-848b-444918f0aac0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:36.787273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f437200a-0f4d-4b29-848b-444918f0aac0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:36.787718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f437200a-0f4d-4b29-848b-444918f0aac0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:36.788161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f437200a-0f4d-4b29-848b-444918f0aac0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:36.814362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:36.819403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f437200a-0f4d-4b29-848b-444918f0aac0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046016 Aug 31 00:39:36.819947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 548/1168] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:36 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:36.981246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-891a6178-c76a-4bc1-b5b4-72b6afd0078f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:36.983691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-891a6178-c76a-4bc1-b5b4-72b6afd0078f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:36.988106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e6812706-1a77-4636-95d5-aa6c839cd2e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:36.990167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-891a6178-c76a-4bc1-b5b4-72b6afd0078f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:36.990316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e6812706-1a77-4636-95d5-aa6c839cd2e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:36.990654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-891a6178-c76a-4bc1-b5b4-72b6afd0078f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:36.991113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-891a6178-c76a-4bc1-b5b4-72b6afd0078f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:36.991974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-891a6178-c76a-4bc1-b5b4-72b6afd0078f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:36.992260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-891a6178-c76a-4bc1-b5b4-72b6afd0078f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:36.992686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-891a6178-c76a-4bc1-b5b4-72b6afd0078f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:36.997339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6812706-1a77-4636-95d5-aa6c839cd2e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:36.997887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6812706-1a77-4636-95d5-aa6c839cd2e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:36.998324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6812706-1a77-4636-95d5-aa6c839cd2e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:36.999055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6812706-1a77-4636-95d5-aa6c839cd2e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:36.999511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6812706-1a77-4636-95d5-aa6c839cd2e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:36.999927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6812706-1a77-4636-95d5-aa6c839cd2e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:37.023014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-891a6178-c76a-4bc1-b5b4-72b6afd0078f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046785 Aug 31 00:39:37.023601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 621/1169] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:37.030083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e6812706-1a77-4636-95d5-aa6c839cd2e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045997 Aug 31 00:39:37.030572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 549/1170] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:37.831639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7156e152-2ba0-4e3d-9aaa-5f0373b8ceba tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:37.833764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7156e152-2ba0-4e3d-9aaa-5f0373b8ceba tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:37.840604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7156e152-2ba0-4e3d-9aaa-5f0373b8ceba tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:37.841082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7156e152-2ba0-4e3d-9aaa-5f0373b8ceba tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:37.841509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7156e152-2ba0-4e3d-9aaa-5f0373b8ceba tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:37.842195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7156e152-2ba0-4e3d-9aaa-5f0373b8ceba tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:37.842641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7156e152-2ba0-4e3d-9aaa-5f0373b8ceba tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:37.843079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7156e152-2ba0-4e3d-9aaa-5f0373b8ceba tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:37.873018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7156e152-2ba0-4e3d-9aaa-5f0373b8ceba tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045293 Aug 31 00:39:37.873574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 622/1171] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:37 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:38.036138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-43b100ab-1edf-4ab9-9d16-de943eb51f36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:38.038244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-43b100ab-1edf-4ab9-9d16-de943eb51f36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:38.043236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-764bfad8-6425-4b2e-9eb7-f303da65ea1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:38.045362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-764bfad8-6425-4b2e-9eb7-f303da65ea1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:38.048047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b100ab-1edf-4ab9-9d16-de943eb51f36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:38.048541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b100ab-1edf-4ab9-9d16-de943eb51f36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:38.048977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b100ab-1edf-4ab9-9d16-de943eb51f36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:38.049670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b100ab-1edf-4ab9-9d16-de943eb51f36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:38.050120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b100ab-1edf-4ab9-9d16-de943eb51f36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:38.050544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b100ab-1edf-4ab9-9d16-de943eb51f36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:38.051723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-764bfad8-6425-4b2e-9eb7-f303da65ea1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:38.052199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-764bfad8-6425-4b2e-9eb7-f303da65ea1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:38.052627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-764bfad8-6425-4b2e-9eb7-f303da65ea1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:38.053305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-764bfad8-6425-4b2e-9eb7-f303da65ea1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:38.053746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-764bfad8-6425-4b2e-9eb7-f303da65ea1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:38.054159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-764bfad8-6425-4b2e-9eb7-f303da65ea1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:38.081927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-43b100ab-1edf-4ab9-9d16-de943eb51f36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049666 Aug 31 00:39:38.082446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 550/1172] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:38.086749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-764bfad8-6425-4b2e-9eb7-f303da65ea1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046479 Aug 31 00:39:38.086749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 623/1173] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:38.886675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-79c470c9-c12d-418d-8216-40fb0bd4d2c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:38.888847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-79c470c9-c12d-418d-8216-40fb0bd4d2c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:38.894909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c470c9-c12d-418d-8216-40fb0bd4d2c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:38.895415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c470c9-c12d-418d-8216-40fb0bd4d2c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:38.895852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c470c9-c12d-418d-8216-40fb0bd4d2c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:38.896537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c470c9-c12d-418d-8216-40fb0bd4d2c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:38.897011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c470c9-c12d-418d-8216-40fb0bd4d2c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:38.897431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79c470c9-c12d-418d-8216-40fb0bd4d2c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:38.928279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-79c470c9-c12d-418d-8216-40fb0bd4d2c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046403 Aug 31 00:39:38.928830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 551/1174] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:38 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:39.093756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9cb7dc77-50cb-4a46-aec6-30d715477a16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:39.095907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9cb7dc77-50cb-4a46-aec6-30d715477a16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:39.097689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fa5f9668-ab76-40e5-bf83-481f36757aee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:39.098076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:39:39.098184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:39:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments (ip 10.222.0.67) !!! Aug 31 00:39:39.100273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fa5f9668-ab76-40e5-bf83-481f36757aee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:39.106405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cb7dc77-50cb-4a46-aec6-30d715477a16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.106887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cb7dc77-50cb-4a46-aec6-30d715477a16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.107610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cb7dc77-50cb-4a46-aec6-30d715477a16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.107875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5f9668-ab76-40e5-bf83-481f36757aee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.108305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cb7dc77-50cb-4a46-aec6-30d715477a16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.108426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5f9668-ab76-40e5-bf83-481f36757aee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.108749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cb7dc77-50cb-4a46-aec6-30d715477a16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.108856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5f9668-ab76-40e5-bf83-481f36757aee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.109161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cb7dc77-50cb-4a46-aec6-30d715477a16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.109468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5f9668-ab76-40e5-bf83-481f36757aee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.110517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5f9668-ab76-40e5-bf83-481f36757aee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.111198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa5f9668-ab76-40e5-bf83-481f36757aee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.141291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9cb7dc77-50cb-4a46-aec6-30d715477a16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051322 Aug 31 00:39:39.141766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 624/1175] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:39.141932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fa5f9668-ab76-40e5-bf83-481f36757aee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047940 Aug 31 00:39:39.142321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 552/1176] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:39 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:39.940202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8562d113-3be5-49af-a69c-39e7cb8a5bd0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:39.942341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8562d113-3be5-49af-a69c-39e7cb8a5bd0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:39.948683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8562d113-3be5-49af-a69c-39e7cb8a5bd0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.949161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8562d113-3be5-49af-a69c-39e7cb8a5bd0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.949593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8562d113-3be5-49af-a69c-39e7cb8a5bd0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.950270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8562d113-3be5-49af-a69c-39e7cb8a5bd0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.950718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8562d113-3be5-49af-a69c-39e7cb8a5bd0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.951194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8562d113-3be5-49af-a69c-39e7cb8a5bd0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.981603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8562d113-3be5-49af-a69c-39e7cb8a5bd0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045317 Aug 31 00:39:39.982596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 625/1177] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:39 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:40.154239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2215e96e-9128-4242-9e6a-44a521ad1eb7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:40.154905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-83052339-3ea3-4413-9596-061cc5d31585 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:40.156408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2215e96e-9128-4242-9e6a-44a521ad1eb7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:40.156553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-83052339-3ea3-4413-9596-061cc5d31585 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:40.162767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83052339-3ea3-4413-9596-061cc5d31585 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:40.162931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2215e96e-9128-4242-9e6a-44a521ad1eb7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:40.163281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83052339-3ea3-4413-9596-061cc5d31585 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:40.163412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2215e96e-9128-4242-9e6a-44a521ad1eb7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:40.163714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83052339-3ea3-4413-9596-061cc5d31585 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:40.163827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2215e96e-9128-4242-9e6a-44a521ad1eb7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:40.164473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83052339-3ea3-4413-9596-061cc5d31585 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:40.165169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2215e96e-9128-4242-9e6a-44a521ad1eb7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:40.165459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83052339-3ea3-4413-9596-061cc5d31585 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:40.165698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2215e96e-9128-4242-9e6a-44a521ad1eb7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:40.165885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83052339-3ea3-4413-9596-061cc5d31585 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:40.166593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2215e96e-9128-4242-9e6a-44a521ad1eb7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:40.195819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-83052339-3ea3-4413-9596-061cc5d31585 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Aug 31 00:39:40.196299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 553/1178] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:40.196482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2215e96e-9128-4242-9e6a-44a521ad1eb7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045941 Aug 31 00:39:40.197001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 626/1179] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:40.994635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3cc89ca7-4481-435a-a014-cf704738752b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:40.996818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3cc89ca7-4481-435a-a014-cf704738752b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:41.002769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3cc89ca7-4481-435a-a014-cf704738752b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:41.003292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3cc89ca7-4481-435a-a014-cf704738752b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:41.003726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3cc89ca7-4481-435a-a014-cf704738752b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:41.004435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3cc89ca7-4481-435a-a014-cf704738752b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:41.004884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3cc89ca7-4481-435a-a014-cf704738752b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:41.005304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3cc89ca7-4481-435a-a014-cf704738752b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:41.034589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3cc89ca7-4481-435a-a014-cf704738752b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Aug 31 00:39:41.035154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 554/1180] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:40 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:41.208463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d449503f-9684-45d3-a8b2-4a2f3ddcf75c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:41.209001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5e85280e-4657-4548-9f5b-f29bf39de43d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:41.210702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d449503f-9684-45d3-a8b2-4a2f3ddcf75c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:41.210959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5e85280e-4657-4548-9f5b-f29bf39de43d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:41.217579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e85280e-4657-4548-9f5b-f29bf39de43d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:41.217705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d449503f-9684-45d3-a8b2-4a2f3ddcf75c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:41.217900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e85280e-4657-4548-9f5b-f29bf39de43d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:41.218120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d449503f-9684-45d3-a8b2-4a2f3ddcf75c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:41.218303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e85280e-4657-4548-9f5b-f29bf39de43d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:41.218994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e85280e-4657-4548-9f5b-f29bf39de43d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:41.219141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d449503f-9684-45d3-a8b2-4a2f3ddcf75c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:41.219460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e85280e-4657-4548-9f5b-f29bf39de43d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:41.219864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d449503f-9684-45d3-a8b2-4a2f3ddcf75c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:41.219968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e85280e-4657-4548-9f5b-f29bf39de43d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:41.220326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d449503f-9684-45d3-a8b2-4a2f3ddcf75c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:41.220749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d449503f-9684-45d3-a8b2-4a2f3ddcf75c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:41.251841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5e85280e-4657-4548-9f5b-f29bf39de43d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046794 Aug 31 00:39:41.252067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d449503f-9684-45d3-a8b2-4a2f3ddcf75c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047258 Aug 31 00:39:41.252325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 627/1182] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:41 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:41.252438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 555/1182] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:42.046934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-51804c1f-30ee-4a7c-b3df-92e874eb8773 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:42.049061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-51804c1f-30ee-4a7c-b3df-92e874eb8773 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:42.055687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51804c1f-30ee-4a7c-b3df-92e874eb8773 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:42.056182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51804c1f-30ee-4a7c-b3df-92e874eb8773 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:42.056613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51804c1f-30ee-4a7c-b3df-92e874eb8773 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:42.057297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51804c1f-30ee-4a7c-b3df-92e874eb8773 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:42.057742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51804c1f-30ee-4a7c-b3df-92e874eb8773 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:42.058160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51804c1f-30ee-4a7c-b3df-92e874eb8773 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:42.086891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-51804c1f-30ee-4a7c-b3df-92e874eb8773 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Aug 31 00:39:42.087468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 556/1183] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:42 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:42.264129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4931dea3-87fa-423a-9f86-7e071b1767b8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:42.264785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c0f60ba5-3764-4a8c-ad3d-fbada7e95a8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:42.266199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4931dea3-87fa-423a-9f86-7e071b1767b8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:42.266344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c0f60ba5-3764-4a8c-ad3d-fbada7e95a8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:42.272532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4931dea3-87fa-423a-9f86-7e071b1767b8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:42.272696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0f60ba5-3764-4a8c-ad3d-fbada7e95a8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:42.273010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4931dea3-87fa-423a-9f86-7e071b1767b8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:42.273148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0f60ba5-3764-4a8c-ad3d-fbada7e95a8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:42.273437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4931dea3-87fa-423a-9f86-7e071b1767b8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:42.273571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0f60ba5-3764-4a8c-ad3d-fbada7e95a8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:42.274650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4931dea3-87fa-423a-9f86-7e071b1767b8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:42.274909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0f60ba5-3764-4a8c-ad3d-fbada7e95a8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:42.275225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4931dea3-87fa-423a-9f86-7e071b1767b8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:42.275650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4931dea3-87fa-423a-9f86-7e071b1767b8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:42.275759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0f60ba5-3764-4a8c-ad3d-fbada7e95a8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:42.276450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0f60ba5-3764-4a8c-ad3d-fbada7e95a8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:42.307825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c0f60ba5-3764-4a8c-ad3d-fbada7e95a8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Aug 31 00:39:42.308399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 628/1184] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:42 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:42.309736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4931dea3-87fa-423a-9f86-7e071b1767b8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049517 Aug 31 00:39:42.310289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 557/1185] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:43.099395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-780978cd-4360-4d1f-befb-ff256916b926 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:43.101543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-780978cd-4360-4d1f-befb-ff256916b926 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:43.107879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-780978cd-4360-4d1f-befb-ff256916b926 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:43.108355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-780978cd-4360-4d1f-befb-ff256916b926 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:43.108803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-780978cd-4360-4d1f-befb-ff256916b926 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:43.109479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-780978cd-4360-4d1f-befb-ff256916b926 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:43.109924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-780978cd-4360-4d1f-befb-ff256916b926 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:43.110341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-780978cd-4360-4d1f-befb-ff256916b926 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:43.140074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-780978cd-4360-4d1f-befb-ff256916b926 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Aug 31 00:39:43.140621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 629/1186] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:43 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:43.320003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-325cffeb-7332-4dd3-a187-e2a5b3341bc3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:43.322418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e0534098-e422-40c5-9100-a3f0203b47e1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:43.322834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-325cffeb-7332-4dd3-a187-e2a5b3341bc3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:43.324566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e0534098-e422-40c5-9100-a3f0203b47e1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:43.329158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-325cffeb-7332-4dd3-a187-e2a5b3341bc3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:43.329636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-325cffeb-7332-4dd3-a187-e2a5b3341bc3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:43.330066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-325cffeb-7332-4dd3-a187-e2a5b3341bc3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:43.330750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-325cffeb-7332-4dd3-a187-e2a5b3341bc3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:43.330855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0534098-e422-40c5-9100-a3f0203b47e1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:43.331232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-325cffeb-7332-4dd3-a187-e2a5b3341bc3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:43.331356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0534098-e422-40c5-9100-a3f0203b47e1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:43.331651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-325cffeb-7332-4dd3-a187-e2a5b3341bc3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:43.331780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0534098-e422-40c5-9100-a3f0203b47e1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:43.332429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0534098-e422-40c5-9100-a3f0203b47e1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:43.332875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0534098-e422-40c5-9100-a3f0203b47e1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:43.333298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e0534098-e422-40c5-9100-a3f0203b47e1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:43.362277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-325cffeb-7332-4dd3-a187-e2a5b3341bc3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046111 Aug 31 00:39:43.362846 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 558/1187] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:43.363078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e0534098-e422-40c5-9100-a3f0203b47e1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045305 Aug 31 00:39:43.363635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 630/1188] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:44.152976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-208b409d-8ad5-4d60-88a5-2ce43251acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:44.155103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-208b409d-8ad5-4d60-88a5-2ce43251acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:44.160996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-208b409d-8ad5-4d60-88a5-2ce43251acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:44.161468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-208b409d-8ad5-4d60-88a5-2ce43251acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:44.161893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-208b409d-8ad5-4d60-88a5-2ce43251acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:44.162565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-208b409d-8ad5-4d60-88a5-2ce43251acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:44.163009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-208b409d-8ad5-4d60-88a5-2ce43251acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:44.163450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-208b409d-8ad5-4d60-88a5-2ce43251acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:44.192525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-208b409d-8ad5-4d60-88a5-2ce43251acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044147 Aug 31 00:39:44.193077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 559/1189] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:44 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:44.374143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-abd984be-c2c7-4e1c-82fb-1f89f664aa92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:44.375166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9f24af93-d92a-45d9-a188-e51499cfc32a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:44.376433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-abd984be-c2c7-4e1c-82fb-1f89f664aa92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:44.377285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9f24af93-d92a-45d9-a188-e51499cfc32a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:44.383678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abd984be-c2c7-4e1c-82fb-1f89f664aa92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:44.384243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abd984be-c2c7-4e1c-82fb-1f89f664aa92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:44.384440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f24af93-d92a-45d9-a188-e51499cfc32a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:44.384668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abd984be-c2c7-4e1c-82fb-1f89f664aa92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:44.384785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f24af93-d92a-45d9-a188-e51499cfc32a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:44.385159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f24af93-d92a-45d9-a188-e51499cfc32a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:44.385367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abd984be-c2c7-4e1c-82fb-1f89f664aa92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:44.385844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f24af93-d92a-45d9-a188-e51499cfc32a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:44.385948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abd984be-c2c7-4e1c-82fb-1f89f664aa92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:44.386261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abd984be-c2c7-4e1c-82fb-1f89f664aa92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:44.386370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f24af93-d92a-45d9-a188-e51499cfc32a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:44.386691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f24af93-d92a-45d9-a188-e51499cfc32a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:44.418612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-abd984be-c2c7-4e1c-82fb-1f89f664aa92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048514 Aug 31 00:39:44.418844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9f24af93-d92a-45d9-a188-e51499cfc32a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047481 Aug 31 00:39:44.419208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 631/1190] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:44.423250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 560/1191] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:45.205171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5aba9084-8c38-44e6-800b-55f9b4f86c11 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:45.207321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5aba9084-8c38-44e6-800b-55f9b4f86c11 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:45.214024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5aba9084-8c38-44e6-800b-55f9b4f86c11 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:45.214495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5aba9084-8c38-44e6-800b-55f9b4f86c11 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:45.214914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5aba9084-8c38-44e6-800b-55f9b4f86c11 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:45.215615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5aba9084-8c38-44e6-800b-55f9b4f86c11 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:45.216060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5aba9084-8c38-44e6-800b-55f9b4f86c11 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:45.216475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5aba9084-8c38-44e6-800b-55f9b4f86c11 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:45.247120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5aba9084-8c38-44e6-800b-55f9b4f86c11 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045813 Aug 31 00:39:45.247596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 632/1192] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:45 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:45.431402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-209e5115-a82b-4b91-bcd2-f58ef7e00c66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:45.431952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-79b84e38-93ca-47eb-97a7-36bdd814254d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:45.433688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-209e5115-a82b-4b91-bcd2-f58ef7e00c66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:45.433854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-79b84e38-93ca-47eb-97a7-36bdd814254d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:45.440999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209e5115-a82b-4b91-bcd2-f58ef7e00c66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:45.441195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79b84e38-93ca-47eb-97a7-36bdd814254d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:45.441481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209e5115-a82b-4b91-bcd2-f58ef7e00c66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:45.441649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79b84e38-93ca-47eb-97a7-36bdd814254d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:45.441913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209e5115-a82b-4b91-bcd2-f58ef7e00c66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:45.442078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79b84e38-93ca-47eb-97a7-36bdd814254d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:45.442601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209e5115-a82b-4b91-bcd2-f58ef7e00c66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:45.442774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79b84e38-93ca-47eb-97a7-36bdd814254d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:45.443064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209e5115-a82b-4b91-bcd2-f58ef7e00c66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:45.443263 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79b84e38-93ca-47eb-97a7-36bdd814254d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:45.443496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209e5115-a82b-4b91-bcd2-f58ef7e00c66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:45.443688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79b84e38-93ca-47eb-97a7-36bdd814254d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:45.474910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-209e5115-a82b-4b91-bcd2-f58ef7e00c66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047894 Aug 31 00:39:45.475506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 561/1193] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:45.475716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-79b84e38-93ca-47eb-97a7-36bdd814254d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048740 Aug 31 00:39:45.477070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 633/1194] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:46.259434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9890a88c-5e05-44db-9325-e4b11a09ff5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:46.261430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9890a88c-5e05-44db-9325-e4b11a09ff5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:46.267294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9890a88c-5e05-44db-9325-e4b11a09ff5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:46.267764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9890a88c-5e05-44db-9325-e4b11a09ff5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:46.268187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9890a88c-5e05-44db-9325-e4b11a09ff5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:46.268853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9890a88c-5e05-44db-9325-e4b11a09ff5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:46.269292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9890a88c-5e05-44db-9325-e4b11a09ff5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:46.269703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9890a88c-5e05-44db-9325-e4b11a09ff5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:46.299783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9890a88c-5e05-44db-9325-e4b11a09ff5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Aug 31 00:39:46.300332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 562/1195] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:46 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:46.487494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ea47eb80-ee6e-4484-90ba-516440610b8f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:46.489391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fba2dc27-53e2-47f0-a2ca-40a384bc843f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:46.489964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ea47eb80-ee6e-4484-90ba-516440610b8f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:46.491565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fba2dc27-53e2-47f0-a2ca-40a384bc843f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:46.497091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea47eb80-ee6e-4484-90ba-516440610b8f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:46.497590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea47eb80-ee6e-4484-90ba-516440610b8f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:46.498026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea47eb80-ee6e-4484-90ba-516440610b8f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:46.498855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fba2dc27-53e2-47f0-a2ca-40a384bc843f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:46.499471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fba2dc27-53e2-47f0-a2ca-40a384bc843f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:46.499909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fba2dc27-53e2-47f0-a2ca-40a384bc843f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:46.500912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fba2dc27-53e2-47f0-a2ca-40a384bc843f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:46.501090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea47eb80-ee6e-4484-90ba-516440610b8f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:46.501486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fba2dc27-53e2-47f0-a2ca-40a384bc843f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:46.501910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fba2dc27-53e2-47f0-a2ca-40a384bc843f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:46.502218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea47eb80-ee6e-4484-90ba-516440610b8f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:46.502661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea47eb80-ee6e-4484-90ba-516440610b8f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:46.537728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fba2dc27-53e2-47f0-a2ca-40a384bc843f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052086 Aug 31 00:39:46.538317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ea47eb80-ee6e-4484-90ba-516440610b8f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054889 Aug 31 00:39:46.538562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 563/1196] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:46.538877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 634/1197] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:46 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:47.312434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bb5b0384-67cb-44a8-8ee9-f6f3e12fe853 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:47.314433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bb5b0384-67cb-44a8-8ee9-f6f3e12fe853 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:47.320500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b0384-67cb-44a8-8ee9-f6f3e12fe853 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:47.321092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b0384-67cb-44a8-8ee9-f6f3e12fe853 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:47.321431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b0384-67cb-44a8-8ee9-f6f3e12fe853 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:47.322110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b0384-67cb-44a8-8ee9-f6f3e12fe853 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:47.322558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b0384-67cb-44a8-8ee9-f6f3e12fe853 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:47.322975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b0384-67cb-44a8-8ee9-f6f3e12fe853 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:47.351526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bb5b0384-67cb-44a8-8ee9-f6f3e12fe853 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043109 Aug 31 00:39:47.352852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 564/1198] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:47 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:47.550440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-141ae43d-0130-4675-bfb6-07aba567f3e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:47.551027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c4bbdede-6b4f-4d7b-8bc4-c38fa256daae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:47.552584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c4bbdede-6b4f-4d7b-8bc4-c38fa256daae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:47.552689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-141ae43d-0130-4675-bfb6-07aba567f3e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:47.559244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4bbdede-6b4f-4d7b-8bc4-c38fa256daae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:47.559455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-141ae43d-0130-4675-bfb6-07aba567f3e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:47.559729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4bbdede-6b4f-4d7b-8bc4-c38fa256daae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:47.559939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-141ae43d-0130-4675-bfb6-07aba567f3e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:47.560164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4bbdede-6b4f-4d7b-8bc4-c38fa256daae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:47.560374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-141ae43d-0130-4675-bfb6-07aba567f3e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:47.560856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4bbdede-6b4f-4d7b-8bc4-c38fa256daae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:47.561063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-141ae43d-0130-4675-bfb6-07aba567f3e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:47.561306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4bbdede-6b4f-4d7b-8bc4-c38fa256daae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:47.561516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-141ae43d-0130-4675-bfb6-07aba567f3e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:47.561725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4bbdede-6b4f-4d7b-8bc4-c38fa256daae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:47.561939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-141ae43d-0130-4675-bfb6-07aba567f3e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:47.578586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:47.589282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:47.594212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c4bbdede-6b4f-4d7b-8bc4-c38fa256daae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047612 Aug 31 00:39:47.594669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-141ae43d-0130-4675-bfb6-07aba567f3e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048216 Aug 31 00:39:47.594782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 565/1199] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:47 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:47.595474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 635/1200] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:48.364183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7d6cc2eb-0ada-4974-96fe-188b6e60bc12 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:48.366318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7d6cc2eb-0ada-4974-96fe-188b6e60bc12 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:48.372950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d6cc2eb-0ada-4974-96fe-188b6e60bc12 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:48.373429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d6cc2eb-0ada-4974-96fe-188b6e60bc12 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:48.373859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d6cc2eb-0ada-4974-96fe-188b6e60bc12 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:48.374538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d6cc2eb-0ada-4974-96fe-188b6e60bc12 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:48.374985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d6cc2eb-0ada-4974-96fe-188b6e60bc12 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:48.375427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d6cc2eb-0ada-4974-96fe-188b6e60bc12 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:48.407813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7d6cc2eb-0ada-4974-96fe-188b6e60bc12 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047547 Aug 31 00:39:48.408788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 566/1201] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:48 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:48.606777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9f1cb1bb-b55a-4793-8e55-88718e0d11c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:48.607686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6f1d4632-f656-4fc4-89b0-aa156c6d5bd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:48.609177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9f1cb1bb-b55a-4793-8e55-88718e0d11c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:48.609933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6f1d4632-f656-4fc4-89b0-aa156c6d5bd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:48.615717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f1cb1bb-b55a-4793-8e55-88718e0d11c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:48.616133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f1cb1bb-b55a-4793-8e55-88718e0d11c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:48.616361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d4632-f656-4fc4-89b0-aa156c6d5bd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:48.616562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f1cb1bb-b55a-4793-8e55-88718e0d11c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:48.616836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d4632-f656-4fc4-89b0-aa156c6d5bd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:48.617299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d4632-f656-4fc4-89b0-aa156c6d5bd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:48.618047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f1cb1bb-b55a-4793-8e55-88718e0d11c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:48.618505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f1cb1bb-b55a-4793-8e55-88718e0d11c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:48.618629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d4632-f656-4fc4-89b0-aa156c6d5bd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:48.618928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f1cb1bb-b55a-4793-8e55-88718e0d11c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:48.619063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d4632-f656-4fc4-89b0-aa156c6d5bd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:48.619414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d4632-f656-4fc4-89b0-aa156c6d5bd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:48.648389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9f1cb1bb-b55a-4793-8e55-88718e0d11c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046381 Aug 31 00:39:48.648813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6f1d4632-f656-4fc4-89b0-aa156c6d5bd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045230 Aug 31 00:39:48.649827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 636/1202] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:48.649974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 567/1203] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:49.424809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7dccd9b2-fd38-450d-8416-28d743304c83 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:49.427325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7dccd9b2-fd38-450d-8416-28d743304c83 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:49.434264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7dccd9b2-fd38-450d-8416-28d743304c83 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.434747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7dccd9b2-fd38-450d-8416-28d743304c83 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.435225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7dccd9b2-fd38-450d-8416-28d743304c83 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.435921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7dccd9b2-fd38-450d-8416-28d743304c83 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.436372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7dccd9b2-fd38-450d-8416-28d743304c83 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.436793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7dccd9b2-fd38-450d-8416-28d743304c83 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.466391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7dccd9b2-fd38-450d-8416-28d743304c83 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Aug 31 00:39:49.466944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 637/1204] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:49 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:49.660679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8b275c33-7a07-4459-a8e0-414e5c175907 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:49.661321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-558af384-df57-4b99-b536-50781616ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:49.662867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8b275c33-7a07-4459-a8e0-414e5c175907 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:49.663001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-558af384-df57-4b99-b536-50781616ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:49.670011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-558af384-df57-4b99-b536-50781616ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.670197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b275c33-7a07-4459-a8e0-414e5c175907 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.670498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b275c33-7a07-4459-a8e0-414e5c175907 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.670610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-558af384-df57-4b99-b536-50781616ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.670926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b275c33-7a07-4459-a8e0-414e5c175907 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.671068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-558af384-df57-4b99-b536-50781616ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.671648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b275c33-7a07-4459-a8e0-414e5c175907 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.671749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-558af384-df57-4b99-b536-50781616ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.672098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b275c33-7a07-4459-a8e0-414e5c175907 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.672201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-558af384-df57-4b99-b536-50781616ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.672516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b275c33-7a07-4459-a8e0-414e5c175907 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.672620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-558af384-df57-4b99-b536-50781616ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.703345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8b275c33-7a07-4459-a8e0-414e5c175907 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046512 Aug 31 00:39:49.703666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-558af384-df57-4b99-b536-50781616ba8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046530 Aug 31 00:39:49.704018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 638/1206] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:49.704388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 568/1206] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:50.479074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-96916fe1-777a-4663-a3de-104394c385c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:50.481186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-96916fe1-777a-4663-a3de-104394c385c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:50.487396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96916fe1-777a-4663-a3de-104394c385c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:50.487875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96916fe1-777a-4663-a3de-104394c385c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:50.488308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96916fe1-777a-4663-a3de-104394c385c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:50.488977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96916fe1-777a-4663-a3de-104394c385c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:50.489416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96916fe1-777a-4663-a3de-104394c385c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:50.489828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96916fe1-777a-4663-a3de-104394c385c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:50.519364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-96916fe1-777a-4663-a3de-104394c385c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Aug 31 00:39:50.519896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 639/1207] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:50 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:50.716012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2708e005-634a-45e2-8ba4-9ab52be80248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:50.716576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6f734415-8391-4bcd-bc2d-7c7273ef52d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:50.718144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2708e005-634a-45e2-8ba4-9ab52be80248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:50.718396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6f734415-8391-4bcd-bc2d-7c7273ef52d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:50.724590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f734415-8391-4bcd-bc2d-7c7273ef52d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:50.724930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2708e005-634a-45e2-8ba4-9ab52be80248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:50.725057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f734415-8391-4bcd-bc2d-7c7273ef52d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:50.725178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2708e005-634a-45e2-8ba4-9ab52be80248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:50.725495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f734415-8391-4bcd-bc2d-7c7273ef52d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:50.725727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2708e005-634a-45e2-8ba4-9ab52be80248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:50.726188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f734415-8391-4bcd-bc2d-7c7273ef52d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:50.726408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2708e005-634a-45e2-8ba4-9ab52be80248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:50.726648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f734415-8391-4bcd-bc2d-7c7273ef52d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:50.726948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2708e005-634a-45e2-8ba4-9ab52be80248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:50.727383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f734415-8391-4bcd-bc2d-7c7273ef52d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:50.727500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2708e005-634a-45e2-8ba4-9ab52be80248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:50.758669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2708e005-634a-45e2-8ba4-9ab52be80248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045868 Aug 31 00:39:50.759293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6f734415-8391-4bcd-bc2d-7c7273ef52d4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047034 Aug 31 00:39:50.759585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 569/1208] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:50.759859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 640/1209] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:51.531883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-55485b55-e3a8-4ac1-b50a-e77c96c4b7ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:51.533913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-55485b55-e3a8-4ac1-b50a-e77c96c4b7ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:51.540865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55485b55-e3a8-4ac1-b50a-e77c96c4b7ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.541344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55485b55-e3a8-4ac1-b50a-e77c96c4b7ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.541778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55485b55-e3a8-4ac1-b50a-e77c96c4b7ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.542464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55485b55-e3a8-4ac1-b50a-e77c96c4b7ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.542914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55485b55-e3a8-4ac1-b50a-e77c96c4b7ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.543363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55485b55-e3a8-4ac1-b50a-e77c96c4b7ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.573343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-55485b55-e3a8-4ac1-b50a-e77c96c4b7ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045556 Aug 31 00:39:51.573895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 570/1210] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:51 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:51.771316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-41a09b06-1958-436f-bd42-86a63bdf5e50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:51.771869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-880076f6-4ad2-42a2-954c-43b4320316c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:51.773546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-41a09b06-1958-436f-bd42-86a63bdf5e50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:51.774244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-880076f6-4ad2-42a2-954c-43b4320316c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:51.780581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41a09b06-1958-436f-bd42-86a63bdf5e50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.780932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-880076f6-4ad2-42a2-954c-43b4320316c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.781058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41a09b06-1958-436f-bd42-86a63bdf5e50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.781429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-880076f6-4ad2-42a2-954c-43b4320316c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.781543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41a09b06-1958-436f-bd42-86a63bdf5e50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.781853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-880076f6-4ad2-42a2-954c-43b4320316c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.782235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41a09b06-1958-436f-bd42-86a63bdf5e50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.782534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-880076f6-4ad2-42a2-954c-43b4320316c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.782637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41a09b06-1958-436f-bd42-86a63bdf5e50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.782981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-880076f6-4ad2-42a2-954c-43b4320316c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.783114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41a09b06-1958-436f-bd42-86a63bdf5e50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.783422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-880076f6-4ad2-42a2-954c-43b4320316c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.813085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-41a09b06-1958-436f-bd42-86a63bdf5e50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045660 Aug 31 00:39:51.817537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-880076f6-4ad2-42a2-954c-43b4320316c0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046307 Aug 31 00:39:51.817692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 641/1211] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:51.817796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 571/1212] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:52.585493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1971a1fd-db7d-48dc-9f68-fb681ae27c86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:52.588069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1971a1fd-db7d-48dc-9f68-fb681ae27c86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:52.593993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1971a1fd-db7d-48dc-9f68-fb681ae27c86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.594470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1971a1fd-db7d-48dc-9f68-fb681ae27c86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.594899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1971a1fd-db7d-48dc-9f68-fb681ae27c86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.595613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1971a1fd-db7d-48dc-9f68-fb681ae27c86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.596064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1971a1fd-db7d-48dc-9f68-fb681ae27c86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.596480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1971a1fd-db7d-48dc-9f68-fb681ae27c86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.626594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1971a1fd-db7d-48dc-9f68-fb681ae27c86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Aug 31 00:39:52.627161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 642/1213] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:52 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:52.825339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-138078a4-6d43-40ce-9107-98c106c8d9d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:52.827159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-77faa72d-abdc-4e98-86df-eb3a5f9f6745 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:52.827557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-138078a4-6d43-40ce-9107-98c106c8d9d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:52.829448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-77faa72d-abdc-4e98-86df-eb3a5f9f6745 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:52.833887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-138078a4-6d43-40ce-9107-98c106c8d9d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.834631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-138078a4-6d43-40ce-9107-98c106c8d9d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.834807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-138078a4-6d43-40ce-9107-98c106c8d9d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.835534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-138078a4-6d43-40ce-9107-98c106c8d9d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.836531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-138078a4-6d43-40ce-9107-98c106c8d9d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.836701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77faa72d-abdc-4e98-86df-eb3a5f9f6745 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.836958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-138078a4-6d43-40ce-9107-98c106c8d9d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.837473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77faa72d-abdc-4e98-86df-eb3a5f9f6745 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.837966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77faa72d-abdc-4e98-86df-eb3a5f9f6745 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.838668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77faa72d-abdc-4e98-86df-eb3a5f9f6745 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.839156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77faa72d-abdc-4e98-86df-eb3a5f9f6745 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.839584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77faa72d-abdc-4e98-86df-eb3a5f9f6745 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.868258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-138078a4-6d43-40ce-9107-98c106c8d9d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046772 Aug 31 00:39:52.868823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 572/1214] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:52.870754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-77faa72d-abdc-4e98-86df-eb3a5f9f6745 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048584 Aug 31 00:39:52.871603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 643/1215] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:53.639882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d9140bf-e4c9-4131-b6a2-d363bd7f7ae5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:53.642042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0d9140bf-e4c9-4131-b6a2-d363bd7f7ae5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:53.643931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=88 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:53.649359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d9140bf-e4c9-4131-b6a2-d363bd7f7ae5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:53.649845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d9140bf-e4c9-4131-b6a2-d363bd7f7ae5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:53.650309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d9140bf-e4c9-4131-b6a2-d363bd7f7ae5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:53.650991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d9140bf-e4c9-4131-b6a2-d363bd7f7ae5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:53.651461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d9140bf-e4c9-4131-b6a2-d363bd7f7ae5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:53.651885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d9140bf-e4c9-4131-b6a2-d363bd7f7ae5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:53.681350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0d9140bf-e4c9-4131-b6a2-d363bd7f7ae5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045235 Aug 31 00:39:53.681908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 573/1216] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:53 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:53.880397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04171954-207b-4012-8ff4-dfbf0fc47f3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:53.882558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-04171954-207b-4012-8ff4-dfbf0fc47f3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:53.883824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fb1abebb-8ae0-4b54-bede-0fbd90fe4f4f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:53.886346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fb1abebb-8ae0-4b54-bede-0fbd90fe4f4f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:53.889825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04171954-207b-4012-8ff4-dfbf0fc47f3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:53.890363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04171954-207b-4012-8ff4-dfbf0fc47f3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:53.890744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04171954-207b-4012-8ff4-dfbf0fc47f3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:53.891463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04171954-207b-4012-8ff4-dfbf0fc47f3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:53.891916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04171954-207b-4012-8ff4-dfbf0fc47f3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:53.892335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04171954-207b-4012-8ff4-dfbf0fc47f3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:53.892621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb1abebb-8ae0-4b54-bede-0fbd90fe4f4f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:53.893099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb1abebb-8ae0-4b54-bede-0fbd90fe4f4f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:53.893533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb1abebb-8ae0-4b54-bede-0fbd90fe4f4f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:53.894233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb1abebb-8ae0-4b54-bede-0fbd90fe4f4f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:53.894667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb1abebb-8ae0-4b54-bede-0fbd90fe4f4f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:53.895115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb1abebb-8ae0-4b54-bede-0fbd90fe4f4f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:53.922491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-04171954-207b-4012-8ff4-dfbf0fc47f3c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045954 Aug 31 00:39:53.923083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 644/1217] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:53 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:53.927717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fb1abebb-8ae0-4b54-bede-0fbd90fe4f4f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048532 Aug 31 00:39:53.928269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 574/1218] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:53 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:54.693978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-55b8a349-1b20-42a2-a477-40067d647e90 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:54.696431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-55b8a349-1b20-42a2-a477-40067d647e90 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:54.702413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8a349-1b20-42a2-a477-40067d647e90 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:54.702896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8a349-1b20-42a2-a477-40067d647e90 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:54.703370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8a349-1b20-42a2-a477-40067d647e90 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:54.704059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8a349-1b20-42a2-a477-40067d647e90 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:54.704508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8a349-1b20-42a2-a477-40067d647e90 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:54.704931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8a349-1b20-42a2-a477-40067d647e90 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:54.735487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-55b8a349-1b20-42a2-a477-40067d647e90 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Aug 31 00:39:54.736032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 645/1219] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:54 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:54.936114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-77878eee-f555-4a26-9aa2-e33f06ee9935 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:54.938266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-77878eee-f555-4a26-9aa2-e33f06ee9935 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:54.939726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-55479109-34ae-459b-8da4-6c90f3c6845d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:54.941854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-55479109-34ae-459b-8da4-6c90f3c6845d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:54.945016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77878eee-f555-4a26-9aa2-e33f06ee9935 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:54.945829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77878eee-f555-4a26-9aa2-e33f06ee9935 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:54.946278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77878eee-f555-4a26-9aa2-e33f06ee9935 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:54.946972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77878eee-f555-4a26-9aa2-e33f06ee9935 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:54.947619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77878eee-f555-4a26-9aa2-e33f06ee9935 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:54.948041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77878eee-f555-4a26-9aa2-e33f06ee9935 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:54.948434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55479109-34ae-459b-8da4-6c90f3c6845d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:54.948910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55479109-34ae-459b-8da4-6c90f3c6845d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:54.949341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55479109-34ae-459b-8da4-6c90f3c6845d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:54.950022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55479109-34ae-459b-8da4-6c90f3c6845d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:54.950469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55479109-34ae-459b-8da4-6c90f3c6845d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:54.951087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55479109-34ae-459b-8da4-6c90f3c6845d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:54.980659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-77878eee-f555-4a26-9aa2-e33f06ee9935 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048615 Aug 31 00:39:54.981235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 575/1220] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:54 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:54.982405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-55479109-34ae-459b-8da4-6c90f3c6845d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046235 Aug 31 00:39:54.983170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 646/1221] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:55.748849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-df2a5c5c-0245-464b-8f9e-a61f88541785 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:55.750945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-df2a5c5c-0245-464b-8f9e-a61f88541785 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:55.756909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df2a5c5c-0245-464b-8f9e-a61f88541785 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:55.757385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df2a5c5c-0245-464b-8f9e-a61f88541785 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:55.758386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df2a5c5c-0245-464b-8f9e-a61f88541785 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:55.759192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df2a5c5c-0245-464b-8f9e-a61f88541785 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:55.759649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df2a5c5c-0245-464b-8f9e-a61f88541785 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:55.760065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df2a5c5c-0245-464b-8f9e-a61f88541785 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:55.790370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-df2a5c5c-0245-464b-8f9e-a61f88541785 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045244 Aug 31 00:39:55.790975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 576/1222] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:55 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:55.996472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7c7e419a-b4e6-44ae-a3aa-a3ac8debe154 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:55.998167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7c7e419a-b4e6-44ae-a3aa-a3ac8debe154 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:55.999147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a292ecba-bd5f-49b7-9700-ed3194070944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:56.001190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a292ecba-bd5f-49b7-9700-ed3194070944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:56.005281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c7e419a-b4e6-44ae-a3aa-a3ac8debe154 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:56.006167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c7e419a-b4e6-44ae-a3aa-a3ac8debe154 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:56.006907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c7e419a-b4e6-44ae-a3aa-a3ac8debe154 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:56.008307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c7e419a-b4e6-44ae-a3aa-a3ac8debe154 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:56.008898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c7e419a-b4e6-44ae-a3aa-a3ac8debe154 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:56.009137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a292ecba-bd5f-49b7-9700-ed3194070944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:56.009457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c7e419a-b4e6-44ae-a3aa-a3ac8debe154 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:56.009619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a292ecba-bd5f-49b7-9700-ed3194070944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:56.010239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a292ecba-bd5f-49b7-9700-ed3194070944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:56.011129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a292ecba-bd5f-49b7-9700-ed3194070944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:56.012060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a292ecba-bd5f-49b7-9700-ed3194070944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:56.012646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a292ecba-bd5f-49b7-9700-ed3194070944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:56.042443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7c7e419a-b4e6-44ae-a3aa-a3ac8debe154 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051377 Aug 31 00:39:56.043025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 647/1223] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:55 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:56.043589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a292ecba-bd5f-49b7-9700-ed3194070944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048335 Aug 31 00:39:56.044158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 577/1224] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:56.802042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-de31ea33-4369-4360-9343-804c3247b612 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:56.804185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-de31ea33-4369-4360-9343-804c3247b612 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:56.806674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=84 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:56.813244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de31ea33-4369-4360-9343-804c3247b612 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:56.814204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de31ea33-4369-4360-9343-804c3247b612 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:56.814842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de31ea33-4369-4360-9343-804c3247b612 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:56.815839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de31ea33-4369-4360-9343-804c3247b612 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:56.816445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de31ea33-4369-4360-9343-804c3247b612 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:56.817062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de31ea33-4369-4360-9343-804c3247b612 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:56.847354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-de31ea33-4369-4360-9343-804c3247b612 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049253 Aug 31 00:39:56.847902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 648/1225] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:56 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:57.054767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3f903086-e6cc-4c58-aa30-40741f05f097 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:57.056224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0b7a3e88-32aa-4af4-8db7-44a79a39040c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:57.057762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3f903086-e6cc-4c58-aa30-40741f05f097 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:57.058496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0b7a3e88-32aa-4af4-8db7-44a79a39040c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:57.064308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f903086-e6cc-4c58-aa30-40741f05f097 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:57.064795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f903086-e6cc-4c58-aa30-40741f05f097 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:57.064918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b7a3e88-32aa-4af4-8db7-44a79a39040c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:57.065231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f903086-e6cc-4c58-aa30-40741f05f097 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:57.065381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b7a3e88-32aa-4af4-8db7-44a79a39040c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:57.065820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b7a3e88-32aa-4af4-8db7-44a79a39040c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:57.065969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f903086-e6cc-4c58-aa30-40741f05f097 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:57.066365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f903086-e6cc-4c58-aa30-40741f05f097 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:57.066509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b7a3e88-32aa-4af4-8db7-44a79a39040c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:57.066786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f903086-e6cc-4c58-aa30-40741f05f097 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:57.066961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b7a3e88-32aa-4af4-8db7-44a79a39040c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:57.067509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b7a3e88-32aa-4af4-8db7-44a79a39040c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:57.097636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0b7a3e88-32aa-4af4-8db7-44a79a39040c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045841 Aug 31 00:39:57.101058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 649/1226] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:57.101240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3f903086-e6cc-4c58-aa30-40741f05f097 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048923 Aug 31 00:39:57.101240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 578/1227] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:57.860564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-28faaa84-6018-4442-b431-9f8ef86c93c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:57.862704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-28faaa84-6018-4442-b431-9f8ef86c93c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:57.868714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28faaa84-6018-4442-b431-9f8ef86c93c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:57.869389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28faaa84-6018-4442-b431-9f8ef86c93c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:57.869822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28faaa84-6018-4442-b431-9f8ef86c93c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:57.870504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28faaa84-6018-4442-b431-9f8ef86c93c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:57.870952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28faaa84-6018-4442-b431-9f8ef86c93c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:57.871401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28faaa84-6018-4442-b431-9f8ef86c93c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:57.901371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-28faaa84-6018-4442-b431-9f8ef86c93c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Aug 31 00:39:57.902210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 650/1228] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:57 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:58.111297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5fca4b7a-4af7-4723-b2f6-b19ebdabfbfd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:58.112278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1f7d44cd-6baf-48ce-9831-a421e1e65441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:58.113369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5fca4b7a-4af7-4723-b2f6-b19ebdabfbfd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:58.114420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1f7d44cd-6baf-48ce-9831-a421e1e65441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:58.121359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fca4b7a-4af7-4723-b2f6-b19ebdabfbfd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.121548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f7d44cd-6baf-48ce-9831-a421e1e65441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.121843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fca4b7a-4af7-4723-b2f6-b19ebdabfbfd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.121994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f7d44cd-6baf-48ce-9831-a421e1e65441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.122278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fca4b7a-4af7-4723-b2f6-b19ebdabfbfd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.122476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f7d44cd-6baf-48ce-9831-a421e1e65441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.122971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fca4b7a-4af7-4723-b2f6-b19ebdabfbfd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.123194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f7d44cd-6baf-48ce-9831-a421e1e65441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.123448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fca4b7a-4af7-4723-b2f6-b19ebdabfbfd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.123647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f7d44cd-6baf-48ce-9831-a421e1e65441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.123868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fca4b7a-4af7-4723-b2f6-b19ebdabfbfd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.124065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f7d44cd-6baf-48ce-9831-a421e1e65441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.155023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1f7d44cd-6baf-48ce-9831-a421e1e65441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046525 Aug 31 00:39:58.155365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5fca4b7a-4af7-4723-b2f6-b19ebdabfbfd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048432 Aug 31 00:39:58.155601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 651/1229] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:58.155927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 579/1230] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:58.914042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7cf0705a-53b1-445e-a1fa-430bf9996905 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:58.916374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7cf0705a-53b1-445e-a1fa-430bf9996905 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:58.922285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cf0705a-53b1-445e-a1fa-430bf9996905 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.922758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cf0705a-53b1-445e-a1fa-430bf9996905 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.923229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cf0705a-53b1-445e-a1fa-430bf9996905 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.923909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cf0705a-53b1-445e-a1fa-430bf9996905 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.924355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cf0705a-53b1-445e-a1fa-430bf9996905 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.924769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cf0705a-53b1-445e-a1fa-430bf9996905 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.941990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:58.956070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7cf0705a-53b1-445e-a1fa-430bf9996905 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046052 Aug 31 00:39:58.956624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 652/1231] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:58 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:59.168070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-654daf38-fdef-4f56-80a4-f30412b9d9de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:59.168698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e9fba4a-342b-4d67-8ed2-67d2bca25539 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:59.170157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-654daf38-fdef-4f56-80a4-f30412b9d9de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:59.170635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7e9fba4a-342b-4d67-8ed2-67d2bca25539 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:59.176651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-654daf38-fdef-4f56-80a4-f30412b9d9de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:59.177126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-654daf38-fdef-4f56-80a4-f30412b9d9de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:59.177327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e9fba4a-342b-4d67-8ed2-67d2bca25539 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:59.177551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-654daf38-fdef-4f56-80a4-f30412b9d9de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:59.177812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e9fba4a-342b-4d67-8ed2-67d2bca25539 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:59.178232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-654daf38-fdef-4f56-80a4-f30412b9d9de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:59.178336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e9fba4a-342b-4d67-8ed2-67d2bca25539 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:59.178677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-654daf38-fdef-4f56-80a4-f30412b9d9de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:59.178920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e9fba4a-342b-4d67-8ed2-67d2bca25539 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:59.179110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-654daf38-fdef-4f56-80a4-f30412b9d9de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:59.179400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e9fba4a-342b-4d67-8ed2-67d2bca25539 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:59.179827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e9fba4a-342b-4d67-8ed2-67d2bca25539 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:59.210032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-654daf38-fdef-4f56-80a4-f30412b9d9de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046490 Aug 31 00:39:59.210593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 653/1232] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:59.210891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7e9fba4a-342b-4d67-8ed2-67d2bca25539 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047400 Aug 31 00:39:59.211551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 580/1233] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:59.969112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cfa2e59b-b065-44e2-b050-efeadd362b9a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:59.971291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cfa2e59b-b065-44e2-b050-efeadd362b9a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:59.977401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa2e59b-b065-44e2-b050-efeadd362b9a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:59.978237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa2e59b-b065-44e2-b050-efeadd362b9a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:59.978801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa2e59b-b065-44e2-b050-efeadd362b9a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:59.979532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa2e59b-b065-44e2-b050-efeadd362b9a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:59.979984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa2e59b-b065-44e2-b050-efeadd362b9a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:59.980405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa2e59b-b065-44e2-b050-efeadd362b9a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.079621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cfa2e59b-b065-44e2-b050-efeadd362b9a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "POST /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/action" status: 200 len: 76639 microversion: 2.1 time: 0.114217 Aug 31 00:40:00.080282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 654/1234] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 00:39:59 2022] POST /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851/action => generated 76639 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:00.222056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-306bdac3-152d-4f1c-abe3-dba020392199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:00.224046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8040317e-a526-4a63-b56e-4e57d62dd5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:00.224793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-306bdac3-152d-4f1c-abe3-dba020392199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:00.226368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8040317e-a526-4a63-b56e-4e57d62dd5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:00.230729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-306bdac3-152d-4f1c-abe3-dba020392199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:00.231239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-306bdac3-152d-4f1c-abe3-dba020392199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:00.231669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-306bdac3-152d-4f1c-abe3-dba020392199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.232622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-306bdac3-152d-4f1c-abe3-dba020392199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:00.233073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-306bdac3-152d-4f1c-abe3-dba020392199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:00.233497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-306bdac3-152d-4f1c-abe3-dba020392199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.234043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8040317e-a526-4a63-b56e-4e57d62dd5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:00.234518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8040317e-a526-4a63-b56e-4e57d62dd5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:00.234941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8040317e-a526-4a63-b56e-4e57d62dd5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.235648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8040317e-a526-4a63-b56e-4e57d62dd5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:00.236091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8040317e-a526-4a63-b56e-4e57d62dd5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:00.236503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8040317e-a526-4a63-b56e-4e57d62dd5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.264770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-306bdac3-152d-4f1c-abe3-dba020392199 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046865 Aug 31 00:40:00.265339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 581/1235] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:00.273012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8040317e-a526-4a63-b56e-4e57d62dd5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053271 Aug 31 00:40:00.273556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 655/1236] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:01.277342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2736ac92-7ca4-4b82-8918-01a675d33849 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:01.279592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2736ac92-7ca4-4b82-8918-01a675d33849 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:01.285025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-143f6c12-11ce-49c8-8781-92d015d5da41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:01.286831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2736ac92-7ca4-4b82-8918-01a675d33849 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:01.287401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2736ac92-7ca4-4b82-8918-01a675d33849 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:01.287821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2736ac92-7ca4-4b82-8918-01a675d33849 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:01.288386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-143f6c12-11ce-49c8-8781-92d015d5da41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:01.288499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2736ac92-7ca4-4b82-8918-01a675d33849 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:01.288950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2736ac92-7ca4-4b82-8918-01a675d33849 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:01.289368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2736ac92-7ca4-4b82-8918-01a675d33849 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:01.294175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:01.297285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143f6c12-11ce-49c8-8781-92d015d5da41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:01.298276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143f6c12-11ce-49c8-8781-92d015d5da41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:01.298894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143f6c12-11ce-49c8-8781-92d015d5da41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:01.300348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143f6c12-11ce-49c8-8781-92d015d5da41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:01.300550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143f6c12-11ce-49c8-8781-92d015d5da41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:01.301039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143f6c12-11ce-49c8-8781-92d015d5da41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:01.321115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2736ac92-7ca4-4b82-8918-01a675d33849 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048489 Aug 31 00:40:01.322524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 582/1237] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:01.336548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-143f6c12-11ce-49c8-8781-92d015d5da41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055446 Aug 31 00:40:01.337664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 656/1238] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:02.333327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e68a17d9-2dde-4365-a12a-89769c2df292 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:02.335488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e68a17d9-2dde-4365-a12a-89769c2df292 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:02.341885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e68a17d9-2dde-4365-a12a-89769c2df292 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:02.342361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e68a17d9-2dde-4365-a12a-89769c2df292 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:02.342790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e68a17d9-2dde-4365-a12a-89769c2df292 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:02.343501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e68a17d9-2dde-4365-a12a-89769c2df292 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:02.343949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e68a17d9-2dde-4365-a12a-89769c2df292 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:02.344362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e68a17d9-2dde-4365-a12a-89769c2df292 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:02.348958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bdcce59e-8edd-4c3b-be43-10dca4027278 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:02.351209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bdcce59e-8edd-4c3b-be43-10dca4027278 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:02.358490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdcce59e-8edd-4c3b-be43-10dca4027278 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:02.358967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdcce59e-8edd-4c3b-be43-10dca4027278 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:02.359427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdcce59e-8edd-4c3b-be43-10dca4027278 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:02.360110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdcce59e-8edd-4c3b-be43-10dca4027278 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:02.360555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdcce59e-8edd-4c3b-be43-10dca4027278 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:02.360966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdcce59e-8edd-4c3b-be43-10dca4027278 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:02.375542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e68a17d9-2dde-4365-a12a-89769c2df292 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046093 Aug 31 00:40:02.376131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 583/1239] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:02.392170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bdcce59e-8edd-4c3b-be43-10dca4027278 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047120 Aug 31 00:40:02.392714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 657/1240] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:03.388490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cab107f5-a1ae-4c07-ad86-35382c5e12d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:03.390703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cab107f5-a1ae-4c07-ad86-35382c5e12d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:03.397085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab107f5-a1ae-4c07-ad86-35382c5e12d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:03.397575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab107f5-a1ae-4c07-ad86-35382c5e12d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:03.398011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab107f5-a1ae-4c07-ad86-35382c5e12d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:03.398706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab107f5-a1ae-4c07-ad86-35382c5e12d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:03.399361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab107f5-a1ae-4c07-ad86-35382c5e12d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:03.400008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab107f5-a1ae-4c07-ad86-35382c5e12d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:03.404207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0e06a11b-b527-41d8-b418-9e6123b012ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:03.406438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0e06a11b-b527-41d8-b418-9e6123b012ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:03.412748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e06a11b-b527-41d8-b418-9e6123b012ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:03.413224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e06a11b-b527-41d8-b418-9e6123b012ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:03.413651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e06a11b-b527-41d8-b418-9e6123b012ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:03.414333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e06a11b-b527-41d8-b418-9e6123b012ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:03.414774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e06a11b-b527-41d8-b418-9e6123b012ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:03.415323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e06a11b-b527-41d8-b418-9e6123b012ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:03.432157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cab107f5-a1ae-4c07-ad86-35382c5e12d6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048196 Aug 31 00:40:03.432990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 584/1241] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:03.445872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0e06a11b-b527-41d8-b418-9e6123b012ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045554 Aug 31 00:40:03.446990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 658/1242] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:04.444582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-05b50b22-d81e-44b8-9226-248b0889e117 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:04.447525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-05b50b22-d81e-44b8-9226-248b0889e117 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:04.453969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05b50b22-d81e-44b8-9226-248b0889e117 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:04.454452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05b50b22-d81e-44b8-9226-248b0889e117 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:04.454876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05b50b22-d81e-44b8-9226-248b0889e117 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:04.455589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05b50b22-d81e-44b8-9226-248b0889e117 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:04.456028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05b50b22-d81e-44b8-9226-248b0889e117 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:04.456438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05b50b22-d81e-44b8-9226-248b0889e117 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:04.457858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c273829d-3cb0-4895-a8f8-8c29ad04e037 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:04.460175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c273829d-3cb0-4895-a8f8-8c29ad04e037 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:04.467045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c273829d-3cb0-4895-a8f8-8c29ad04e037 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:04.467542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c273829d-3cb0-4895-a8f8-8c29ad04e037 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:04.467976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c273829d-3cb0-4895-a8f8-8c29ad04e037 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:04.468670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c273829d-3cb0-4895-a8f8-8c29ad04e037 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:04.469120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c273829d-3cb0-4895-a8f8-8c29ad04e037 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:04.469538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c273829d-3cb0-4895-a8f8-8c29ad04e037 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:04.487246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-05b50b22-d81e-44b8-9226-248b0889e117 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046289 Aug 31 00:40:04.487727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 585/1243] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:04.500983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c273829d-3cb0-4895-a8f8-8c29ad04e037 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046870 Aug 31 00:40:04.501590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 659/1244] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:05.499112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-815d9e37-30e6-4d80-b469-964bf384ce16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:05.501229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-815d9e37-30e6-4d80-b469-964bf384ce16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:05.508092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-815d9e37-30e6-4d80-b469-964bf384ce16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:05.508474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-815d9e37-30e6-4d80-b469-964bf384ce16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:05.508949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-815d9e37-30e6-4d80-b469-964bf384ce16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:05.509821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-815d9e37-30e6-4d80-b469-964bf384ce16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:05.510327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-815d9e37-30e6-4d80-b469-964bf384ce16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:05.510751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-815d9e37-30e6-4d80-b469-964bf384ce16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:05.515071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-01686cfe-e5df-4963-a809-cf29903b9a57 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:05.516773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-01686cfe-e5df-4963-a809-cf29903b9a57 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:05.523181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01686cfe-e5df-4963-a809-cf29903b9a57 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:05.523660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01686cfe-e5df-4963-a809-cf29903b9a57 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:05.524123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01686cfe-e5df-4963-a809-cf29903b9a57 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:05.524817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01686cfe-e5df-4963-a809-cf29903b9a57 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:05.525841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01686cfe-e5df-4963-a809-cf29903b9a57 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:05.526258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01686cfe-e5df-4963-a809-cf29903b9a57 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:05.543103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-815d9e37-30e6-4d80-b469-964bf384ce16 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048015 Aug 31 00:40:05.543668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 586/1245] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:05.557304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-01686cfe-e5df-4963-a809-cf29903b9a57 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047809 Aug 31 00:40:05.557941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 660/1246] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:06.555480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-adff6156-50e4-486d-92cf-57a3d198f743 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:06.558456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-adff6156-50e4-486d-92cf-57a3d198f743 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:06.566430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-adff6156-50e4-486d-92cf-57a3d198f743 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:06.566923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-adff6156-50e4-486d-92cf-57a3d198f743 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:06.567401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-adff6156-50e4-486d-92cf-57a3d198f743 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:06.568126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-adff6156-50e4-486d-92cf-57a3d198f743 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:06.568571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-adff6156-50e4-486d-92cf-57a3d198f743 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:06.568989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-adff6156-50e4-486d-92cf-57a3d198f743 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:06.570138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d362baee-5e21-4961-bff1-9702f98dd486 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:06.573671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d362baee-5e21-4961-bff1-9702f98dd486 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:06.580423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d362baee-5e21-4961-bff1-9702f98dd486 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:06.580897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d362baee-5e21-4961-bff1-9702f98dd486 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:06.581320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d362baee-5e21-4961-bff1-9702f98dd486 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:06.582002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d362baee-5e21-4961-bff1-9702f98dd486 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:06.582441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d362baee-5e21-4961-bff1-9702f98dd486 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:06.582853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d362baee-5e21-4961-bff1-9702f98dd486 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:06.600844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-adff6156-50e4-486d-92cf-57a3d198f743 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049334 Aug 31 00:40:06.601407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 587/1247] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:06.614559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d362baee-5e21-4961-bff1-9702f98dd486 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048661 Aug 31 00:40:06.615134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 661/1248] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:07.613794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7867c8b4-13d8-4d81-ab16-2a912de0fc81 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:07.616061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7867c8b4-13d8-4d81-ab16-2a912de0fc81 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:07.622920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7867c8b4-13d8-4d81-ab16-2a912de0fc81 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:07.623479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7867c8b4-13d8-4d81-ab16-2a912de0fc81 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:07.623873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7867c8b4-13d8-4d81-ab16-2a912de0fc81 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:07.630387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7867c8b4-13d8-4d81-ab16-2a912de0fc81 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:07.630387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7867c8b4-13d8-4d81-ab16-2a912de0fc81 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:07.630387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7867c8b4-13d8-4d81-ab16-2a912de0fc81 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:07.630760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8a213d23-6f99-4f42-9929-0e1caa01fd85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:07.630760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8a213d23-6f99-4f42-9929-0e1caa01fd85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:07.636211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a213d23-6f99-4f42-9929-0e1caa01fd85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:07.636700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a213d23-6f99-4f42-9929-0e1caa01fd85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:07.637136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a213d23-6f99-4f42-9929-0e1caa01fd85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:07.637834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a213d23-6f99-4f42-9929-0e1caa01fd85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:07.638283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a213d23-6f99-4f42-9929-0e1caa01fd85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:07.638704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8a213d23-6f99-4f42-9929-0e1caa01fd85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:07.656802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7867c8b4-13d8-4d81-ab16-2a912de0fc81 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046977 Aug 31 00:40:07.657355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 588/1249] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:07.669443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8a213d23-6f99-4f42-9929-0e1caa01fd85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Aug 31 00:40:07.670000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 662/1250] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:08.668925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1253d256-b0dd-4eec-8a5c-079c347c2e63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:08.671199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1253d256-b0dd-4eec-8a5c-079c347c2e63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:08.677807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1253d256-b0dd-4eec-8a5c-079c347c2e63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:08.678295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1253d256-b0dd-4eec-8a5c-079c347c2e63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:08.678731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1253d256-b0dd-4eec-8a5c-079c347c2e63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:08.679454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1253d256-b0dd-4eec-8a5c-079c347c2e63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:08.679907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1253d256-b0dd-4eec-8a5c-079c347c2e63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:08.680329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1253d256-b0dd-4eec-8a5c-079c347c2e63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:08.685907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-88b7274d-a88a-4546-9f5b-b164ed205216 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:08.688184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-88b7274d-a88a-4546-9f5b-b164ed205216 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:08.694356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88b7274d-a88a-4546-9f5b-b164ed205216 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:08.694839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88b7274d-a88a-4546-9f5b-b164ed205216 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:08.695361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88b7274d-a88a-4546-9f5b-b164ed205216 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:08.696153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88b7274d-a88a-4546-9f5b-b164ed205216 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:08.696609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88b7274d-a88a-4546-9f5b-b164ed205216 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:08.697675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88b7274d-a88a-4546-9f5b-b164ed205216 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:08.713449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1253d256-b0dd-4eec-8a5c-079c347c2e63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048471 Aug 31 00:40:08.714067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 589/1251] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:40:08.727545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-88b7274d-a88a-4546-9f5b-b164ed205216 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049700 Aug 31 00:40:08.728131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 663/1252] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:09.725799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ec2cebcb-2950-47e5-aa57-18dc2f95f4ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:09.727974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ec2cebcb-2950-47e5-aa57-18dc2f95f4ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:09.734492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec2cebcb-2950-47e5-aa57-18dc2f95f4ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:09.735002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec2cebcb-2950-47e5-aa57-18dc2f95f4ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:09.735424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec2cebcb-2950-47e5-aa57-18dc2f95f4ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:09.736547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec2cebcb-2950-47e5-aa57-18dc2f95f4ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:09.736547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec2cebcb-2950-47e5-aa57-18dc2f95f4ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:09.736938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec2cebcb-2950-47e5-aa57-18dc2f95f4ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:09.740411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1ecf4884-2253-44a1-af28-f51f1fe9919e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:09.742763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1ecf4884-2253-44a1-af28-f51f1fe9919e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:09.749914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ecf4884-2253-44a1-af28-f51f1fe9919e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:09.750398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ecf4884-2253-44a1-af28-f51f1fe9919e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:09.750833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ecf4884-2253-44a1-af28-f51f1fe9919e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:09.751555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ecf4884-2253-44a1-af28-f51f1fe9919e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:09.752253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ecf4884-2253-44a1-af28-f51f1fe9919e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:09.752771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ecf4884-2253-44a1-af28-f51f1fe9919e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:09.768352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ec2cebcb-2950-47e5-aa57-18dc2f95f4ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046422 Aug 31 00:40:09.768914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 590/1253] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:09.784454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1ecf4884-2253-44a1-af28-f51f1fe9919e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047889 Aug 31 00:40:09.785004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 664/1254] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:10.781025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c038b355-1c14-4938-95e8-a01a80f32e20 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:10.783179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c038b355-1c14-4938-95e8-a01a80f32e20 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:10.790105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c038b355-1c14-4938-95e8-a01a80f32e20 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.790586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c038b355-1c14-4938-95e8-a01a80f32e20 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.791017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c038b355-1c14-4938-95e8-a01a80f32e20 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.792420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c038b355-1c14-4938-95e8-a01a80f32e20 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.792874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c038b355-1c14-4938-95e8-a01a80f32e20 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.793296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c038b355-1c14-4938-95e8-a01a80f32e20 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.799309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-83fa80fb-24d1-4b53-8613-009327e39115 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:10.801617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-83fa80fb-24d1-4b53-8613-009327e39115 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:10.809085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83fa80fb-24d1-4b53-8613-009327e39115 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.809569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83fa80fb-24d1-4b53-8613-009327e39115 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.810002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83fa80fb-24d1-4b53-8613-009327e39115 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.811506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83fa80fb-24d1-4b53-8613-009327e39115 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.812037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83fa80fb-24d1-4b53-8613-009327e39115 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.812547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83fa80fb-24d1-4b53-8613-009327e39115 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.823402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c038b355-1c14-4938-95e8-a01a80f32e20 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046114 Aug 31 00:40:10.823986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 591/1255] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:10.844612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-83fa80fb-24d1-4b53-8613-009327e39115 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050649 Aug 31 00:40:10.845164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 665/1256] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:11.834970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-104e2939-4692-41e2-86fe-74bf3ac1d43e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:11.837125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-104e2939-4692-41e2-86fe-74bf3ac1d43e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:11.846075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-104e2939-4692-41e2-86fe-74bf3ac1d43e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.846560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-104e2939-4692-41e2-86fe-74bf3ac1d43e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.846991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-104e2939-4692-41e2-86fe-74bf3ac1d43e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.847701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-104e2939-4692-41e2-86fe-74bf3ac1d43e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.848147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-104e2939-4692-41e2-86fe-74bf3ac1d43e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.848645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-104e2939-4692-41e2-86fe-74bf3ac1d43e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.857887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ada1e669-b76e-49b3-8ad6-86ef36f0ef7f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:11.861157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ada1e669-b76e-49b3-8ad6-86ef36f0ef7f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:11.868503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada1e669-b76e-49b3-8ad6-86ef36f0ef7f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.869473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada1e669-b76e-49b3-8ad6-86ef36f0ef7f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.871146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada1e669-b76e-49b3-8ad6-86ef36f0ef7f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.872586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada1e669-b76e-49b3-8ad6-86ef36f0ef7f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.873503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada1e669-b76e-49b3-8ad6-86ef36f0ef7f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.874367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada1e669-b76e-49b3-8ad6-86ef36f0ef7f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.880683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-104e2939-4692-41e2-86fe-74bf3ac1d43e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049593 Aug 31 00:40:11.881250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 592/1257] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:11.911663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ada1e669-b76e-49b3-8ad6-86ef36f0ef7f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058601 Aug 31 00:40:11.912230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 666/1258] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:12.893679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b04776ec-af26-4187-ad8f-215eb1ef6399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:12.895819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b04776ec-af26-4187-ad8f-215eb1ef6399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:12.902799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b04776ec-af26-4187-ad8f-215eb1ef6399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:12.903306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b04776ec-af26-4187-ad8f-215eb1ef6399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:12.903739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b04776ec-af26-4187-ad8f-215eb1ef6399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:12.904435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b04776ec-af26-4187-ad8f-215eb1ef6399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:12.904881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b04776ec-af26-4187-ad8f-215eb1ef6399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:12.905506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b04776ec-af26-4187-ad8f-215eb1ef6399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:12.926424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0568d1db-8a0d-42d6-8b7b-095ed1722d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:12.926424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0568d1db-8a0d-42d6-8b7b-095ed1722d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:12.933358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0568d1db-8a0d-42d6-8b7b-095ed1722d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:12.933840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0568d1db-8a0d-42d6-8b7b-095ed1722d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:12.934273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0568d1db-8a0d-42d6-8b7b-095ed1722d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:12.934967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0568d1db-8a0d-42d6-8b7b-095ed1722d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:12.935457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0568d1db-8a0d-42d6-8b7b-095ed1722d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:12.935879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0568d1db-8a0d-42d6-8b7b-095ed1722d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:12.936324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b04776ec-af26-4187-ad8f-215eb1ef6399 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046208 Aug 31 00:40:12.936904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 593/1259] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:12.969267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0568d1db-8a0d-42d6-8b7b-095ed1722d72 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048984 Aug 31 00:40:12.969840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 667/1260] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:13.949628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c7fc5112-7aae-49fb-bcbb-b535d581ceb6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:13.951801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c7fc5112-7aae-49fb-bcbb-b535d581ceb6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:13.959542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7fc5112-7aae-49fb-bcbb-b535d581ceb6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:13.960312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7fc5112-7aae-49fb-bcbb-b535d581ceb6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:13.960312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7fc5112-7aae-49fb-bcbb-b535d581ceb6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:13.960754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7fc5112-7aae-49fb-bcbb-b535d581ceb6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:13.961209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7fc5112-7aae-49fb-bcbb-b535d581ceb6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:13.961627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7fc5112-7aae-49fb-bcbb-b535d581ceb6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:13.984547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d63649fd-aa78-49d9-af5c-5b034b24257a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:13.987101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d63649fd-aa78-49d9-af5c-5b034b24257a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:13.998609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d63649fd-aa78-49d9-af5c-5b034b24257a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:13.998812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d63649fd-aa78-49d9-af5c-5b034b24257a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:13.999272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d63649fd-aa78-49d9-af5c-5b034b24257a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:13.999979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d63649fd-aa78-49d9-af5c-5b034b24257a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:14.000430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d63649fd-aa78-49d9-af5c-5b034b24257a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:14.000853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d63649fd-aa78-49d9-af5c-5b034b24257a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:14.005784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c7fc5112-7aae-49fb-bcbb-b535d581ceb6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061129 Aug 31 00:40:14.006863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 594/1261] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:14.039837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d63649fd-aa78-49d9-af5c-5b034b24257a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060786 Aug 31 00:40:14.040576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 668/1262] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:15.018795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-90352f18-25f1-45f1-a0d0-4df11c6c7325 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:15.021033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-90352f18-25f1-45f1-a0d0-4df11c6c7325 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:15.028358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90352f18-25f1-45f1-a0d0-4df11c6c7325 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:15.028842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90352f18-25f1-45f1-a0d0-4df11c6c7325 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:15.029276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90352f18-25f1-45f1-a0d0-4df11c6c7325 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:15.029964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90352f18-25f1-45f1-a0d0-4df11c6c7325 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:15.030412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90352f18-25f1-45f1-a0d0-4df11c6c7325 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:15.030830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90352f18-25f1-45f1-a0d0-4df11c6c7325 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:15.053469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c09bc77f-a2a4-496c-8802-84c5634db18f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:15.055857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c09bc77f-a2a4-496c-8802-84c5634db18f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:15.060786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-90352f18-25f1-45f1-a0d0-4df11c6c7325 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045960 Aug 31 00:40:15.061561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 595/1263] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:15.062614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09bc77f-a2a4-496c-8802-84c5634db18f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:15.063130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09bc77f-a2a4-496c-8802-84c5634db18f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:15.063767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09bc77f-a2a4-496c-8802-84c5634db18f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:15.064725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09bc77f-a2a4-496c-8802-84c5634db18f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:15.065323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09bc77f-a2a4-496c-8802-84c5634db18f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:15.065752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09bc77f-a2a4-496c-8802-84c5634db18f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:15.083678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:15.099145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c09bc77f-a2a4-496c-8802-84c5634db18f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049955 Aug 31 00:40:15.099706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 669/1264] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:16.073171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8520f9bf-444d-4333-82b0-12b0c3889e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:16.075310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8520f9bf-444d-4333-82b0-12b0c3889e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:16.081739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8520f9bf-444d-4333-82b0-12b0c3889e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.082220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8520f9bf-444d-4333-82b0-12b0c3889e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.082669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8520f9bf-444d-4333-82b0-12b0c3889e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.083463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8520f9bf-444d-4333-82b0-12b0c3889e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.083912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8520f9bf-444d-4333-82b0-12b0c3889e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.084334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8520f9bf-444d-4333-82b0-12b0c3889e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.111832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5272ca57-dc82-467c-b032-9a08369afa19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:16.114124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5272ca57-dc82-467c-b032-9a08369afa19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:16.115475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8520f9bf-444d-4333-82b0-12b0c3889e99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046208 Aug 31 00:40:16.120227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 596/1265] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:16.120392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5272ca57-dc82-467c-b032-9a08369afa19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.120868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5272ca57-dc82-467c-b032-9a08369afa19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.121295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5272ca57-dc82-467c-b032-9a08369afa19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.121985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5272ca57-dc82-467c-b032-9a08369afa19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.122432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5272ca57-dc82-467c-b032-9a08369afa19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.122849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5272ca57-dc82-467c-b032-9a08369afa19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.152351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5272ca57-dc82-467c-b032-9a08369afa19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Aug 31 00:40:16.152893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 670/1266] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:17.127916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fcdd1004-a08a-41d0-b72c-a4531c31882e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:17.130101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fcdd1004-a08a-41d0-b72c-a4531c31882e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:17.136751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcdd1004-a08a-41d0-b72c-a4531c31882e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:17.137228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcdd1004-a08a-41d0-b72c-a4531c31882e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:17.137650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcdd1004-a08a-41d0-b72c-a4531c31882e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:17.138326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcdd1004-a08a-41d0-b72c-a4531c31882e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:17.138762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcdd1004-a08a-41d0-b72c-a4531c31882e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:17.139214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcdd1004-a08a-41d0-b72c-a4531c31882e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:17.164761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-81eb3405-eff1-4269-a8c3-2ff39c49f092 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:17.168406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-81eb3405-eff1-4269-a8c3-2ff39c49f092 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:17.170298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fcdd1004-a08a-41d0-b72c-a4531c31882e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046260 Aug 31 00:40:17.171171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 597/1267] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:40:17.175912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81eb3405-eff1-4269-a8c3-2ff39c49f092 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:17.176403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81eb3405-eff1-4269-a8c3-2ff39c49f092 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:17.176837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81eb3405-eff1-4269-a8c3-2ff39c49f092 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:17.177692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81eb3405-eff1-4269-a8c3-2ff39c49f092 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:17.178136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81eb3405-eff1-4269-a8c3-2ff39c49f092 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:17.178596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81eb3405-eff1-4269-a8c3-2ff39c49f092 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:17.210152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-81eb3405-eff1-4269-a8c3-2ff39c49f092 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049414 Aug 31 00:40:17.210707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 671/1268] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:18.183178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-80894a56-7eda-4b55-99a2-0c9eec4b61ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:18.185281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-80894a56-7eda-4b55-99a2-0c9eec4b61ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:18.191612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80894a56-7eda-4b55-99a2-0c9eec4b61ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.192081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80894a56-7eda-4b55-99a2-0c9eec4b61ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.192533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80894a56-7eda-4b55-99a2-0c9eec4b61ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.193202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80894a56-7eda-4b55-99a2-0c9eec4b61ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.193638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80894a56-7eda-4b55-99a2-0c9eec4b61ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.194046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80894a56-7eda-4b55-99a2-0c9eec4b61ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.222724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-deb06616-e93d-4872-b703-84096cf1dfbc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:18.223351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:18.226047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-deb06616-e93d-4872-b703-84096cf1dfbc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:18.229161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-80894a56-7eda-4b55-99a2-0c9eec4b61ea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050234 Aug 31 00:40:18.230245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 598/1269] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:18.233747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-deb06616-e93d-4872-b703-84096cf1dfbc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.234441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-deb06616-e93d-4872-b703-84096cf1dfbc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.234877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-deb06616-e93d-4872-b703-84096cf1dfbc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.235604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-deb06616-e93d-4872-b703-84096cf1dfbc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.236057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-deb06616-e93d-4872-b703-84096cf1dfbc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.236484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-deb06616-e93d-4872-b703-84096cf1dfbc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.267962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-deb06616-e93d-4872-b703-84096cf1dfbc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049330 Aug 31 00:40:18.268816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 672/1270] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:18 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:19.241960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-34966edc-934c-4f1f-9b4a-fa7bcfe232a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:19.244095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-34966edc-934c-4f1f-9b4a-fa7bcfe232a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:19.251317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34966edc-934c-4f1f-9b4a-fa7bcfe232a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:19.251739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34966edc-934c-4f1f-9b4a-fa7bcfe232a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:19.252168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34966edc-934c-4f1f-9b4a-fa7bcfe232a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:19.252854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34966edc-934c-4f1f-9b4a-fa7bcfe232a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:19.253304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34966edc-934c-4f1f-9b4a-fa7bcfe232a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:19.253721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34966edc-934c-4f1f-9b4a-fa7bcfe232a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:19.283613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c7376c42-7b46-46f8-b17f-d8e1e6901888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:19.284891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-34966edc-934c-4f1f-9b4a-fa7bcfe232a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047025 Aug 31 00:40:19.285786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 599/1271] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:19.287867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c7376c42-7b46-46f8-b17f-d8e1e6901888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:19.295431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7376c42-7b46-46f8-b17f-d8e1e6901888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:19.295982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7376c42-7b46-46f8-b17f-d8e1e6901888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:19.296433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7376c42-7b46-46f8-b17f-d8e1e6901888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:19.297137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7376c42-7b46-46f8-b17f-d8e1e6901888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:19.297621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7376c42-7b46-46f8-b17f-d8e1e6901888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:19.298161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7376c42-7b46-46f8-b17f-d8e1e6901888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:19.328993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c7376c42-7b46-46f8-b17f-d8e1e6901888 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052333 Aug 31 00:40:19.329548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 673/1272] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:20.297898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-441ad3f7-c79b-4654-99ec-8d996f6d984d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:20.299980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-441ad3f7-c79b-4654-99ec-8d996f6d984d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:20.306346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-441ad3f7-c79b-4654-99ec-8d996f6d984d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.306821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-441ad3f7-c79b-4654-99ec-8d996f6d984d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.307522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-441ad3f7-c79b-4654-99ec-8d996f6d984d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.308217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-441ad3f7-c79b-4654-99ec-8d996f6d984d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.308666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-441ad3f7-c79b-4654-99ec-8d996f6d984d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.309088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-441ad3f7-c79b-4654-99ec-8d996f6d984d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.340363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-441ad3f7-c79b-4654-99ec-8d996f6d984d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046461 Aug 31 00:40:20.341144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 600/1273] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:20.343316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-18f5c512-8761-49c7-8beb-083267117fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:20.345483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-18f5c512-8761-49c7-8beb-083267117fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:20.351646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18f5c512-8761-49c7-8beb-083267117fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.352134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18f5c512-8761-49c7-8beb-083267117fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.352565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18f5c512-8761-49c7-8beb-083267117fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.353254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18f5c512-8761-49c7-8beb-083267117fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.353698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18f5c512-8761-49c7-8beb-083267117fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.354122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18f5c512-8761-49c7-8beb-083267117fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.386029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-18f5c512-8761-49c7-8beb-083267117fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048141 Aug 31 00:40:20.386631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 674/1274] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:21.352775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-079760b9-21eb-4f5d-b89f-6c07dd9313e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:21.355007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-079760b9-21eb-4f5d-b89f-6c07dd9313e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:21.361650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079760b9-21eb-4f5d-b89f-6c07dd9313e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.362123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079760b9-21eb-4f5d-b89f-6c07dd9313e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.362553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079760b9-21eb-4f5d-b89f-6c07dd9313e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.363261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079760b9-21eb-4f5d-b89f-6c07dd9313e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.363712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079760b9-21eb-4f5d-b89f-6c07dd9313e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.364127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079760b9-21eb-4f5d-b89f-6c07dd9313e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.394738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-079760b9-21eb-4f5d-b89f-6c07dd9313e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045843 Aug 31 00:40:21.395769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 601/1275] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:21.397844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-be54cf32-9287-4b9d-bb2a-5063da67cef8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:21.400020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-be54cf32-9287-4b9d-bb2a-5063da67cef8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:21.407650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be54cf32-9287-4b9d-bb2a-5063da67cef8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.408132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be54cf32-9287-4b9d-bb2a-5063da67cef8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.408570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be54cf32-9287-4b9d-bb2a-5063da67cef8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.409267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be54cf32-9287-4b9d-bb2a-5063da67cef8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.409721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be54cf32-9287-4b9d-bb2a-5063da67cef8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.410145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be54cf32-9287-4b9d-bb2a-5063da67cef8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.441624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-be54cf32-9287-4b9d-bb2a-5063da67cef8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047776 Aug 31 00:40:21.442185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 675/1276] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:21 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:22.407917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3651b35c-510a-40bb-a07d-828953444ad0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:22.410021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3651b35c-510a-40bb-a07d-828953444ad0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:22.416364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3651b35c-510a-40bb-a07d-828953444ad0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:22.417599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3651b35c-510a-40bb-a07d-828953444ad0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:22.417899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3651b35c-510a-40bb-a07d-828953444ad0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:22.418572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3651b35c-510a-40bb-a07d-828953444ad0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:22.419015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3651b35c-510a-40bb-a07d-828953444ad0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:22.419452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3651b35c-510a-40bb-a07d-828953444ad0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:22.449699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3651b35c-510a-40bb-a07d-828953444ad0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045888 Aug 31 00:40:22.450276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 602/1277] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:22.457100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed1587a2-220b-4198-958e-31105bcec900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:22.459282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ed1587a2-220b-4198-958e-31105bcec900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:22.466395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed1587a2-220b-4198-958e-31105bcec900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:22.466857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed1587a2-220b-4198-958e-31105bcec900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:22.467303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed1587a2-220b-4198-958e-31105bcec900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:22.467982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed1587a2-220b-4198-958e-31105bcec900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:22.468430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed1587a2-220b-4198-958e-31105bcec900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:22.468912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed1587a2-220b-4198-958e-31105bcec900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:22.499509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ed1587a2-220b-4198-958e-31105bcec900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049554 Aug 31 00:40:22.500057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 676/1278] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:22 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:23.461784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ab5138ee-b966-4524-9acf-472238826e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:23.463912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ab5138ee-b966-4524-9acf-472238826e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:23.470320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab5138ee-b966-4524-9acf-472238826e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.470794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab5138ee-b966-4524-9acf-472238826e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.471266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab5138ee-b966-4524-9acf-472238826e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.471937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab5138ee-b966-4524-9acf-472238826e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.472387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab5138ee-b966-4524-9acf-472238826e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.472803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab5138ee-b966-4524-9acf-472238826e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.503021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ab5138ee-b966-4524-9acf-472238826e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045028 Aug 31 00:40:23.503524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 603/1279] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:23.510901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bd1d5490-0321-4767-9861-b86545503957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:23.513168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bd1d5490-0321-4767-9861-b86545503957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:23.519938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd1d5490-0321-4767-9861-b86545503957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.520431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd1d5490-0321-4767-9861-b86545503957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.520863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd1d5490-0321-4767-9861-b86545503957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.521553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd1d5490-0321-4767-9861-b86545503957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.522003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd1d5490-0321-4767-9861-b86545503957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.522421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd1d5490-0321-4767-9861-b86545503957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.553935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bd1d5490-0321-4767-9861-b86545503957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046916 Aug 31 00:40:23.554510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 677/1280] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:24.514629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-964f48f5-19eb-43f6-99ef-6774907c740a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:24.516764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-964f48f5-19eb-43f6-99ef-6774907c740a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:24.519102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=62 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:24.524600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-964f48f5-19eb-43f6-99ef-6774907c740a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.525078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-964f48f5-19eb-43f6-99ef-6774907c740a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.525510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-964f48f5-19eb-43f6-99ef-6774907c740a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.526193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-964f48f5-19eb-43f6-99ef-6774907c740a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.526638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-964f48f5-19eb-43f6-99ef-6774907c740a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.527598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-964f48f5-19eb-43f6-99ef-6774907c740a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.562314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-964f48f5-19eb-43f6-99ef-6774907c740a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051570 Aug 31 00:40:24.562908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 604/1281] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:24.568544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7d98015f-7b53-4dc0-8c31-5c2951dcf815 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:24.570733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7d98015f-7b53-4dc0-8c31-5c2951dcf815 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:24.577942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d98015f-7b53-4dc0-8c31-5c2951dcf815 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.578429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d98015f-7b53-4dc0-8c31-5c2951dcf815 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.578864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d98015f-7b53-4dc0-8c31-5c2951dcf815 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.579627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d98015f-7b53-4dc0-8c31-5c2951dcf815 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.580077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d98015f-7b53-4dc0-8c31-5c2951dcf815 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.580488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d98015f-7b53-4dc0-8c31-5c2951dcf815 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.611941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7d98015f-7b53-4dc0-8c31-5c2951dcf815 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047401 Aug 31 00:40:24.612519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 678/1282] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:25.574866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c32bf3af-b966-47a7-844d-accabdfd72d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:25.577082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c32bf3af-b966-47a7-844d-accabdfd72d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:25.588610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c32bf3af-b966-47a7-844d-accabdfd72d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:25.589095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c32bf3af-b966-47a7-844d-accabdfd72d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:25.589559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c32bf3af-b966-47a7-844d-accabdfd72d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:25.590914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c32bf3af-b966-47a7-844d-accabdfd72d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:25.592019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c32bf3af-b966-47a7-844d-accabdfd72d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:25.592443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c32bf3af-b966-47a7-844d-accabdfd72d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:25.624109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-14c16eb1-1352-4ef1-b3bc-16e66b37419f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:25.626228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-14c16eb1-1352-4ef1-b3bc-16e66b37419f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:25.632686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c16eb1-1352-4ef1-b3bc-16e66b37419f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:25.633176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c16eb1-1352-4ef1-b3bc-16e66b37419f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:25.633612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c16eb1-1352-4ef1-b3bc-16e66b37419f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:25.634309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c16eb1-1352-4ef1-b3bc-16e66b37419f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:25.634758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c16eb1-1352-4ef1-b3bc-16e66b37419f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:25.635248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14c16eb1-1352-4ef1-b3bc-16e66b37419f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:25.637810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c32bf3af-b966-47a7-844d-accabdfd72d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066943 Aug 31 00:40:25.638593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 605/1283] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:25.671011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-14c16eb1-1352-4ef1-b3bc-16e66b37419f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051338 Aug 31 00:40:25.671881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 679/1284] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:26.652720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-70f00f0e-aaec-4038-921b-e05c74d520a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:26.655117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-70f00f0e-aaec-4038-921b-e05c74d520a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:26.663842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70f00f0e-aaec-4038-921b-e05c74d520a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.664321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70f00f0e-aaec-4038-921b-e05c74d520a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.664750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70f00f0e-aaec-4038-921b-e05c74d520a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.665439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70f00f0e-aaec-4038-921b-e05c74d520a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.665876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70f00f0e-aaec-4038-921b-e05c74d520a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.666289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-70f00f0e-aaec-4038-921b-e05c74d520a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.683376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3fb88670-186a-471d-8d29-efbe582e999f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:26.686568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3fb88670-186a-471d-8d29-efbe582e999f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:26.693044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3fb88670-186a-471d-8d29-efbe582e999f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.693527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3fb88670-186a-471d-8d29-efbe582e999f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.693965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3fb88670-186a-471d-8d29-efbe582e999f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.694664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3fb88670-186a-471d-8d29-efbe582e999f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.696735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3fb88670-186a-471d-8d29-efbe582e999f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.696735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3fb88670-186a-471d-8d29-efbe582e999f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.699657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-70f00f0e-aaec-4038-921b-e05c74d520a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052953 Aug 31 00:40:26.700595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 606/1285] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:26.729020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3fb88670-186a-471d-8d29-efbe582e999f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049623 Aug 31 00:40:26.729595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 680/1286] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:26 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:27.712234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e67c5144-9633-48b2-b5cb-8d5f7cd024c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:27.714323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e67c5144-9633-48b2-b5cb-8d5f7cd024c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:27.720802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e67c5144-9633-48b2-b5cb-8d5f7cd024c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.721259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e67c5144-9633-48b2-b5cb-8d5f7cd024c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.721682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e67c5144-9633-48b2-b5cb-8d5f7cd024c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.722351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e67c5144-9633-48b2-b5cb-8d5f7cd024c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.722790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e67c5144-9633-48b2-b5cb-8d5f7cd024c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.723246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e67c5144-9633-48b2-b5cb-8d5f7cd024c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.742075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c5abd195-4ec5-474d-988f-1a30e781ed78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:27.744223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c5abd195-4ec5-474d-988f-1a30e781ed78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:27.748183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=66 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:27.751626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5abd195-4ec5-474d-988f-1a30e781ed78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.752108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5abd195-4ec5-474d-988f-1a30e781ed78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.752538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5abd195-4ec5-474d-988f-1a30e781ed78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.753232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5abd195-4ec5-474d-988f-1a30e781ed78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.753678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5abd195-4ec5-474d-988f-1a30e781ed78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.753789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e67c5144-9633-48b2-b5cb-8d5f7cd024c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045462 Aug 31 00:40:27.754097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c5abd195-4ec5-474d-988f-1a30e781ed78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.754305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 607/1287] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:27.787722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c5abd195-4ec5-474d-988f-1a30e781ed78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049762 Aug 31 00:40:27.788303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 681/1288] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:27 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:28.766718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-505eb450-6bfc-4c86-964c-6b9e2fa4ffbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:28.768859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-505eb450-6bfc-4c86-964c-6b9e2fa4ffbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:28.775330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505eb450-6bfc-4c86-964c-6b9e2fa4ffbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.775808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505eb450-6bfc-4c86-964c-6b9e2fa4ffbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.776236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505eb450-6bfc-4c86-964c-6b9e2fa4ffbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:28.776917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505eb450-6bfc-4c86-964c-6b9e2fa4ffbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.778158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505eb450-6bfc-4c86-964c-6b9e2fa4ffbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.778590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505eb450-6bfc-4c86-964c-6b9e2fa4ffbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:28.799905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e460d5a5-e6b1-4e71-b8e7-074e30ad65eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:28.802061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e460d5a5-e6b1-4e71-b8e7-074e30ad65eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:28.808349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e460d5a5-e6b1-4e71-b8e7-074e30ad65eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.808791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-505eb450-6bfc-4c86-964c-6b9e2fa4ffbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046112 Aug 31 00:40:28.808918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e460d5a5-e6b1-4e71-b8e7-074e30ad65eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.809235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e460d5a5-e6b1-4e71-b8e7-074e30ad65eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:28.810106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 608/1289] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:28.810265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e460d5a5-e6b1-4e71-b8e7-074e30ad65eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.810494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e460d5a5-e6b1-4e71-b8e7-074e30ad65eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.810918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e460d5a5-e6b1-4e71-b8e7-074e30ad65eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:28.841818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e460d5a5-e6b1-4e71-b8e7-074e30ad65eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045783 Aug 31 00:40:28.842379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 682/1290] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:29.820792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8f1dee28-cd46-4076-bd11-6aa1826f46f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:29.822965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8f1dee28-cd46-4076-bd11-6aa1826f46f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:29.829630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f1dee28-cd46-4076-bd11-6aa1826f46f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.830112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f1dee28-cd46-4076-bd11-6aa1826f46f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.830536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f1dee28-cd46-4076-bd11-6aa1826f46f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.831252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f1dee28-cd46-4076-bd11-6aa1826f46f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.831692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f1dee28-cd46-4076-bd11-6aa1826f46f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.832096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f1dee28-cd46-4076-bd11-6aa1826f46f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.853949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bd8eda9e-935d-447b-9973-0d5c27579ea4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:29.857038 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bd8eda9e-935d-447b-9973-0d5c27579ea4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:29.863580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd8eda9e-935d-447b-9973-0d5c27579ea4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.864059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd8eda9e-935d-447b-9973-0d5c27579ea4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.864182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8f1dee28-cd46-4076-bd11-6aa1826f46f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047414 Aug 31 00:40:29.864489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd8eda9e-935d-447b-9973-0d5c27579ea4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.864729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 609/1291] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:29.865179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd8eda9e-935d-447b-9973-0d5c27579ea4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.865625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd8eda9e-935d-447b-9973-0d5c27579ea4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.866043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd8eda9e-935d-447b-9973-0d5c27579ea4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.896473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bd8eda9e-935d-447b-9973-0d5c27579ea4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046441 Aug 31 00:40:29.897302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 683/1292] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:30.877052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-09460872-b642-4bf5-b12f-e8e4ddf5175b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:30.879220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-09460872-b642-4bf5-b12f-e8e4ddf5175b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:30.885702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09460872-b642-4bf5-b12f-e8e4ddf5175b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:30.886180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09460872-b642-4bf5-b12f-e8e4ddf5175b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:30.887216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09460872-b642-4bf5-b12f-e8e4ddf5175b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:30.887991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09460872-b642-4bf5-b12f-e8e4ddf5175b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:30.888502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09460872-b642-4bf5-b12f-e8e4ddf5175b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:30.888916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09460872-b642-4bf5-b12f-e8e4ddf5175b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:30.909446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8799e887-2c8d-4312-b6d6-8aa07bd0e02e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:30.911625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8799e887-2c8d-4312-b6d6-8aa07bd0e02e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:30.918064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8799e887-2c8d-4312-b6d6-8aa07bd0e02e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:30.918520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8799e887-2c8d-4312-b6d6-8aa07bd0e02e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:30.918942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8799e887-2c8d-4312-b6d6-8aa07bd0e02e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:30.919660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8799e887-2c8d-4312-b6d6-8aa07bd0e02e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:30.920100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8799e887-2c8d-4312-b6d6-8aa07bd0e02e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:30.920293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-09460872-b642-4bf5-b12f-e8e4ddf5175b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047093 Aug 31 00:40:30.920515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8799e887-2c8d-4312-b6d6-8aa07bd0e02e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:30.920871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 610/1293] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:30.950947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8799e887-2c8d-4312-b6d6-8aa07bd0e02e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Aug 31 00:40:30.951541 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 684/1294] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:31.932538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-601d2aa8-5fc0-4fd7-a808-6113d4512c96 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:31.935474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-601d2aa8-5fc0-4fd7-a808-6113d4512c96 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:31.942172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-601d2aa8-5fc0-4fd7-a808-6113d4512c96 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.942647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-601d2aa8-5fc0-4fd7-a808-6113d4512c96 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.943175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-601d2aa8-5fc0-4fd7-a808-6113d4512c96 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.943914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-601d2aa8-5fc0-4fd7-a808-6113d4512c96 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.944392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-601d2aa8-5fc0-4fd7-a808-6113d4512c96 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.944872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-601d2aa8-5fc0-4fd7-a808-6113d4512c96 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.962742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f7849654-e894-45f1-b8b6-8f45261ca716 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:31.965097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f7849654-e894-45f1-b8b6-8f45261ca716 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:31.971739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7849654-e894-45f1-b8b6-8f45261ca716 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.972221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7849654-e894-45f1-b8b6-8f45261ca716 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.972651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7849654-e894-45f1-b8b6-8f45261ca716 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.973359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7849654-e894-45f1-b8b6-8f45261ca716 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.973789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7849654-e894-45f1-b8b6-8f45261ca716 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.974398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7849654-e894-45f1-b8b6-8f45261ca716 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.976274 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-601d2aa8-5fc0-4fd7-a808-6113d4512c96 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047701 Aug 31 00:40:31.976903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 611/1295] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:32.007559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f7849654-e894-45f1-b8b6-8f45261ca716 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048704 Aug 31 00:40:32.008131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 685/1296] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:32.989882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-757a04a1-afda-4ab7-b93a-9537322c6186 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:32.992168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-757a04a1-afda-4ab7-b93a-9537322c6186 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:32.999199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-757a04a1-afda-4ab7-b93a-9537322c6186 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:32.999678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-757a04a1-afda-4ab7-b93a-9537322c6186 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:33.000108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-757a04a1-afda-4ab7-b93a-9537322c6186 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:33.000800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-757a04a1-afda-4ab7-b93a-9537322c6186 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:33.001268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-757a04a1-afda-4ab7-b93a-9537322c6186 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:33.001657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-757a04a1-afda-4ab7-b93a-9537322c6186 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:33.020388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fc447339-bf81-4bbc-a007-6e4a121358bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:33.022933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fc447339-bf81-4bbc-a007-6e4a121358bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:33.030419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc447339-bf81-4bbc-a007-6e4a121358bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:33.030937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc447339-bf81-4bbc-a007-6e4a121358bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:33.031408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc447339-bf81-4bbc-a007-6e4a121358bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:33.032184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-757a04a1-afda-4ab7-b93a-9537322c6186 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046351 Aug 31 00:40:33.032404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc447339-bf81-4bbc-a007-6e4a121358bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:33.032842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 612/1297] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:33.033049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc447339-bf81-4bbc-a007-6e4a121358bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:33.033688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc447339-bf81-4bbc-a007-6e4a121358bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:33.040032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:33.077536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fc447339-bf81-4bbc-a007-6e4a121358bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061464 Aug 31 00:40:33.078425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 686/1298] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:33 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:34.044804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c479cb3-b31b-4e07-9485-abb05b716bc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.047003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c479cb3-b31b-4e07-9485-abb05b716bc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:34.053770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c479cb3-b31b-4e07-9485-abb05b716bc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:34.054290 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c479cb3-b31b-4e07-9485-abb05b716bc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:34.054716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c479cb3-b31b-4e07-9485-abb05b716bc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:34.055427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c479cb3-b31b-4e07-9485-abb05b716bc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:34.055911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c479cb3-b31b-4e07-9485-abb05b716bc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:34.056380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c479cb3-b31b-4e07-9485-abb05b716bc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:34.087286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c479cb3-b31b-4e07-9485-abb05b716bc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046668 Aug 31 00:40:34.087837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 613/1299] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:34.092295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a426ee00-a567-43d8-a337-35d0d5667fa2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.094521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a426ee00-a567-43d8-a337-35d0d5667fa2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:34.100921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a426ee00-a567-43d8-a337-35d0d5667fa2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:34.101401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a426ee00-a567-43d8-a337-35d0d5667fa2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:34.101834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a426ee00-a567-43d8-a337-35d0d5667fa2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:34.102531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a426ee00-a567-43d8-a337-35d0d5667fa2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:34.102983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a426ee00-a567-43d8-a337-35d0d5667fa2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:34.103433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a426ee00-a567-43d8-a337-35d0d5667fa2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:34.133196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a426ee00-a567-43d8-a337-35d0d5667fa2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045547 Aug 31 00:40:34.133770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 687/1300] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:34 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:35.100772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-00e51751-77a9-4dcd-b7ef-feade706e122 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:35.102930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-00e51751-77a9-4dcd-b7ef-feade706e122 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:35.109914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00e51751-77a9-4dcd-b7ef-feade706e122 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:35.110386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00e51751-77a9-4dcd-b7ef-feade706e122 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:35.110814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00e51751-77a9-4dcd-b7ef-feade706e122 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:35.111522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00e51751-77a9-4dcd-b7ef-feade706e122 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:35.111961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00e51751-77a9-4dcd-b7ef-feade706e122 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:35.112372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00e51751-77a9-4dcd-b7ef-feade706e122 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:35.142413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-00e51751-77a9-4dcd-b7ef-feade706e122 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045641 Aug 31 00:40:35.143075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 614/1301] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:35.145936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eb565976-8b2c-4ba6-afda-0151f42f8480 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:35.148106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eb565976-8b2c-4ba6-afda-0151f42f8480 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:35.155526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb565976-8b2c-4ba6-afda-0151f42f8480 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:35.156017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb565976-8b2c-4ba6-afda-0151f42f8480 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:35.156454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb565976-8b2c-4ba6-afda-0151f42f8480 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:35.157157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb565976-8b2c-4ba6-afda-0151f42f8480 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:35.157681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb565976-8b2c-4ba6-afda-0151f42f8480 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:35.158032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb565976-8b2c-4ba6-afda-0151f42f8480 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:35.189476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eb565976-8b2c-4ba6-afda-0151f42f8480 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047522 Aug 31 00:40:35.190047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 688/1302] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:36.155579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-48163478-e602-46eb-a525-c21c2cf868b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:36.157677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-48163478-e602-46eb-a525-c21c2cf868b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:36.163997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48163478-e602-46eb-a525-c21c2cf868b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:36.164469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48163478-e602-46eb-a525-c21c2cf868b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:36.164897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48163478-e602-46eb-a525-c21c2cf868b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:36.165571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48163478-e602-46eb-a525-c21c2cf868b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:36.166017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48163478-e602-46eb-a525-c21c2cf868b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:36.166432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48163478-e602-46eb-a525-c21c2cf868b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:36.183125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:36.197227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-48163478-e602-46eb-a525-c21c2cf868b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046273 Aug 31 00:40:36.198010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 615/1303] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:36.202300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8c44aa9b-6a91-4eed-b1d3-e210e43baed3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:36.204430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8c44aa9b-6a91-4eed-b1d3-e210e43baed3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:36.210725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c44aa9b-6a91-4eed-b1d3-e210e43baed3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:36.211249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c44aa9b-6a91-4eed-b1d3-e210e43baed3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:36.211685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c44aa9b-6a91-4eed-b1d3-e210e43baed3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:36.212372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c44aa9b-6a91-4eed-b1d3-e210e43baed3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:36.212844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c44aa9b-6a91-4eed-b1d3-e210e43baed3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:36.213266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c44aa9b-6a91-4eed-b1d3-e210e43baed3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:36.243374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8c44aa9b-6a91-4eed-b1d3-e210e43baed3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045433 Aug 31 00:40:36.243929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 689/1304] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:37.210904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1cc1b79f-be0a-4efb-9f1c-f1b21670fa58 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:37.213061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1cc1b79f-be0a-4efb-9f1c-f1b21670fa58 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:37.219714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cc1b79f-be0a-4efb-9f1c-f1b21670fa58 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.220191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cc1b79f-be0a-4efb-9f1c-f1b21670fa58 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.220619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cc1b79f-be0a-4efb-9f1c-f1b21670fa58 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.221347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cc1b79f-be0a-4efb-9f1c-f1b21670fa58 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.221743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cc1b79f-be0a-4efb-9f1c-f1b21670fa58 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.222161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cc1b79f-be0a-4efb-9f1c-f1b21670fa58 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.252951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1cc1b79f-be0a-4efb-9f1c-f1b21670fa58 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045938 Aug 31 00:40:37.253735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 616/1305] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:37.256013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5dc12c1a-1bd3-47c6-aa78-30ac1542174c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:37.258192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5dc12c1a-1bd3-47c6-aa78-30ac1542174c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:37.265270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc12c1a-1bd3-47c6-aa78-30ac1542174c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.265745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc12c1a-1bd3-47c6-aa78-30ac1542174c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.266173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc12c1a-1bd3-47c6-aa78-30ac1542174c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.266856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc12c1a-1bd3-47c6-aa78-30ac1542174c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.267367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc12c1a-1bd3-47c6-aa78-30ac1542174c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.267786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc12c1a-1bd3-47c6-aa78-30ac1542174c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.297128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5dc12c1a-1bd3-47c6-aa78-30ac1542174c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Aug 31 00:40:37.297675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 690/1306] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:37 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:38.264814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d38f9dfd-6c75-4066-99d2-c1c683d0dd54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:38.267062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d38f9dfd-6c75-4066-99d2-c1c683d0dd54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:38.273881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d38f9dfd-6c75-4066-99d2-c1c683d0dd54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.274390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d38f9dfd-6c75-4066-99d2-c1c683d0dd54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.274852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d38f9dfd-6c75-4066-99d2-c1c683d0dd54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.275816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d38f9dfd-6c75-4066-99d2-c1c683d0dd54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.276261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d38f9dfd-6c75-4066-99d2-c1c683d0dd54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.276678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d38f9dfd-6c75-4066-99d2-c1c683d0dd54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.307432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d38f9dfd-6c75-4066-99d2-c1c683d0dd54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046718 Aug 31 00:40:38.307983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 617/1307] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:38.309175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ea683e81-29cb-4803-8a66-efef9675521b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:38.311414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ea683e81-29cb-4803-8a66-efef9675521b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:38.317875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea683e81-29cb-4803-8a66-efef9675521b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.318411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea683e81-29cb-4803-8a66-efef9675521b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.318850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea683e81-29cb-4803-8a66-efef9675521b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.319621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea683e81-29cb-4803-8a66-efef9675521b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.320102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea683e81-29cb-4803-8a66-efef9675521b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.320765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea683e81-29cb-4803-8a66-efef9675521b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.351383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ea683e81-29cb-4803-8a66-efef9675521b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046075 Aug 31 00:40:38.351934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 691/1308] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:39.322679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1cdd0ae1-2494-4fad-9cc4-c183c328bb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:39.324921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1cdd0ae1-2494-4fad-9cc4-c183c328bb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:39.331910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ae1-2494-4fad-9cc4-c183c328bb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:39.332391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ae1-2494-4fad-9cc4-c183c328bb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:39.332819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ae1-2494-4fad-9cc4-c183c328bb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:39.333634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ae1-2494-4fad-9cc4-c183c328bb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:39.334083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ae1-2494-4fad-9cc4-c183c328bb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:39.334500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ae1-2494-4fad-9cc4-c183c328bb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:39.364035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3e624784-4903-42f9-85be-f664cd2edecc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:39.364801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1cdd0ae1-2494-4fad-9cc4-c183c328bb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046286 Aug 31 00:40:39.365372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 618/1309] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:39.366150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3e624784-4903-42f9-85be-f664cd2edecc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:39.373336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e624784-4903-42f9-85be-f664cd2edecc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:39.373854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e624784-4903-42f9-85be-f664cd2edecc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:39.374546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e624784-4903-42f9-85be-f664cd2edecc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:39.375290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e624784-4903-42f9-85be-f664cd2edecc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:39.375739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e624784-4903-42f9-85be-f664cd2edecc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:39.376151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e624784-4903-42f9-85be-f664cd2edecc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:39.408707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3e624784-4903-42f9-85be-f664cd2edecc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048606 Aug 31 00:40:39.409259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 692/1310] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:39 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:40.377636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-17950901-6b6e-4d10-afa5-2d198e725354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:40.380436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-17950901-6b6e-4d10-afa5-2d198e725354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:40.387149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17950901-6b6e-4d10-afa5-2d198e725354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.387636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17950901-6b6e-4d10-afa5-2d198e725354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.388134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17950901-6b6e-4d10-afa5-2d198e725354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.389210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17950901-6b6e-4d10-afa5-2d198e725354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.389657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17950901-6b6e-4d10-afa5-2d198e725354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.390075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17950901-6b6e-4d10-afa5-2d198e725354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.421953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-17950901-6b6e-4d10-afa5-2d198e725354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048737 Aug 31 00:40:40.422679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 619/1311] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:40.422842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ce09977a-0dd6-4dc6-9fee-52989822efe9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:40.424709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ce09977a-0dd6-4dc6-9fee-52989822efe9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:40.431130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce09977a-0dd6-4dc6-9fee-52989822efe9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.431649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce09977a-0dd6-4dc6-9fee-52989822efe9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.432076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce09977a-0dd6-4dc6-9fee-52989822efe9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.432752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce09977a-0dd6-4dc6-9fee-52989822efe9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.433191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce09977a-0dd6-4dc6-9fee-52989822efe9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.433602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ce09977a-0dd6-4dc6-9fee-52989822efe9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.464542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ce09977a-0dd6-4dc6-9fee-52989822efe9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047103 Aug 31 00:40:40.465103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 693/1312] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:41.433779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cdb7be65-f0b0-45e1-82cf-f73bd1df37a0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:41.436238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cdb7be65-f0b0-45e1-82cf-f73bd1df37a0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:41.442812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb7be65-f0b0-45e1-82cf-f73bd1df37a0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:41.443334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb7be65-f0b0-45e1-82cf-f73bd1df37a0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:41.443774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb7be65-f0b0-45e1-82cf-f73bd1df37a0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:41.444470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb7be65-f0b0-45e1-82cf-f73bd1df37a0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:41.444915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb7be65-f0b0-45e1-82cf-f73bd1df37a0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:41.445331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb7be65-f0b0-45e1-82cf-f73bd1df37a0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:41.477490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cdb7be65-f0b0-45e1-82cf-f73bd1df37a0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047570 Aug 31 00:40:41.477847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-563e642b-356e-4afd-a0a3-8da375a96cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:41.478332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 620/1313] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:40:41.479945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-563e642b-356e-4afd-a0a3-8da375a96cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:41.486845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-563e642b-356e-4afd-a0a3-8da375a96cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:41.487473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-563e642b-356e-4afd-a0a3-8da375a96cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:41.487915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-563e642b-356e-4afd-a0a3-8da375a96cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:41.488594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-563e642b-356e-4afd-a0a3-8da375a96cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:41.489037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-563e642b-356e-4afd-a0a3-8da375a96cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:41.489494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-563e642b-356e-4afd-a0a3-8da375a96cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:41.520549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-563e642b-356e-4afd-a0a3-8da375a96cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046467 Aug 31 00:40:41.521025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 694/1314] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:41 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:42.489920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1eac1999-17e5-4494-b840-5e6b3b4567e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:42.492076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1eac1999-17e5-4494-b840-5e6b3b4567e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:42.498993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eac1999-17e5-4494-b840-5e6b3b4567e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.499515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eac1999-17e5-4494-b840-5e6b3b4567e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.499953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eac1999-17e5-4494-b840-5e6b3b4567e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.500646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eac1999-17e5-4494-b840-5e6b3b4567e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.501097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eac1999-17e5-4494-b840-5e6b3b4567e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.501521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eac1999-17e5-4494-b840-5e6b3b4567e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.533907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-23ffe178-2093-49cb-9534-7b1c69b99521 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:42.536227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-23ffe178-2093-49cb-9534-7b1c69b99521 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:42.537334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1eac1999-17e5-4494-b840-5e6b3b4567e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051265 Aug 31 00:40:42.537917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 621/1315] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:42.542741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23ffe178-2093-49cb-9534-7b1c69b99521 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.543252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23ffe178-2093-49cb-9534-7b1c69b99521 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.543683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23ffe178-2093-49cb-9534-7b1c69b99521 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.544412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23ffe178-2093-49cb-9534-7b1c69b99521 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.545460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23ffe178-2093-49cb-9534-7b1c69b99521 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.545881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23ffe178-2093-49cb-9534-7b1c69b99521 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.575104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-23ffe178-2093-49cb-9534-7b1c69b99521 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046305 Aug 31 00:40:42.575650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 695/1316] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:42 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:43.550142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d29ab9a0-da83-472a-a85c-f20b1790b80c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:43.552370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d29ab9a0-da83-472a-a85c-f20b1790b80c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:43.558917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d29ab9a0-da83-472a-a85c-f20b1790b80c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:43.559424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d29ab9a0-da83-472a-a85c-f20b1790b80c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:43.559857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d29ab9a0-da83-472a-a85c-f20b1790b80c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:43.560534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d29ab9a0-da83-472a-a85c-f20b1790b80c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:43.561618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d29ab9a0-da83-472a-a85c-f20b1790b80c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:43.562039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d29ab9a0-da83-472a-a85c-f20b1790b80c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:43.587220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9978ef09-2c4f-4c29-b2e4-430ec7eb5fc5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:43.589358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9978ef09-2c4f-4c29-b2e4-430ec7eb5fc5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:43.592562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d29ab9a0-da83-472a-a85c-f20b1790b80c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046066 Aug 31 00:40:43.593427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 622/1317] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:43.596061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9978ef09-2c4f-4c29-b2e4-430ec7eb5fc5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:43.596604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9978ef09-2c4f-4c29-b2e4-430ec7eb5fc5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:43.597030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9978ef09-2c4f-4c29-b2e4-430ec7eb5fc5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:43.597717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9978ef09-2c4f-4c29-b2e4-430ec7eb5fc5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:43.598160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9978ef09-2c4f-4c29-b2e4-430ec7eb5fc5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:43.598575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9978ef09-2c4f-4c29-b2e4-430ec7eb5fc5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:43.630466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9978ef09-2c4f-4c29-b2e4-430ec7eb5fc5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047391 Aug 31 00:40:43.631019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 696/1318] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:44.605568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f387f652-6e32-4acc-8430-09d60e60a02a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:44.608765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f387f652-6e32-4acc-8430-09d60e60a02a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:44.616033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f387f652-6e32-4acc-8430-09d60e60a02a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.616539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f387f652-6e32-4acc-8430-09d60e60a02a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.617023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f387f652-6e32-4acc-8430-09d60e60a02a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.617763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f387f652-6e32-4acc-8430-09d60e60a02a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.618230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f387f652-6e32-4acc-8430-09d60e60a02a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.618647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f387f652-6e32-4acc-8430-09d60e60a02a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.642592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-57789d44-61a5-4aa5-9202-f68081b3c74c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:44.644738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-57789d44-61a5-4aa5-9202-f68081b3c74c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:44.651096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57789d44-61a5-4aa5-9202-f68081b3c74c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.651578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57789d44-61a5-4aa5-9202-f68081b3c74c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.652018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57789d44-61a5-4aa5-9202-f68081b3c74c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.652711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57789d44-61a5-4aa5-9202-f68081b3c74c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.652827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f387f652-6e32-4acc-8430-09d60e60a02a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051451 Aug 31 00:40:44.653154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57789d44-61a5-4aa5-9202-f68081b3c74c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.653395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 623/1319] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:44.653562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57789d44-61a5-4aa5-9202-f68081b3c74c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.683998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-57789d44-61a5-4aa5-9202-f68081b3c74c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045920 Aug 31 00:40:44.684560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 697/1320] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:45.666514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6d0c6851-7b79-4959-a87a-d5d18d94f871 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:45.668645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6d0c6851-7b79-4959-a87a-d5d18d94f871 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:45.674981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d0c6851-7b79-4959-a87a-d5d18d94f871 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:45.675502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d0c6851-7b79-4959-a87a-d5d18d94f871 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:45.675948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d0c6851-7b79-4959-a87a-d5d18d94f871 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:45.676605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d0c6851-7b79-4959-a87a-d5d18d94f871 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:45.677050 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d0c6851-7b79-4959-a87a-d5d18d94f871 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:45.677465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d0c6851-7b79-4959-a87a-d5d18d94f871 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:45.697031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6f9f5d45-94d3-4775-b5f8-3f29a9caec71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:45.699290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6f9f5d45-94d3-4775-b5f8-3f29a9caec71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:45.706737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9f5d45-94d3-4775-b5f8-3f29a9caec71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:45.707384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9f5d45-94d3-4775-b5f8-3f29a9caec71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:45.707858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9f5d45-94d3-4775-b5f8-3f29a9caec71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:45.708534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9f5d45-94d3-4775-b5f8-3f29a9caec71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:45.708986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9f5d45-94d3-4775-b5f8-3f29a9caec71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:45.709093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6d0c6851-7b79-4959-a87a-d5d18d94f871 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046777 Aug 31 00:40:45.709413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9f5d45-94d3-4775-b5f8-3f29a9caec71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:45.709677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 624/1321] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:45.739543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6f9f5d45-94d3-4775-b5f8-3f29a9caec71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046336 Aug 31 00:40:45.740104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 698/1322] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:46.721993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-246aaad2-3b63-47af-b377-d0b6bf424c57 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:46.724273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-246aaad2-3b63-47af-b377-d0b6bf424c57 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:46.730953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-246aaad2-3b63-47af-b377-d0b6bf424c57 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.731714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-246aaad2-3b63-47af-b377-d0b6bf424c57 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.732136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-246aaad2-3b63-47af-b377-d0b6bf424c57 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.732820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-246aaad2-3b63-47af-b377-d0b6bf424c57 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.733267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-246aaad2-3b63-47af-b377-d0b6bf424c57 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.734231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-246aaad2-3b63-47af-b377-d0b6bf424c57 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.752923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-281bee1b-52a0-41a8-a56c-5fba3df8a6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:46.755143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-281bee1b-52a0-41a8-a56c-5fba3df8a6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:46.761834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281bee1b-52a0-41a8-a56c-5fba3df8a6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.762305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281bee1b-52a0-41a8-a56c-5fba3df8a6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.764750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281bee1b-52a0-41a8-a56c-5fba3df8a6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.764750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281bee1b-52a0-41a8-a56c-5fba3df8a6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.764750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281bee1b-52a0-41a8-a56c-5fba3df8a6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.764750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-281bee1b-52a0-41a8-a56c-5fba3df8a6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.765340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-246aaad2-3b63-47af-b377-d0b6bf424c57 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047644 Aug 31 00:40:46.765921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 625/1323] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:46.795783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-281bee1b-52a0-41a8-a56c-5fba3df8a6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047668 Aug 31 00:40:46.797105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 699/1324] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:46 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:47.778061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4ff88e43-b697-4516-8012-e7207ae4c7ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:47.780246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4ff88e43-b697-4516-8012-e7207ae4c7ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:47.787448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ff88e43-b697-4516-8012-e7207ae4c7ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:47.787930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ff88e43-b697-4516-8012-e7207ae4c7ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:47.788360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ff88e43-b697-4516-8012-e7207ae4c7ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:47.789063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ff88e43-b697-4516-8012-e7207ae4c7ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:47.789517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ff88e43-b697-4516-8012-e7207ae4c7ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:47.789940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ff88e43-b697-4516-8012-e7207ae4c7ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:47.809044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f73a11e5-7145-4769-9153-378e4193b05c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:47.811352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f73a11e5-7145-4769-9153-378e4193b05c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:47.817987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73a11e5-7145-4769-9153-378e4193b05c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:47.818470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73a11e5-7145-4769-9153-378e4193b05c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:47.819049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73a11e5-7145-4769-9153-378e4193b05c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:47.819765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73a11e5-7145-4769-9153-378e4193b05c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:47.820224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73a11e5-7145-4769-9153-378e4193b05c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:47.820419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4ff88e43-b697-4516-8012-e7207ae4c7ba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046311 Aug 31 00:40:47.820641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73a11e5-7145-4769-9153-378e4193b05c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:47.820962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 626/1325] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:47.851140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f73a11e5-7145-4769-9153-378e4193b05c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046039 Aug 31 00:40:47.851704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 700/1326] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:47 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:48.832899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-13ec41ef-83b5-44a9-9461-c05ad994ecda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:48.835054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-13ec41ef-83b5-44a9-9461-c05ad994ecda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:48.841829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13ec41ef-83b5-44a9-9461-c05ad994ecda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:48.842268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13ec41ef-83b5-44a9-9461-c05ad994ecda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:48.842701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13ec41ef-83b5-44a9-9461-c05ad994ecda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:48.843515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13ec41ef-83b5-44a9-9461-c05ad994ecda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:48.844031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13ec41ef-83b5-44a9-9461-c05ad994ecda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:48.844433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13ec41ef-83b5-44a9-9461-c05ad994ecda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:48.864067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-26755f57-049d-4592-be9c-8310580cbadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:48.866343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-26755f57-049d-4592-be9c-8310580cbadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:48.872695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26755f57-049d-4592-be9c-8310580cbadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:48.873195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26755f57-049d-4592-be9c-8310580cbadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:48.873601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26755f57-049d-4592-be9c-8310580cbadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:48.874939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26755f57-049d-4592-be9c-8310580cbadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:48.875316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-13ec41ef-83b5-44a9-9461-c05ad994ecda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045679 Aug 31 00:40:48.875507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26755f57-049d-4592-be9c-8310580cbadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:48.875884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-26755f57-049d-4592-be9c-8310580cbadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:48.876087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 627/1327] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:48.905286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-26755f57-049d-4592-be9c-8310580cbadd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045186 Aug 31 00:40:48.906051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 701/1328] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:49.887950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93257797-5ea2-4267-9d9a-43786a726944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:49.890774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-93257797-5ea2-4267-9d9a-43786a726944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:49.897295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93257797-5ea2-4267-9d9a-43786a726944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:49.898060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93257797-5ea2-4267-9d9a-43786a726944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:49.898279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93257797-5ea2-4267-9d9a-43786a726944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:49.899060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93257797-5ea2-4267-9d9a-43786a726944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:49.899515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93257797-5ea2-4267-9d9a-43786a726944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:49.899931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93257797-5ea2-4267-9d9a-43786a726944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:49.917740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f215b150-5887-435a-bc50-4929a6044054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:49.919936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f215b150-5887-435a-bc50-4929a6044054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:49.926589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f215b150-5887-435a-bc50-4929a6044054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:49.927098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f215b150-5887-435a-bc50-4929a6044054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:49.927533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f215b150-5887-435a-bc50-4929a6044054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:49.928228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f215b150-5887-435a-bc50-4929a6044054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:49.928676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f215b150-5887-435a-bc50-4929a6044054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:49.929095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f215b150-5887-435a-bc50-4929a6044054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:49.930384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-93257797-5ea2-4267-9d9a-43786a726944 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046416 Aug 31 00:40:49.930943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 628/1329] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:49.956354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:49.962549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f215b150-5887-435a-bc50-4929a6044054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048733 Aug 31 00:40:49.963135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 702/1330] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:50.942627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a3fadfe5-2080-4912-a92f-60e872cefadf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:50.944798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a3fadfe5-2080-4912-a92f-60e872cefadf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:50.950919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe5-2080-4912-a92f-60e872cefadf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.951421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe5-2080-4912-a92f-60e872cefadf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.951854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe5-2080-4912-a92f-60e872cefadf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:50.952609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe5-2080-4912-a92f-60e872cefadf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.953046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe5-2080-4912-a92f-60e872cefadf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.953477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3fadfe5-2080-4912-a92f-60e872cefadf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:50.977526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6baf3eca-7f64-4f18-9602-9870ac788670 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:50.979684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6baf3eca-7f64-4f18-9602-9870ac788670 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:50.987125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6baf3eca-7f64-4f18-9602-9870ac788670 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.987397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a3fadfe5-2080-4912-a92f-60e872cefadf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048679 Aug 31 00:40:50.987603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6baf3eca-7f64-4f18-9602-9870ac788670 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.988019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6baf3eca-7f64-4f18-9602-9870ac788670 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:50.988266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 629/1331] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:50.988716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6baf3eca-7f64-4f18-9602-9870ac788670 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.989154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6baf3eca-7f64-4f18-9602-9870ac788670 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.989568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6baf3eca-7f64-4f18-9602-9870ac788670 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:51.020245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6baf3eca-7f64-4f18-9602-9870ac788670 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046955 Aug 31 00:40:51.020796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 703/1332] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:52.002031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4b909430-0d3f-408a-a5dc-a88bb22807d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:52.004191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4b909430-0d3f-408a-a5dc-a88bb22807d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:52.010631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b909430-0d3f-408a-a5dc-a88bb22807d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:52.011165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b909430-0d3f-408a-a5dc-a88bb22807d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:52.011598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b909430-0d3f-408a-a5dc-a88bb22807d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:52.012478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b909430-0d3f-408a-a5dc-a88bb22807d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:52.012935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b909430-0d3f-408a-a5dc-a88bb22807d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:52.013354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b909430-0d3f-408a-a5dc-a88bb22807d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:52.033426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7925c2e5-447d-4663-91ee-e0a1ec2b5287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:52.035910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7925c2e5-447d-4663-91ee-e0a1ec2b5287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:52.042313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7925c2e5-447d-4663-91ee-e0a1ec2b5287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:52.042862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7925c2e5-447d-4663-91ee-e0a1ec2b5287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:52.043589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7925c2e5-447d-4663-91ee-e0a1ec2b5287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:52.044377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7925c2e5-447d-4663-91ee-e0a1ec2b5287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:52.045025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7925c2e5-447d-4663-91ee-e0a1ec2b5287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:52.045742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7925c2e5-447d-4663-91ee-e0a1ec2b5287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:52.047834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4b909430-0d3f-408a-a5dc-a88bb22807d9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050233 Aug 31 00:40:52.048719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 630/1333] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:52.077850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7925c2e5-447d-4663-91ee-e0a1ec2b5287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048772 Aug 31 00:40:52.079100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 704/1334] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:53.060197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-02fd8d62-1afa-44e2-9ee7-9cfec303c5d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:53.062437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-02fd8d62-1afa-44e2-9ee7-9cfec303c5d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:53.069034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02fd8d62-1afa-44e2-9ee7-9cfec303c5d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:53.069527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02fd8d62-1afa-44e2-9ee7-9cfec303c5d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:53.069968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02fd8d62-1afa-44e2-9ee7-9cfec303c5d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:53.070673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02fd8d62-1afa-44e2-9ee7-9cfec303c5d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:53.071150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02fd8d62-1afa-44e2-9ee7-9cfec303c5d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:53.071589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-02fd8d62-1afa-44e2-9ee7-9cfec303c5d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:53.090989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6cb41bd1-96be-4c8e-a7ab-adb71865d63c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:53.094841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6cb41bd1-96be-4c8e-a7ab-adb71865d63c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:53.101063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cb41bd1-96be-4c8e-a7ab-adb71865d63c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:53.101550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cb41bd1-96be-4c8e-a7ab-adb71865d63c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:53.101986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cb41bd1-96be-4c8e-a7ab-adb71865d63c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:53.102685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cb41bd1-96be-4c8e-a7ab-adb71865d63c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:53.103012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-02fd8d62-1afa-44e2-9ee7-9cfec303c5d4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046856 Aug 31 00:40:53.103171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cb41bd1-96be-4c8e-a7ab-adb71865d63c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:53.103597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6cb41bd1-96be-4c8e-a7ab-adb71865d63c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:53.103757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 631/1335] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:53 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:53.135620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6cb41bd1-96be-4c8e-a7ab-adb71865d63c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048954 Aug 31 00:40:53.136187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 705/1336] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:53 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:54.116248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-63c485e8-436f-4d19-8af4-b7179a4b4cb5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:54.118411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-63c485e8-436f-4d19-8af4-b7179a4b4cb5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:54.125525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63c485e8-436f-4d19-8af4-b7179a4b4cb5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:54.125869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63c485e8-436f-4d19-8af4-b7179a4b4cb5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:54.126390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63c485e8-436f-4d19-8af4-b7179a4b4cb5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:54.127119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63c485e8-436f-4d19-8af4-b7179a4b4cb5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:54.127573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63c485e8-436f-4d19-8af4-b7179a4b4cb5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:54.127999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63c485e8-436f-4d19-8af4-b7179a4b4cb5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:54.131827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:54.148247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8ffba066-1f88-4693-ac16-c0d5ac8991bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:54.150853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8ffba066-1f88-4693-ac16-c0d5ac8991bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:54.158446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ffba066-1f88-4693-ac16-c0d5ac8991bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:54.158935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ffba066-1f88-4693-ac16-c0d5ac8991bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:54.159396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ffba066-1f88-4693-ac16-c0d5ac8991bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:54.160247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ffba066-1f88-4693-ac16-c0d5ac8991bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:54.160597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-63c485e8-436f-4d19-8af4-b7179a4b4cb5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048210 Aug 31 00:40:54.160837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ffba066-1f88-4693-ac16-c0d5ac8991bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:54.161113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ffba066-1f88-4693-ac16-c0d5ac8991bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:54.161562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 632/1337] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:54.191840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8ffba066-1f88-4693-ac16-c0d5ac8991bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047711 Aug 31 00:40:54.192392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 706/1338] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:54 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:55.173508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5fc6f5f8-591c-48a7-83cb-98970b339e33 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:55.177234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5fc6f5f8-591c-48a7-83cb-98970b339e33 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:55.179609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=58 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:55.184671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fc6f5f8-591c-48a7-83cb-98970b339e33 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:55.185177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fc6f5f8-591c-48a7-83cb-98970b339e33 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:55.185603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fc6f5f8-591c-48a7-83cb-98970b339e33 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:55.186280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fc6f5f8-591c-48a7-83cb-98970b339e33 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:55.186725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fc6f5f8-591c-48a7-83cb-98970b339e33 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:55.187724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5fc6f5f8-591c-48a7-83cb-98970b339e33 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:55.206015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a23f01d8-649b-4a76-8cb7-7f618396e723 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:55.209246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a23f01d8-649b-4a76-8cb7-7f618396e723 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:55.215603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a23f01d8-649b-4a76-8cb7-7f618396e723 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:55.216088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a23f01d8-649b-4a76-8cb7-7f618396e723 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:55.216523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a23f01d8-649b-4a76-8cb7-7f618396e723 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:55.217247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a23f01d8-649b-4a76-8cb7-7f618396e723 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:55.217870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a23f01d8-649b-4a76-8cb7-7f618396e723 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:55.218287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a23f01d8-649b-4a76-8cb7-7f618396e723 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:55.220823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5fc6f5f8-591c-48a7-83cb-98970b339e33 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051788 Aug 31 00:40:55.221387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 633/1339] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:55.251372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a23f01d8-649b-4a76-8cb7-7f618396e723 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050586 Aug 31 00:40:55.251862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 707/1340] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:55 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:56.233355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5f558f0a-d248-4ce8-8580-693ee9ca8ef5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:56.236353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5f558f0a-d248-4ce8-8580-693ee9ca8ef5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:56.243516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f558f0a-d248-4ce8-8580-693ee9ca8ef5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.244073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f558f0a-d248-4ce8-8580-693ee9ca8ef5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.244506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f558f0a-d248-4ce8-8580-693ee9ca8ef5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.245186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f558f0a-d248-4ce8-8580-693ee9ca8ef5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.245630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f558f0a-d248-4ce8-8580-693ee9ca8ef5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.246043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f558f0a-d248-4ce8-8580-693ee9ca8ef5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.265537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b8c9288f-bcb1-4be8-a241-c38285365a54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:56.269970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b8c9288f-bcb1-4be8-a241-c38285365a54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:56.279299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c9288f-bcb1-4be8-a241-c38285365a54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.279881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5f558f0a-d248-4ce8-8580-693ee9ca8ef5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050653 Aug 31 00:40:56.280279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c9288f-bcb1-4be8-a241-c38285365a54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.281984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c9288f-bcb1-4be8-a241-c38285365a54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.283151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c9288f-bcb1-4be8-a241-c38285365a54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.284157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c9288f-bcb1-4be8-a241-c38285365a54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.284816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c9288f-bcb1-4be8-a241-c38285365a54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.286430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 634/1341] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:56.318715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b8c9288f-bcb1-4be8-a241-c38285365a54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059248 Aug 31 00:40:56.319301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 708/1342] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:57.293440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1ad3908c-d500-4290-b6b2-17e12b892f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:57.295629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1ad3908c-d500-4290-b6b2-17e12b892f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:57.303063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad3908c-d500-4290-b6b2-17e12b892f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:57.303554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad3908c-d500-4290-b6b2-17e12b892f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:57.303985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad3908c-d500-4290-b6b2-17e12b892f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:57.304668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad3908c-d500-4290-b6b2-17e12b892f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:57.305117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad3908c-d500-4290-b6b2-17e12b892f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:57.305536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad3908c-d500-4290-b6b2-17e12b892f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:57.330327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cc91baf1-67a2-476d-9567-dc8238d62113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:57.332483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cc91baf1-67a2-476d-9567-dc8238d62113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:57.339468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc91baf1-67a2-476d-9567-dc8238d62113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:57.339706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1ad3908c-d500-4290-b6b2-17e12b892f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049670 Aug 31 00:40:57.339964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc91baf1-67a2-476d-9567-dc8238d62113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:57.340256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 635/1343] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:57.340719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc91baf1-67a2-476d-9567-dc8238d62113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:57.341807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc91baf1-67a2-476d-9567-dc8238d62113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:57.342091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc91baf1-67a2-476d-9567-dc8238d62113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:57.342367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc91baf1-67a2-476d-9567-dc8238d62113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:57.375711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cc91baf1-67a2-476d-9567-dc8238d62113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049655 Aug 31 00:40:57.376503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 709/1344] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:58.355220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1234ae69-8290-4a22-9699-c89d4aa80287 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:58.357600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1234ae69-8290-4a22-9699-c89d4aa80287 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:58.365705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1234ae69-8290-4a22-9699-c89d4aa80287 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:58.366183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1234ae69-8290-4a22-9699-c89d4aa80287 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:58.366611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1234ae69-8290-4a22-9699-c89d4aa80287 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:58.367321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1234ae69-8290-4a22-9699-c89d4aa80287 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:58.367768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1234ae69-8290-4a22-9699-c89d4aa80287 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:58.368188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1234ae69-8290-4a22-9699-c89d4aa80287 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:58.392764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e1831ae5-43c3-4199-be2b-9faa5a4ef538 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:58.396874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e1831ae5-43c3-4199-be2b-9faa5a4ef538 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:58.405878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:40:58.405878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:40:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments (ip 10.222.0.67) !!! Aug 31 00:40:58.408961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1234ae69-8290-4a22-9699-c89d4aa80287 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059227 Aug 31 00:40:58.409291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=58 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:58.409913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 636/1345] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:58.417229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1831ae5-43c3-4199-be2b-9faa5a4ef538 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:58.417829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1831ae5-43c3-4199-be2b-9faa5a4ef538 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:58.418386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1831ae5-43c3-4199-be2b-9faa5a4ef538 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:58.419271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1831ae5-43c3-4199-be2b-9faa5a4ef538 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:58.419811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1831ae5-43c3-4199-be2b-9faa5a4ef538 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:58.420356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1831ae5-43c3-4199-be2b-9faa5a4ef538 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:58.461287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e1831ae5-43c3-4199-be2b-9faa5a4ef538 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076409 Aug 31 00:40:58.461844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 710/1346] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:59.474771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5339f3e7-62ac-4dbf-ac94-0a039f73a6f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:59.477068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5339f3e7-62ac-4dbf-ac94-0a039f73a6f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:59.484231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5339f3e7-62ac-4dbf-ac94-0a039f73a6f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:59.484715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5339f3e7-62ac-4dbf-ac94-0a039f73a6f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:59.485156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5339f3e7-62ac-4dbf-ac94-0a039f73a6f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:59.485853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5339f3e7-62ac-4dbf-ac94-0a039f73a6f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:59.486362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5339f3e7-62ac-4dbf-ac94-0a039f73a6f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:59.486720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5339f3e7-62ac-4dbf-ac94-0a039f73a6f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:59.519066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5339f3e7-62ac-4dbf-ac94-0a039f73a6f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049385 Aug 31 00:40:59.519651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 711/1347] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:59.551430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b3cf8e01-0c6f-4624-a245-873d4ddb9601 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:59.553796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b3cf8e01-0c6f-4624-a245-873d4ddb9601 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:59.559872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e01-0c6f-4624-a245-873d4ddb9601 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:59.560394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e01-0c6f-4624-a245-873d4ddb9601 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:59.560867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e01-0c6f-4624-a245-873d4ddb9601 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:59.561546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e01-0c6f-4624-a245-873d4ddb9601 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:59.562645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e01-0c6f-4624-a245-873d4ddb9601 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:59.563432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e01-0c6f-4624-a245-873d4ddb9601 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:59.593897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b3cf8e01-0c6f-4624-a245-873d4ddb9601 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.173684 Aug 31 00:40:59.594733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 637/1348] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:40:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:00.531987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-644fb237-269f-4e54-9a87-996e00c5aa04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:00.534201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-644fb237-269f-4e54-9a87-996e00c5aa04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:00.540864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-644fb237-269f-4e54-9a87-996e00c5aa04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:00.541355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-644fb237-269f-4e54-9a87-996e00c5aa04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:00.541791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-644fb237-269f-4e54-9a87-996e00c5aa04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:00.542497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-644fb237-269f-4e54-9a87-996e00c5aa04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:00.542952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-644fb237-269f-4e54-9a87-996e00c5aa04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:00.543397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-644fb237-269f-4e54-9a87-996e00c5aa04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:00.576611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-644fb237-269f-4e54-9a87-996e00c5aa04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049063 Aug 31 00:41:00.577172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 712/1349] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:00.609060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-651cb39a-3a0e-42c4-bcdc-50558f81d281 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:00.611935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-651cb39a-3a0e-42c4-bcdc-50558f81d281 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:00.618763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-651cb39a-3a0e-42c4-bcdc-50558f81d281 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:00.619259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-651cb39a-3a0e-42c4-bcdc-50558f81d281 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:00.619688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-651cb39a-3a0e-42c4-bcdc-50558f81d281 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:00.620366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-651cb39a-3a0e-42c4-bcdc-50558f81d281 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:00.620922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-651cb39a-3a0e-42c4-bcdc-50558f81d281 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:00.621338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-651cb39a-3a0e-42c4-bcdc-50558f81d281 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:00.664227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-651cb39a-3a0e-42c4-bcdc-50558f81d281 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061967 Aug 31 00:41:00.664799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 638/1350] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:01.589927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c9ad56be-ceb3-4752-afa5-a5a4ffd28e18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:01.592117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c9ad56be-ceb3-4752-afa5-a5a4ffd28e18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:01.598740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9ad56be-ceb3-4752-afa5-a5a4ffd28e18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:01.599279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9ad56be-ceb3-4752-afa5-a5a4ffd28e18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:01.599717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9ad56be-ceb3-4752-afa5-a5a4ffd28e18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:01.600426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9ad56be-ceb3-4752-afa5-a5a4ffd28e18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:01.600879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9ad56be-ceb3-4752-afa5-a5a4ffd28e18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:01.601303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c9ad56be-ceb3-4752-afa5-a5a4ffd28e18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:01.633488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c9ad56be-ceb3-4752-afa5-a5a4ffd28e18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047499 Aug 31 00:41:01.634052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 713/1351] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:01.677781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-32027856-6177-4b15-9337-e42f518b62b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:01.680732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-32027856-6177-4b15-9337-e42f518b62b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:01.689136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32027856-6177-4b15-9337-e42f518b62b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:01.689621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32027856-6177-4b15-9337-e42f518b62b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:01.690052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32027856-6177-4b15-9337-e42f518b62b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:01.690803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32027856-6177-4b15-9337-e42f518b62b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:01.691250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32027856-6177-4b15-9337-e42f518b62b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:01.691668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32027856-6177-4b15-9337-e42f518b62b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:01.722533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-32027856-6177-4b15-9337-e42f518b62b9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048822 Aug 31 00:41:01.723115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 639/1352] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:02.646489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ebce17f3-dadf-4387-94d9-f3347941a38e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:02.648643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ebce17f3-dadf-4387-94d9-f3347941a38e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:02.655394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebce17f3-dadf-4387-94d9-f3347941a38e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:02.656048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebce17f3-dadf-4387-94d9-f3347941a38e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:02.656475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebce17f3-dadf-4387-94d9-f3347941a38e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:02.657202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebce17f3-dadf-4387-94d9-f3347941a38e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:02.657655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebce17f3-dadf-4387-94d9-f3347941a38e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:02.658075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebce17f3-dadf-4387-94d9-f3347941a38e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:02.690061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ebce17f3-dadf-4387-94d9-f3347941a38e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047518 Aug 31 00:41:02.690769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 714/1353] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:02.736735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-92e4426e-dca2-4714-885d-49b4afb3accd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:02.738857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-92e4426e-dca2-4714-885d-49b4afb3accd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:02.745886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92e4426e-dca2-4714-885d-49b4afb3accd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:02.746392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92e4426e-dca2-4714-885d-49b4afb3accd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:02.746837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92e4426e-dca2-4714-885d-49b4afb3accd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:02.747606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92e4426e-dca2-4714-885d-49b4afb3accd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:02.748062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92e4426e-dca2-4714-885d-49b4afb3accd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:02.748485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92e4426e-dca2-4714-885d-49b4afb3accd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:02.783956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-92e4426e-dca2-4714-885d-49b4afb3accd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052469 Aug 31 00:41:02.784535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 640/1354] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:03.702263 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-731b5a40-cdcf-45fd-b935-ad0c1a6dc148 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:03.704429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-731b5a40-cdcf-45fd-b935-ad0c1a6dc148 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:03.711262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731b5a40-cdcf-45fd-b935-ad0c1a6dc148 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:03.711754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731b5a40-cdcf-45fd-b935-ad0c1a6dc148 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:03.712192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731b5a40-cdcf-45fd-b935-ad0c1a6dc148 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:03.713512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731b5a40-cdcf-45fd-b935-ad0c1a6dc148 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:03.713980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731b5a40-cdcf-45fd-b935-ad0c1a6dc148 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:03.714406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731b5a40-cdcf-45fd-b935-ad0c1a6dc148 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:03.749840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-731b5a40-cdcf-45fd-b935-ad0c1a6dc148 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051361 Aug 31 00:41:03.750400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 715/1355] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:03.796534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dbbfd8a2-662f-44c5-91c0-86e2c2df946a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:03.798697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dbbfd8a2-662f-44c5-91c0-86e2c2df946a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:03.800809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:41:03.800944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:41:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments (ip 10.222.0.67) !!! Aug 31 00:41:03.808003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbbfd8a2-662f-44c5-91c0-86e2c2df946a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:03.808485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbbfd8a2-662f-44c5-91c0-86e2c2df946a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:03.808914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbbfd8a2-662f-44c5-91c0-86e2c2df946a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:03.809637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbbfd8a2-662f-44c5-91c0-86e2c2df946a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:03.810082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbbfd8a2-662f-44c5-91c0-86e2c2df946a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:03.810502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbbfd8a2-662f-44c5-91c0-86e2c2df946a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:03.844136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dbbfd8a2-662f-44c5-91c0-86e2c2df946a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051066 Aug 31 00:41:03.844715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 641/1356] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:04.762060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c7ed47d2-794c-4717-beb9-f8c2676c9dac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:04.764235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c7ed47d2-794c-4717-beb9-f8c2676c9dac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:04.771104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ed47d2-794c-4717-beb9-f8c2676c9dac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:04.771598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ed47d2-794c-4717-beb9-f8c2676c9dac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:04.772116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ed47d2-794c-4717-beb9-f8c2676c9dac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:04.773050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ed47d2-794c-4717-beb9-f8c2676c9dac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:04.773610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ed47d2-794c-4717-beb9-f8c2676c9dac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:04.774239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ed47d2-794c-4717-beb9-f8c2676c9dac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:04.808622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c7ed47d2-794c-4717-beb9-f8c2676c9dac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050480 Aug 31 00:41:04.809204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 716/1357] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:04.856546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bba1192d-c2c3-4fc6-8d91-1af6059ca388 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:04.858748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bba1192d-c2c3-4fc6-8d91-1af6059ca388 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:04.865835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba1192d-c2c3-4fc6-8d91-1af6059ca388 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:04.866313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba1192d-c2c3-4fc6-8d91-1af6059ca388 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:04.866745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba1192d-c2c3-4fc6-8d91-1af6059ca388 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:04.867447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba1192d-c2c3-4fc6-8d91-1af6059ca388 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:04.867893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba1192d-c2c3-4fc6-8d91-1af6059ca388 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:04.868315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba1192d-c2c3-4fc6-8d91-1af6059ca388 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:04.899623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bba1192d-c2c3-4fc6-8d91-1af6059ca388 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047155 Aug 31 00:41:04.900192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 642/1358] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:05.820990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5bbe9e01-b44d-4811-8427-89e65b8ecaa0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:05.823180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5bbe9e01-b44d-4811-8427-89e65b8ecaa0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:05.830744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bbe9e01-b44d-4811-8427-89e65b8ecaa0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:05.831491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bbe9e01-b44d-4811-8427-89e65b8ecaa0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:05.831622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bbe9e01-b44d-4811-8427-89e65b8ecaa0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:05.832293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bbe9e01-b44d-4811-8427-89e65b8ecaa0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:05.832744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bbe9e01-b44d-4811-8427-89e65b8ecaa0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:05.833170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bbe9e01-b44d-4811-8427-89e65b8ecaa0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:05.869095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5bbe9e01-b44d-4811-8427-89e65b8ecaa0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052029 Aug 31 00:41:05.869943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 717/1359] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:05.911980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be82a37e-ca7a-4896-b157-49d0db96b3d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:05.914128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-be82a37e-ca7a-4896-b157-49d0db96b3d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:05.920677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be82a37e-ca7a-4896-b157-49d0db96b3d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:05.921147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be82a37e-ca7a-4896-b157-49d0db96b3d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:05.921600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be82a37e-ca7a-4896-b157-49d0db96b3d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:05.922272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be82a37e-ca7a-4896-b157-49d0db96b3d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:05.922820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be82a37e-ca7a-4896-b157-49d0db96b3d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:05.923364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be82a37e-ca7a-4896-b157-49d0db96b3d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:05.953577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-be82a37e-ca7a-4896-b157-49d0db96b3d0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045725 Aug 31 00:41:05.954881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 643/1360] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:06.881817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c878d876-18e9-440b-b5b5-acd7ab95d615 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:06.884155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c878d876-18e9-440b-b5b5-acd7ab95d615 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:06.892601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c878d876-18e9-440b-b5b5-acd7ab95d615 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:06.893184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c878d876-18e9-440b-b5b5-acd7ab95d615 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:06.893752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c878d876-18e9-440b-b5b5-acd7ab95d615 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:06.894696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c878d876-18e9-440b-b5b5-acd7ab95d615 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:06.895188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c878d876-18e9-440b-b5b5-acd7ab95d615 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:06.896139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c878d876-18e9-440b-b5b5-acd7ab95d615 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:06.928985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c878d876-18e9-440b-b5b5-acd7ab95d615 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051138 Aug 31 00:41:06.929597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 718/1361] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:06.965700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-449780fd-6f81-4fc9-9c0c-681b46ad780f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:06.967918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-449780fd-6f81-4fc9-9c0c-681b46ad780f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:06.975183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449780fd-6f81-4fc9-9c0c-681b46ad780f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:06.975674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449780fd-6f81-4fc9-9c0c-681b46ad780f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:06.976103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449780fd-6f81-4fc9-9c0c-681b46ad780f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:06.976798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449780fd-6f81-4fc9-9c0c-681b46ad780f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:06.977239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449780fd-6f81-4fc9-9c0c-681b46ad780f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:06.977657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449780fd-6f81-4fc9-9c0c-681b46ad780f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:07.007500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-449780fd-6f81-4fc9-9c0c-681b46ad780f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045659 Aug 31 00:41:07.008064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 644/1362] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:07.942126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-73ba9e90-4459-4809-84bf-98f91bbeaffd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:07.944267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-73ba9e90-4459-4809-84bf-98f91bbeaffd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:07.950674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73ba9e90-4459-4809-84bf-98f91bbeaffd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:07.951174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73ba9e90-4459-4809-84bf-98f91bbeaffd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:07.951608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73ba9e90-4459-4809-84bf-98f91bbeaffd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:07.952293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73ba9e90-4459-4809-84bf-98f91bbeaffd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:07.952738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73ba9e90-4459-4809-84bf-98f91bbeaffd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:07.953155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73ba9e90-4459-4809-84bf-98f91bbeaffd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:07.970894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:07.985291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-73ba9e90-4459-4809-84bf-98f91bbeaffd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047524 Aug 31 00:41:07.985870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 719/1363] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:08.020399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-418bffb7-986d-4645-8b31-9234d5f2f973 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:08.022502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-418bffb7-986d-4645-8b31-9234d5f2f973 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:08.028917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-418bffb7-986d-4645-8b31-9234d5f2f973 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:08.029392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-418bffb7-986d-4645-8b31-9234d5f2f973 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:08.029826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-418bffb7-986d-4645-8b31-9234d5f2f973 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:08.030500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-418bffb7-986d-4645-8b31-9234d5f2f973 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:08.030944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-418bffb7-986d-4645-8b31-9234d5f2f973 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:08.031386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-418bffb7-986d-4645-8b31-9234d5f2f973 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:08.062275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-418bffb7-986d-4645-8b31-9234d5f2f973 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046433 Aug 31 00:41:08.062844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 645/1364] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:08.997886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aec91483-2bbe-4684-b2ad-2294fe795e78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:09.000022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aec91483-2bbe-4684-b2ad-2294fe795e78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:09.006976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aec91483-2bbe-4684-b2ad-2294fe795e78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:09.007479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aec91483-2bbe-4684-b2ad-2294fe795e78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:09.007903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aec91483-2bbe-4684-b2ad-2294fe795e78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:09.008573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aec91483-2bbe-4684-b2ad-2294fe795e78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:09.009014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aec91483-2bbe-4684-b2ad-2294fe795e78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:09.009426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aec91483-2bbe-4684-b2ad-2294fe795e78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:09.039459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aec91483-2bbe-4684-b2ad-2294fe795e78 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Aug 31 00:41:09.040020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 720/1365] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:09.074354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c79a6f56-5447-4cba-87f3-3273a31107f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:09.076565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c79a6f56-5447-4cba-87f3-3273a31107f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:09.083125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c79a6f56-5447-4cba-87f3-3273a31107f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:09.083618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c79a6f56-5447-4cba-87f3-3273a31107f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:09.084054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c79a6f56-5447-4cba-87f3-3273a31107f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:09.084759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c79a6f56-5447-4cba-87f3-3273a31107f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:09.085210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c79a6f56-5447-4cba-87f3-3273a31107f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:09.085636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c79a6f56-5447-4cba-87f3-3273a31107f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:09.119755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c79a6f56-5447-4cba-87f3-3273a31107f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049430 Aug 31 00:41:09.120356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 646/1366] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:10.052867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-63628af5-ba6c-4d6c-860b-580a5e1d2ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:10.055072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-63628af5-ba6c-4d6c-860b-580a5e1d2ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:10.061464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63628af5-ba6c-4d6c-860b-580a5e1d2ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:10.061948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63628af5-ba6c-4d6c-860b-580a5e1d2ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:10.062384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63628af5-ba6c-4d6c-860b-580a5e1d2ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:10.063092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63628af5-ba6c-4d6c-860b-580a5e1d2ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:10.063866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63628af5-ba6c-4d6c-860b-580a5e1d2ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:10.064420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63628af5-ba6c-4d6c-860b-580a5e1d2ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:10.095900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-63628af5-ba6c-4d6c-860b-580a5e1d2ef0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046899 Aug 31 00:41:10.096439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 721/1367] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:10.132893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-796ca12c-d1a6-4801-8cce-288ffd1cc134 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:10.135057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-796ca12c-d1a6-4801-8cce-288ffd1cc134 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:10.141382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-796ca12c-d1a6-4801-8cce-288ffd1cc134 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:10.142509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-796ca12c-d1a6-4801-8cce-288ffd1cc134 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:10.142965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-796ca12c-d1a6-4801-8cce-288ffd1cc134 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:10.143700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-796ca12c-d1a6-4801-8cce-288ffd1cc134 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:10.144186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-796ca12c-d1a6-4801-8cce-288ffd1cc134 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:10.144602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-796ca12c-d1a6-4801-8cce-288ffd1cc134 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:10.174010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-796ca12c-d1a6-4801-8cce-288ffd1cc134 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044917 Aug 31 00:41:10.174556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 647/1368] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:11.108684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4e234137-ec71-4fdc-9e09-38245fc666e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:11.111114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4e234137-ec71-4fdc-9e09-38245fc666e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:11.117506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e234137-ec71-4fdc-9e09-38245fc666e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:11.117988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e234137-ec71-4fdc-9e09-38245fc666e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:11.118423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e234137-ec71-4fdc-9e09-38245fc666e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:11.119139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e234137-ec71-4fdc-9e09-38245fc666e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:11.119595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e234137-ec71-4fdc-9e09-38245fc666e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:11.120019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e234137-ec71-4fdc-9e09-38245fc666e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:11.151246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4e234137-ec71-4fdc-9e09-38245fc666e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046710 Aug 31 00:41:11.151820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 722/1369] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:11.188054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bc0db8f4-eaaa-4684-8552-bcfea71ac992 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:11.191577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bc0db8f4-eaaa-4684-8552-bcfea71ac992 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:11.197932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc0db8f4-eaaa-4684-8552-bcfea71ac992 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:11.198405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc0db8f4-eaaa-4684-8552-bcfea71ac992 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:11.198835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc0db8f4-eaaa-4684-8552-bcfea71ac992 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:11.199550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc0db8f4-eaaa-4684-8552-bcfea71ac992 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:11.200000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc0db8f4-eaaa-4684-8552-bcfea71ac992 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:11.200416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc0db8f4-eaaa-4684-8552-bcfea71ac992 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:11.225846 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:11.231623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bc0db8f4-eaaa-4684-8552-bcfea71ac992 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047230 Aug 31 00:41:11.232222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 648/1370] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:12.164720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-53443691-1ee7-4be8-824e-06d46c55d23a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:12.166962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-53443691-1ee7-4be8-824e-06d46c55d23a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:12.173374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53443691-1ee7-4be8-824e-06d46c55d23a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:12.173855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53443691-1ee7-4be8-824e-06d46c55d23a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:12.174291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53443691-1ee7-4be8-824e-06d46c55d23a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:12.175284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53443691-1ee7-4be8-824e-06d46c55d23a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:12.175754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53443691-1ee7-4be8-824e-06d46c55d23a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:12.176173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53443691-1ee7-4be8-824e-06d46c55d23a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:12.206694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-53443691-1ee7-4be8-824e-06d46c55d23a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Aug 31 00:41:12.207296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 723/1371] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:12.245445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-df0086d0-0a1d-4956-98fe-c05b5368ba77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:12.247666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-df0086d0-0a1d-4956-98fe-c05b5368ba77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:12.255115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df0086d0-0a1d-4956-98fe-c05b5368ba77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:12.255600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df0086d0-0a1d-4956-98fe-c05b5368ba77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:12.256033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df0086d0-0a1d-4956-98fe-c05b5368ba77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:12.256720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df0086d0-0a1d-4956-98fe-c05b5368ba77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:12.257168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df0086d0-0a1d-4956-98fe-c05b5368ba77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:12.257587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-df0086d0-0a1d-4956-98fe-c05b5368ba77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:12.288352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-df0086d0-0a1d-4956-98fe-c05b5368ba77 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047197 Aug 31 00:41:12.288915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 649/1372] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:13.219114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1737f361-3d6b-4bef-86ce-5a2f779ad695 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:13.221543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1737f361-3d6b-4bef-86ce-5a2f779ad695 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:13.227962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1737f361-3d6b-4bef-86ce-5a2f779ad695 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:13.228438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1737f361-3d6b-4bef-86ce-5a2f779ad695 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:13.228873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1737f361-3d6b-4bef-86ce-5a2f779ad695 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:13.229557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1737f361-3d6b-4bef-86ce-5a2f779ad695 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:13.230005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1737f361-3d6b-4bef-86ce-5a2f779ad695 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:13.230423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1737f361-3d6b-4bef-86ce-5a2f779ad695 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:13.261804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1737f361-3d6b-4bef-86ce-5a2f779ad695 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046605 Aug 31 00:41:13.262379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 724/1373] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:13.300702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-351301d9-695d-4161-ac66-7a308f9cdb6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:13.302841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-351301d9-695d-4161-ac66-7a308f9cdb6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:13.310215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-351301d9-695d-4161-ac66-7a308f9cdb6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:13.310700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-351301d9-695d-4161-ac66-7a308f9cdb6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:13.311157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-351301d9-695d-4161-ac66-7a308f9cdb6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:13.311852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-351301d9-695d-4161-ac66-7a308f9cdb6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:13.312296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-351301d9-695d-4161-ac66-7a308f9cdb6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:13.312763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-351301d9-695d-4161-ac66-7a308f9cdb6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:13.355325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-351301d9-695d-4161-ac66-7a308f9cdb6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058562 Aug 31 00:41:13.355886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 650/1374] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:14.274686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2f9c6d67-ff11-4739-a515-f0c7c442c0c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:14.276753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2f9c6d67-ff11-4739-a515-f0c7c442c0c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:14.283268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f9c6d67-ff11-4739-a515-f0c7c442c0c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:14.284523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f9c6d67-ff11-4739-a515-f0c7c442c0c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:14.285005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f9c6d67-ff11-4739-a515-f0c7c442c0c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:14.285799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f9c6d67-ff11-4739-a515-f0c7c442c0c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:14.286253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f9c6d67-ff11-4739-a515-f0c7c442c0c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:14.286677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f9c6d67-ff11-4739-a515-f0c7c442c0c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:14.317099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2f9c6d67-ff11-4739-a515-f0c7c442c0c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046553 Aug 31 00:41:14.318218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 725/1375] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:14.368149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-25fbcb83-a286-4c30-8a20-85b01befda8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:14.370290 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-25fbcb83-a286-4c30-8a20-85b01befda8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:14.376322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25fbcb83-a286-4c30-8a20-85b01befda8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:14.376789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25fbcb83-a286-4c30-8a20-85b01befda8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:14.377218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25fbcb83-a286-4c30-8a20-85b01befda8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:14.378035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25fbcb83-a286-4c30-8a20-85b01befda8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:14.378476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25fbcb83-a286-4c30-8a20-85b01befda8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:14.378888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25fbcb83-a286-4c30-8a20-85b01befda8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:14.407762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-25fbcb83-a286-4c30-8a20-85b01befda8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043497 Aug 31 00:41:14.408309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 651/1376] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:15.330349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-752640e5-daf0-4608-b2c0-e6d5a61cefdb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:15.333229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-752640e5-daf0-4608-b2c0-e6d5a61cefdb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:15.339267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-752640e5-daf0-4608-b2c0-e6d5a61cefdb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:15.339750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-752640e5-daf0-4608-b2c0-e6d5a61cefdb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:15.340182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-752640e5-daf0-4608-b2c0-e6d5a61cefdb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:15.341325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-752640e5-daf0-4608-b2c0-e6d5a61cefdb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:15.342041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-752640e5-daf0-4608-b2c0-e6d5a61cefdb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:15.342468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-752640e5-daf0-4608-b2c0-e6d5a61cefdb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:15.375372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-752640e5-daf0-4608-b2c0-e6d5a61cefdb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049567 Aug 31 00:41:15.376001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 726/1377] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:15.422117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-98dceb58-7510-4d74-90dd-4557f1d017f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:15.424371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-98dceb58-7510-4d74-90dd-4557f1d017f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:15.432715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98dceb58-7510-4d74-90dd-4557f1d017f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:15.433210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98dceb58-7510-4d74-90dd-4557f1d017f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:15.433643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98dceb58-7510-4d74-90dd-4557f1d017f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:15.434345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98dceb58-7510-4d74-90dd-4557f1d017f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:15.434796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98dceb58-7510-4d74-90dd-4557f1d017f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:15.435281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98dceb58-7510-4d74-90dd-4557f1d017f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:15.471305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-98dceb58-7510-4d74-90dd-4557f1d017f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053058 Aug 31 00:41:15.471939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 652/1378] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:16.388331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6744f7c5-4cd2-4469-81e9-d840cd0ec8a1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:16.390472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6744f7c5-4cd2-4469-81e9-d840cd0ec8a1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:16.397659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6744f7c5-4cd2-4469-81e9-d840cd0ec8a1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:16.398136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6744f7c5-4cd2-4469-81e9-d840cd0ec8a1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:16.398565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6744f7c5-4cd2-4469-81e9-d840cd0ec8a1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:16.399273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6744f7c5-4cd2-4469-81e9-d840cd0ec8a1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:16.399723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6744f7c5-4cd2-4469-81e9-d840cd0ec8a1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:16.400143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6744f7c5-4cd2-4469-81e9-d840cd0ec8a1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:16.430501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6744f7c5-4cd2-4469-81e9-d840cd0ec8a1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046125 Aug 31 00:41:16.431077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 727/1379] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:16.483637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5e6c4168-e6c0-4772-8c27-86e62faadcc5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:16.485743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5e6c4168-e6c0-4772-8c27-86e62faadcc5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:16.496463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6c4168-e6c0-4772-8c27-86e62faadcc5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:16.496937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6c4168-e6c0-4772-8c27-86e62faadcc5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:16.497634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6c4168-e6c0-4772-8c27-86e62faadcc5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:16.498038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6c4168-e6c0-4772-8c27-86e62faadcc5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:16.498476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6c4168-e6c0-4772-8c27-86e62faadcc5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:16.498883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e6c4168-e6c0-4772-8c27-86e62faadcc5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:16.528816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5e6c4168-e6c0-4772-8c27-86e62faadcc5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049374 Aug 31 00:41:16.529371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 653/1380] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:17.443261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e5f4928b-1839-4604-a63e-da191c05b7a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:17.445457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e5f4928b-1839-4604-a63e-da191c05b7a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:17.451806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5f4928b-1839-4604-a63e-da191c05b7a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:17.452275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5f4928b-1839-4604-a63e-da191c05b7a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:17.452696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5f4928b-1839-4604-a63e-da191c05b7a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:17.453368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5f4928b-1839-4604-a63e-da191c05b7a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:17.453813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5f4928b-1839-4604-a63e-da191c05b7a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:17.454223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5f4928b-1839-4604-a63e-da191c05b7a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:17.485704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e5f4928b-1839-4604-a63e-da191c05b7a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 Aug 31 00:41:17.486265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 728/1381] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:17.541289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-579eae3d-bfec-4b2e-8f0b-c37ef30b471a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:17.543445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-579eae3d-bfec-4b2e-8f0b-c37ef30b471a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:17.549813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-579eae3d-bfec-4b2e-8f0b-c37ef30b471a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:17.550293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-579eae3d-bfec-4b2e-8f0b-c37ef30b471a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:17.550756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-579eae3d-bfec-4b2e-8f0b-c37ef30b471a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:17.551542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-579eae3d-bfec-4b2e-8f0b-c37ef30b471a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:17.551986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-579eae3d-bfec-4b2e-8f0b-c37ef30b471a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:17.552411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-579eae3d-bfec-4b2e-8f0b-c37ef30b471a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:17.583673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-579eae3d-bfec-4b2e-8f0b-c37ef30b471a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046453 Aug 31 00:41:17.584243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 654/1382] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:18.500668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9c3cfdce-1963-4dff-85f0-81a70ab5c4f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:18.502961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9c3cfdce-1963-4dff-85f0-81a70ab5c4f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:18.509835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c3cfdce-1963-4dff-85f0-81a70ab5c4f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:18.510304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c3cfdce-1963-4dff-85f0-81a70ab5c4f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:18.510726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c3cfdce-1963-4dff-85f0-81a70ab5c4f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:18.511432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c3cfdce-1963-4dff-85f0-81a70ab5c4f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:18.511877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c3cfdce-1963-4dff-85f0-81a70ab5c4f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:18.512316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c3cfdce-1963-4dff-85f0-81a70ab5c4f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:18.542187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9c3cfdce-1963-4dff-85f0-81a70ab5c4f1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Aug 31 00:41:18.542729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 729/1383] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:18 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:18.595386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d3973a47-f1b1-4ce6-8379-18b11de47a3c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:18.597699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d3973a47-f1b1-4ce6-8379-18b11de47a3c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:18.604308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3973a47-f1b1-4ce6-8379-18b11de47a3c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:18.604791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3973a47-f1b1-4ce6-8379-18b11de47a3c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:18.605225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3973a47-f1b1-4ce6-8379-18b11de47a3c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:18.605907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3973a47-f1b1-4ce6-8379-18b11de47a3c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:18.606622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3973a47-f1b1-4ce6-8379-18b11de47a3c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:18.607061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3973a47-f1b1-4ce6-8379-18b11de47a3c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:18.637279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d3973a47-f1b1-4ce6-8379-18b11de47a3c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045898 Aug 31 00:41:18.637836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 655/1384] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:41:19.554812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-47534556-4034-4c5f-bbb7-6f9be35444ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:19.556872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-47534556-4034-4c5f-bbb7-6f9be35444ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:19.563554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47534556-4034-4c5f-bbb7-6f9be35444ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:19.564035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47534556-4034-4c5f-bbb7-6f9be35444ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:19.564468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47534556-4034-4c5f-bbb7-6f9be35444ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:19.565154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47534556-4034-4c5f-bbb7-6f9be35444ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:19.565620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47534556-4034-4c5f-bbb7-6f9be35444ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:19.566047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47534556-4034-4c5f-bbb7-6f9be35444ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:19.595989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-47534556-4034-4c5f-bbb7-6f9be35444ca tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Aug 31 00:41:19.596541 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 730/1385] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:19.651207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ffc3eb05-2120-4fe2-aa07-e639d78ad77a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:19.654157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ffc3eb05-2120-4fe2-aa07-e639d78ad77a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:19.660829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffc3eb05-2120-4fe2-aa07-e639d78ad77a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:19.662066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffc3eb05-2120-4fe2-aa07-e639d78ad77a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:19.662504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffc3eb05-2120-4fe2-aa07-e639d78ad77a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:19.663275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffc3eb05-2120-4fe2-aa07-e639d78ad77a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:19.663727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffc3eb05-2120-4fe2-aa07-e639d78ad77a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:19.664179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffc3eb05-2120-4fe2-aa07-e639d78ad77a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:19.695329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ffc3eb05-2120-4fe2-aa07-e639d78ad77a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049870 Aug 31 00:41:19.695887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 656/1386] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:20.609585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0f8f9fde-516d-4e26-ae8f-130e67247072 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:20.611741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0f8f9fde-516d-4e26-ae8f-130e67247072 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:20.618208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f8f9fde-516d-4e26-ae8f-130e67247072 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:20.618683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f8f9fde-516d-4e26-ae8f-130e67247072 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:20.619137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f8f9fde-516d-4e26-ae8f-130e67247072 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:20.619826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f8f9fde-516d-4e26-ae8f-130e67247072 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:20.620275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f8f9fde-516d-4e26-ae8f-130e67247072 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:20.620696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f8f9fde-516d-4e26-ae8f-130e67247072 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:20.651406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0f8f9fde-516d-4e26-ae8f-130e67247072 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046062 Aug 31 00:41:20.651961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 731/1387] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:20.707638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-236854f5-fe2f-453d-b3d2-fa1684898d44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:20.710633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-236854f5-fe2f-453d-b3d2-fa1684898d44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:20.716986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-236854f5-fe2f-453d-b3d2-fa1684898d44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:20.717650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-236854f5-fe2f-453d-b3d2-fa1684898d44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:20.717876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-236854f5-fe2f-453d-b3d2-fa1684898d44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:20.718594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-236854f5-fe2f-453d-b3d2-fa1684898d44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:20.719070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-236854f5-fe2f-453d-b3d2-fa1684898d44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:20.719489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-236854f5-fe2f-453d-b3d2-fa1684898d44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:20.749798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-236854f5-fe2f-453d-b3d2-fa1684898d44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046059 Aug 31 00:41:20.750360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 657/1388] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:21.664006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a020dc7a-eca2-402f-86d2-e2ca47515981 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:21.666174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a020dc7a-eca2-402f-86d2-e2ca47515981 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:21.672586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a020dc7a-eca2-402f-86d2-e2ca47515981 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:21.673067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a020dc7a-eca2-402f-86d2-e2ca47515981 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:21.673506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a020dc7a-eca2-402f-86d2-e2ca47515981 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:21.674193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a020dc7a-eca2-402f-86d2-e2ca47515981 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:21.674645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a020dc7a-eca2-402f-86d2-e2ca47515981 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:21.675096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a020dc7a-eca2-402f-86d2-e2ca47515981 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:21.705446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a020dc7a-eca2-402f-86d2-e2ca47515981 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045461 Aug 31 00:41:21.706032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 732/1389] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:21 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:21.762083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-583218cf-4e8e-4f3b-9d82-b456c4eaae72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:21.764283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-583218cf-4e8e-4f3b-9d82-b456c4eaae72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:21.770695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-583218cf-4e8e-4f3b-9d82-b456c4eaae72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:21.771217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-583218cf-4e8e-4f3b-9d82-b456c4eaae72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:21.771642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-583218cf-4e8e-4f3b-9d82-b456c4eaae72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:21.772320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-583218cf-4e8e-4f3b-9d82-b456c4eaae72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:21.772760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-583218cf-4e8e-4f3b-9d82-b456c4eaae72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:21.773170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-583218cf-4e8e-4f3b-9d82-b456c4eaae72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:21.802741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-583218cf-4e8e-4f3b-9d82-b456c4eaae72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044532 Aug 31 00:41:21.803312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 658/1390] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:22.717567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9cc8623b-1aca-42d3-93e2-1394ee75a3b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:22.720589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9cc8623b-1aca-42d3-93e2-1394ee75a3b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:22.728115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cc8623b-1aca-42d3-93e2-1394ee75a3b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:22.728593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cc8623b-1aca-42d3-93e2-1394ee75a3b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:22.729024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cc8623b-1aca-42d3-93e2-1394ee75a3b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:22.729705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cc8623b-1aca-42d3-93e2-1394ee75a3b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:22.730147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cc8623b-1aca-42d3-93e2-1394ee75a3b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:22.730559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cc8623b-1aca-42d3-93e2-1394ee75a3b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:22.761438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9cc8623b-1aca-42d3-93e2-1394ee75a3b4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047896 Aug 31 00:41:22.761990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 733/1391] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:22 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:22.815059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-526a7b6f-415d-4cda-a702-557b60e2baa1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:22.817227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-526a7b6f-415d-4cda-a702-557b60e2baa1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:22.824523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-526a7b6f-415d-4cda-a702-557b60e2baa1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:22.825009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-526a7b6f-415d-4cda-a702-557b60e2baa1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:22.825446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-526a7b6f-415d-4cda-a702-557b60e2baa1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:22.826141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-526a7b6f-415d-4cda-a702-557b60e2baa1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:22.826630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-526a7b6f-415d-4cda-a702-557b60e2baa1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:22.827009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-526a7b6f-415d-4cda-a702-557b60e2baa1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:22.858636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-526a7b6f-415d-4cda-a702-557b60e2baa1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047476 Aug 31 00:41:22.859210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 659/1392] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:23.773636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67c294c7-8b7e-4912-8e8e-57502c7a90ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:23.775821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-67c294c7-8b7e-4912-8e8e-57502c7a90ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:23.782141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67c294c7-8b7e-4912-8e8e-57502c7a90ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:23.782621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67c294c7-8b7e-4912-8e8e-57502c7a90ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:23.783059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67c294c7-8b7e-4912-8e8e-57502c7a90ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:23.783771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67c294c7-8b7e-4912-8e8e-57502c7a90ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:23.784218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67c294c7-8b7e-4912-8e8e-57502c7a90ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:23.784640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67c294c7-8b7e-4912-8e8e-57502c7a90ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:23.814115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67c294c7-8b7e-4912-8e8e-57502c7a90ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Aug 31 00:41:23.814655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 734/1393] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:23.870773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7c61ea78-d369-4bd0-8e81-a9f29ef74157 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:23.873405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7c61ea78-d369-4bd0-8e81-a9f29ef74157 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:23.879661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c61ea78-d369-4bd0-8e81-a9f29ef74157 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:23.880738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c61ea78-d369-4bd0-8e81-a9f29ef74157 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:23.881168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c61ea78-d369-4bd0-8e81-a9f29ef74157 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:23.881837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c61ea78-d369-4bd0-8e81-a9f29ef74157 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:23.882277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c61ea78-d369-4bd0-8e81-a9f29ef74157 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:23.882689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c61ea78-d369-4bd0-8e81-a9f29ef74157 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:23.911826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7c61ea78-d369-4bd0-8e81-a9f29ef74157 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044882 Aug 31 00:41:23.912374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 660/1394] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:24.827482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-480b7124-1a23-42cd-a1b7-9b4995bf8b2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:24.829599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-480b7124-1a23-42cd-a1b7-9b4995bf8b2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:24.836189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480b7124-1a23-42cd-a1b7-9b4995bf8b2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:24.836663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480b7124-1a23-42cd-a1b7-9b4995bf8b2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:24.837090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480b7124-1a23-42cd-a1b7-9b4995bf8b2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:24.837768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480b7124-1a23-42cd-a1b7-9b4995bf8b2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:24.838213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480b7124-1a23-42cd-a1b7-9b4995bf8b2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:24.838631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480b7124-1a23-42cd-a1b7-9b4995bf8b2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:24.868525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-480b7124-1a23-42cd-a1b7-9b4995bf8b2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Aug 31 00:41:24.869081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 735/1395] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:24.924372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b25d3982-dddf-44cc-ba26-cf1b7ae35cfc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:24.926123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b25d3982-dddf-44cc-ba26-cf1b7ae35cfc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:24.932914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b25d3982-dddf-44cc-ba26-cf1b7ae35cfc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:24.933387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b25d3982-dddf-44cc-ba26-cf1b7ae35cfc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:24.933811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b25d3982-dddf-44cc-ba26-cf1b7ae35cfc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:24.934487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b25d3982-dddf-44cc-ba26-cf1b7ae35cfc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:24.934926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b25d3982-dddf-44cc-ba26-cf1b7ae35cfc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:24.935365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b25d3982-dddf-44cc-ba26-cf1b7ae35cfc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:24.964926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b25d3982-dddf-44cc-ba26-cf1b7ae35cfc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044803 Aug 31 00:41:24.965487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 661/1396] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:25.881694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b7ef8181-52d0-4739-8826-e39428325ed5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:25.883991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b7ef8181-52d0-4739-8826-e39428325ed5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:25.890333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7ef8181-52d0-4739-8826-e39428325ed5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:25.890923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7ef8181-52d0-4739-8826-e39428325ed5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:25.891390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7ef8181-52d0-4739-8826-e39428325ed5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:25.892080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7ef8181-52d0-4739-8826-e39428325ed5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:25.892528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7ef8181-52d0-4739-8826-e39428325ed5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:25.892946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7ef8181-52d0-4739-8826-e39428325ed5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:25.897614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:25.923450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b7ef8181-52d0-4739-8826-e39428325ed5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046327 Aug 31 00:41:25.923998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 736/1397] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:25.978576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b701230a-0938-4d83-b0c2-445d0ea4c902 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:25.980766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b701230a-0938-4d83-b0c2-445d0ea4c902 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:25.984483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=58 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:25.988564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b701230a-0938-4d83-b0c2-445d0ea4c902 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:25.991056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b701230a-0938-4d83-b0c2-445d0ea4c902 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:25.991056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b701230a-0938-4d83-b0c2-445d0ea4c902 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:25.991056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b701230a-0938-4d83-b0c2-445d0ea4c902 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:25.991056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b701230a-0938-4d83-b0c2-445d0ea4c902 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:25.991440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b701230a-0938-4d83-b0c2-445d0ea4c902 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:26.023721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b701230a-0938-4d83-b0c2-445d0ea4c902 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049801 Aug 31 00:41:26.024432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 662/1398] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:26.935871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf90aa6f-c277-40b1-a033-3f1e154a7db9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:26.937988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf90aa6f-c277-40b1-a033-3f1e154a7db9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:26.944478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf90aa6f-c277-40b1-a033-3f1e154a7db9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:26.944957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf90aa6f-c277-40b1-a033-3f1e154a7db9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:26.945396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf90aa6f-c277-40b1-a033-3f1e154a7db9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:26.946079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf90aa6f-c277-40b1-a033-3f1e154a7db9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:26.946528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf90aa6f-c277-40b1-a033-3f1e154a7db9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:26.946946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf90aa6f-c277-40b1-a033-3f1e154a7db9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:26.977048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf90aa6f-c277-40b1-a033-3f1e154a7db9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045097 Aug 31 00:41:26.977609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 737/1399] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:26 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:27.037602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dced3f01-6d86-4ea5-a07d-cc447b8ba802 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:27.039787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dced3f01-6d86-4ea5-a07d-cc447b8ba802 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:27.046198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dced3f01-6d86-4ea5-a07d-cc447b8ba802 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:27.046647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dced3f01-6d86-4ea5-a07d-cc447b8ba802 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:27.047103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dced3f01-6d86-4ea5-a07d-cc447b8ba802 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:27.047802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dced3f01-6d86-4ea5-a07d-cc447b8ba802 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:27.048253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dced3f01-6d86-4ea5-a07d-cc447b8ba802 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:27.048677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dced3f01-6d86-4ea5-a07d-cc447b8ba802 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:27.079058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dced3f01-6d86-4ea5-a07d-cc447b8ba802 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046730 Aug 31 00:41:27.079670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 663/1400] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:27.989978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0ca8d39e-0e65-4265-8e71-06a1d05cddb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:27.992172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0ca8d39e-0e65-4265-8e71-06a1d05cddb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:27.998239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca8d39e-0e65-4265-8e71-06a1d05cddb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:27.998709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca8d39e-0e65-4265-8e71-06a1d05cddb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:27.999161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca8d39e-0e65-4265-8e71-06a1d05cddb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:27.999843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca8d39e-0e65-4265-8e71-06a1d05cddb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:28.000286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca8d39e-0e65-4265-8e71-06a1d05cddb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:28.000700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca8d39e-0e65-4265-8e71-06a1d05cddb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:28.032767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0ca8d39e-0e65-4265-8e71-06a1d05cddb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046978 Aug 31 00:41:28.033335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 738/1401] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:27 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:28.092500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bba29ef9-8296-4096-881b-679b39a159be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:28.094593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bba29ef9-8296-4096-881b-679b39a159be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:28.101844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba29ef9-8296-4096-881b-679b39a159be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:28.102326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba29ef9-8296-4096-881b-679b39a159be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:28.102755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba29ef9-8296-4096-881b-679b39a159be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:28.103461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba29ef9-8296-4096-881b-679b39a159be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:28.103905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba29ef9-8296-4096-881b-679b39a159be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:28.104321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba29ef9-8296-4096-881b-679b39a159be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:28.135493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bba29ef9-8296-4096-881b-679b39a159be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046907 Aug 31 00:41:28.136070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 664/1402] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:29.048004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7342aa81-d44b-4281-8a9e-6e0a3d033aed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:29.050146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7342aa81-d44b-4281-8a9e-6e0a3d033aed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:29.053094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=58 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:29.058396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342aa81-d44b-4281-8a9e-6e0a3d033aed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:29.058879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342aa81-d44b-4281-8a9e-6e0a3d033aed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:29.059357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342aa81-d44b-4281-8a9e-6e0a3d033aed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:29.060051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342aa81-d44b-4281-8a9e-6e0a3d033aed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:29.060504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342aa81-d44b-4281-8a9e-6e0a3d033aed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:29.060927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342aa81-d44b-4281-8a9e-6e0a3d033aed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:29.090513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7342aa81-d44b-4281-8a9e-6e0a3d033aed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046632 Aug 31 00:41:29.091084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 739/1403] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:29.148835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d8db3ff8-489c-4942-86b1-b6c139329d1a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:29.151257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d8db3ff8-489c-4942-86b1-b6c139329d1a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:29.158793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8db3ff8-489c-4942-86b1-b6c139329d1a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:29.158926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8db3ff8-489c-4942-86b1-b6c139329d1a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:29.159332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8db3ff8-489c-4942-86b1-b6c139329d1a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:29.160089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8db3ff8-489c-4942-86b1-b6c139329d1a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:29.160540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8db3ff8-489c-4942-86b1-b6c139329d1a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:29.161717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8db3ff8-489c-4942-86b1-b6c139329d1a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:29.179725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:29.194825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d8db3ff8-489c-4942-86b1-b6c139329d1a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050881 Aug 31 00:41:29.195420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 665/1404] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:30.102974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a98bb3b6-5509-45a4-9746-d6d2e3946722 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:30.105101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a98bb3b6-5509-45a4-9746-d6d2e3946722 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:30.111805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a98bb3b6-5509-45a4-9746-d6d2e3946722 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:30.112287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a98bb3b6-5509-45a4-9746-d6d2e3946722 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:30.112720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a98bb3b6-5509-45a4-9746-d6d2e3946722 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:30.113407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a98bb3b6-5509-45a4-9746-d6d2e3946722 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:30.113862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a98bb3b6-5509-45a4-9746-d6d2e3946722 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:30.114872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a98bb3b6-5509-45a4-9746-d6d2e3946722 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:30.145448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a98bb3b6-5509-45a4-9746-d6d2e3946722 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046540 Aug 31 00:41:30.146014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 740/1405] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:30.207154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f4b7d02c-4674-4d6c-9d91-57cbbf5e2c25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:30.209297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f4b7d02c-4674-4d6c-9d91-57cbbf5e2c25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:30.215820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4b7d02c-4674-4d6c-9d91-57cbbf5e2c25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:30.216297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4b7d02c-4674-4d6c-9d91-57cbbf5e2c25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:30.216731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4b7d02c-4674-4d6c-9d91-57cbbf5e2c25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:30.217785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4b7d02c-4674-4d6c-9d91-57cbbf5e2c25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:30.217892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4b7d02c-4674-4d6c-9d91-57cbbf5e2c25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:30.218264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4b7d02c-4674-4d6c-9d91-57cbbf5e2c25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:30.249773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f4b7d02c-4674-4d6c-9d91-57cbbf5e2c25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046554 Aug 31 00:41:30.250340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 666/1406] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:31.157804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1748d22f-d576-4e02-a9fd-8bf38dd215ff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:31.159956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1748d22f-d576-4e02-a9fd-8bf38dd215ff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:31.166687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1748d22f-d576-4e02-a9fd-8bf38dd215ff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:31.167208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1748d22f-d576-4e02-a9fd-8bf38dd215ff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:31.167643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1748d22f-d576-4e02-a9fd-8bf38dd215ff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:31.168331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1748d22f-d576-4e02-a9fd-8bf38dd215ff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:31.168783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1748d22f-d576-4e02-a9fd-8bf38dd215ff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:31.169204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1748d22f-d576-4e02-a9fd-8bf38dd215ff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:31.199174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1748d22f-d576-4e02-a9fd-8bf38dd215ff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Aug 31 00:41:31.199730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 741/1407] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:31.262051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bd5bb48a-af52-4086-82bc-4d454e1e06cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:31.264172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bd5bb48a-af52-4086-82bc-4d454e1e06cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:31.271159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd5bb48a-af52-4086-82bc-4d454e1e06cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:31.271648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd5bb48a-af52-4086-82bc-4d454e1e06cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:31.272179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd5bb48a-af52-4086-82bc-4d454e1e06cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:31.273122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd5bb48a-af52-4086-82bc-4d454e1e06cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:31.273576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd5bb48a-af52-4086-82bc-4d454e1e06cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:31.274004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd5bb48a-af52-4086-82bc-4d454e1e06cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:31.305974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bd5bb48a-af52-4086-82bc-4d454e1e06cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047881 Aug 31 00:41:31.306546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 667/1408] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:32.211736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-155de3df-3cf6-4070-a000-bb8174a358a9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:32.213890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-155de3df-3cf6-4070-a000-bb8174a358a9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:32.220267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-155de3df-3cf6-4070-a000-bb8174a358a9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:32.220736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-155de3df-3cf6-4070-a000-bb8174a358a9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:32.221160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-155de3df-3cf6-4070-a000-bb8174a358a9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:32.221835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-155de3df-3cf6-4070-a000-bb8174a358a9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:32.222276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-155de3df-3cf6-4070-a000-bb8174a358a9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:32.222691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-155de3df-3cf6-4070-a000-bb8174a358a9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:32.252081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-155de3df-3cf6-4070-a000-bb8174a358a9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044347 Aug 31 00:41:32.252559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 742/1409] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:41:32.319067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d3ca618-265d-4b85-b81c-78824599dc6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:32.321142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0d3ca618-265d-4b85-b81c-78824599dc6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:32.327422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d3ca618-265d-4b85-b81c-78824599dc6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:32.327888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d3ca618-265d-4b85-b81c-78824599dc6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:32.328311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d3ca618-265d-4b85-b81c-78824599dc6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:32.328987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d3ca618-265d-4b85-b81c-78824599dc6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:32.329427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d3ca618-265d-4b85-b81c-78824599dc6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:32.329839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d3ca618-265d-4b85-b81c-78824599dc6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:32.359719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0d3ca618-265d-4b85-b81c-78824599dc6a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045189 Aug 31 00:41:32.360281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 668/1410] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:33.264995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e954810f-37d5-4048-9c8a-37dcf30b3698 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:33.267060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e954810f-37d5-4048-9c8a-37dcf30b3698 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:33.274378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e954810f-37d5-4048-9c8a-37dcf30b3698 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:33.274857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e954810f-37d5-4048-9c8a-37dcf30b3698 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:33.275316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e954810f-37d5-4048-9c8a-37dcf30b3698 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:33.276497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e954810f-37d5-4048-9c8a-37dcf30b3698 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:33.276497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e954810f-37d5-4048-9c8a-37dcf30b3698 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:33.277161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e954810f-37d5-4048-9c8a-37dcf30b3698 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:33.305955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e954810f-37d5-4048-9c8a-37dcf30b3698 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 Aug 31 00:41:33.306506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 743/1411] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:33 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:33.372961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-30b9e8f9-88ac-4e37-b366-160c268608c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:33.375106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-30b9e8f9-88ac-4e37-b366-160c268608c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:33.382129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30b9e8f9-88ac-4e37-b366-160c268608c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:33.382601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30b9e8f9-88ac-4e37-b366-160c268608c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:33.383028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30b9e8f9-88ac-4e37-b366-160c268608c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:33.383741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30b9e8f9-88ac-4e37-b366-160c268608c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:33.384185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30b9e8f9-88ac-4e37-b366-160c268608c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:33.384602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-30b9e8f9-88ac-4e37-b366-160c268608c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:33.415322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-30b9e8f9-88ac-4e37-b366-160c268608c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046310 Aug 31 00:41:33.415900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 669/1412] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:33 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:34.318231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-62744d46-6dac-4f68-8012-fe71719b6d12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:34.320368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-62744d46-6dac-4f68-8012-fe71719b6d12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:34.326696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62744d46-6dac-4f68-8012-fe71719b6d12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:34.327201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62744d46-6dac-4f68-8012-fe71719b6d12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:34.327634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62744d46-6dac-4f68-8012-fe71719b6d12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:34.328312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62744d46-6dac-4f68-8012-fe71719b6d12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:34.328762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62744d46-6dac-4f68-8012-fe71719b6d12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:34.329180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62744d46-6dac-4f68-8012-fe71719b6d12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:34.359132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-62744d46-6dac-4f68-8012-fe71719b6d12 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044750 Aug 31 00:41:34.359681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 744/1413] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:34 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:34.427891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2fbda051-6a7b-40f5-b609-00486adfb51e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:34.430004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2fbda051-6a7b-40f5-b609-00486adfb51e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:34.436395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fbda051-6a7b-40f5-b609-00486adfb51e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:34.436867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fbda051-6a7b-40f5-b609-00486adfb51e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:34.437302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fbda051-6a7b-40f5-b609-00486adfb51e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:34.437985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fbda051-6a7b-40f5-b609-00486adfb51e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:34.438433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fbda051-6a7b-40f5-b609-00486adfb51e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:34.438851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fbda051-6a7b-40f5-b609-00486adfb51e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:34.469312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2fbda051-6a7b-40f5-b609-00486adfb51e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045660 Aug 31 00:41:34.470074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 670/1414] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:35.371447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ff46a0de-7e1f-40ba-b041-609c4f2bb41d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:35.373680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ff46a0de-7e1f-40ba-b041-609c4f2bb41d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:35.380200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff46a0de-7e1f-40ba-b041-609c4f2bb41d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:35.380838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff46a0de-7e1f-40ba-b041-609c4f2bb41d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:35.381276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff46a0de-7e1f-40ba-b041-609c4f2bb41d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:35.381962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff46a0de-7e1f-40ba-b041-609c4f2bb41d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:35.382443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff46a0de-7e1f-40ba-b041-609c4f2bb41d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:35.382862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff46a0de-7e1f-40ba-b041-609c4f2bb41d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:35.413091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ff46a0de-7e1f-40ba-b041-609c4f2bb41d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045621 Aug 31 00:41:35.413640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 745/1415] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:35.482771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ba839f25-5830-4b98-8445-6d60e96f196b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:35.484839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ba839f25-5830-4b98-8445-6d60e96f196b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:35.491509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba839f25-5830-4b98-8445-6d60e96f196b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:35.491979 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba839f25-5830-4b98-8445-6d60e96f196b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:35.492404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba839f25-5830-4b98-8445-6d60e96f196b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:35.493079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba839f25-5830-4b98-8445-6d60e96f196b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:35.493515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba839f25-5830-4b98-8445-6d60e96f196b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:35.493926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba839f25-5830-4b98-8445-6d60e96f196b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:35.524905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ba839f25-5830-4b98-8445-6d60e96f196b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046436 Aug 31 00:41:35.525477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 671/1416] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:36.425310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b08890bb-014d-43f6-a41a-a6696c17bf0e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:36.428117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b08890bb-014d-43f6-a41a-a6696c17bf0e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:36.434412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b08890bb-014d-43f6-a41a-a6696c17bf0e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:36.434886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b08890bb-014d-43f6-a41a-a6696c17bf0e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:36.435346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b08890bb-014d-43f6-a41a-a6696c17bf0e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:36.436020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b08890bb-014d-43f6-a41a-a6696c17bf0e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:36.436463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b08890bb-014d-43f6-a41a-a6696c17bf0e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:36.436876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b08890bb-014d-43f6-a41a-a6696c17bf0e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:36.465840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b08890bb-014d-43f6-a41a-a6696c17bf0e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Aug 31 00:41:36.466382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 746/1417] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:36.538217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-561aea07-b6c2-4015-9d7f-b0b7d3118dcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:36.541104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-561aea07-b6c2-4015-9d7f-b0b7d3118dcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:36.548255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-561aea07-b6c2-4015-9d7f-b0b7d3118dcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:36.548735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-561aea07-b6c2-4015-9d7f-b0b7d3118dcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:36.549166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-561aea07-b6c2-4015-9d7f-b0b7d3118dcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:36.549850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-561aea07-b6c2-4015-9d7f-b0b7d3118dcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:36.550302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-561aea07-b6c2-4015-9d7f-b0b7d3118dcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:36.550722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-561aea07-b6c2-4015-9d7f-b0b7d3118dcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:36.580629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-561aea07-b6c2-4015-9d7f-b0b7d3118dcf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047613 Aug 31 00:41:36.581298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 672/1418] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:37.478157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0428d028-2bb2-4748-9b51-1b29e9a35bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:37.480312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0428d028-2bb2-4748-9b51-1b29e9a35bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:37.486939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0428d028-2bb2-4748-9b51-1b29e9a35bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:37.487452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0428d028-2bb2-4748-9b51-1b29e9a35bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:37.487890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0428d028-2bb2-4748-9b51-1b29e9a35bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:37.488579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0428d028-2bb2-4748-9b51-1b29e9a35bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:37.489578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0428d028-2bb2-4748-9b51-1b29e9a35bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:37.489975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0428d028-2bb2-4748-9b51-1b29e9a35bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:37.519426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0428d028-2bb2-4748-9b51-1b29e9a35bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Aug 31 00:41:37.519978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 747/1419] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:37 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:37.593227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c2136e82-8bf7-4556-956d-31dfa1ca270d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:37.595390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c2136e82-8bf7-4556-956d-31dfa1ca270d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:37.601975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2136e82-8bf7-4556-956d-31dfa1ca270d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:37.602431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2136e82-8bf7-4556-956d-31dfa1ca270d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:37.602865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2136e82-8bf7-4556-956d-31dfa1ca270d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:37.603571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2136e82-8bf7-4556-956d-31dfa1ca270d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:37.604020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2136e82-8bf7-4556-956d-31dfa1ca270d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:37.604434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2136e82-8bf7-4556-956d-31dfa1ca270d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:37.635396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c2136e82-8bf7-4556-956d-31dfa1ca270d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046039 Aug 31 00:41:37.635967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 673/1420] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:38.531908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d3ab3e13-bdc6-4b39-be8e-1e5f013b5660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:38.534049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d3ab3e13-bdc6-4b39-be8e-1e5f013b5660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:38.540594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ab3e13-bdc6-4b39-be8e-1e5f013b5660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:38.541071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ab3e13-bdc6-4b39-be8e-1e5f013b5660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:38.541504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ab3e13-bdc6-4b39-be8e-1e5f013b5660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:38.542189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ab3e13-bdc6-4b39-be8e-1e5f013b5660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:38.542635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ab3e13-bdc6-4b39-be8e-1e5f013b5660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:38.543071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3ab3e13-bdc6-4b39-be8e-1e5f013b5660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:38.573010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d3ab3e13-bdc6-4b39-be8e-1e5f013b5660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045077 Aug 31 00:41:38.573571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 748/1421] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:38.648600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a146921b-25dc-45f6-8cb7-80f2131c0fbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:38.650840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a146921b-25dc-45f6-8cb7-80f2131c0fbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:38.656796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a146921b-25dc-45f6-8cb7-80f2131c0fbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:38.657268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a146921b-25dc-45f6-8cb7-80f2131c0fbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:38.657699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a146921b-25dc-45f6-8cb7-80f2131c0fbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:38.658380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a146921b-25dc-45f6-8cb7-80f2131c0fbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:38.658827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a146921b-25dc-45f6-8cb7-80f2131c0fbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:38.659282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a146921b-25dc-45f6-8cb7-80f2131c0fbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:38.687965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a146921b-25dc-45f6-8cb7-80f2131c0fbc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044250 Aug 31 00:41:38.688525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 674/1422] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:39.585616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f0641026-fd08-466f-9ea1-7f19f5f480c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:39.587742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f0641026-fd08-466f-9ea1-7f19f5f480c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:39.593977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0641026-fd08-466f-9ea1-7f19f5f480c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:39.594448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0641026-fd08-466f-9ea1-7f19f5f480c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:39.594874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0641026-fd08-466f-9ea1-7f19f5f480c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:39.595574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0641026-fd08-466f-9ea1-7f19f5f480c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:39.596019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0641026-fd08-466f-9ea1-7f19f5f480c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:39.596438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0641026-fd08-466f-9ea1-7f19f5f480c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:39.626274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f0641026-fd08-466f-9ea1-7f19f5f480c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Aug 31 00:41:39.626820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 749/1423] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:39 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:39.701074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-48c41e57-339d-4c64-9a79-0ebc08821183 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:39.703198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-48c41e57-339d-4c64-9a79-0ebc08821183 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:39.709489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48c41e57-339d-4c64-9a79-0ebc08821183 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:39.709956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48c41e57-339d-4c64-9a79-0ebc08821183 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:39.710429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48c41e57-339d-4c64-9a79-0ebc08821183 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:39.711123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48c41e57-339d-4c64-9a79-0ebc08821183 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:39.711563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48c41e57-339d-4c64-9a79-0ebc08821183 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:39.711971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48c41e57-339d-4c64-9a79-0ebc08821183 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:39.740616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-48c41e57-339d-4c64-9a79-0ebc08821183 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043635 Aug 31 00:41:39.741177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 675/1424] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:40.638012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-538436b5-1124-4808-a6a3-8aff93b0ee50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:40.640180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-538436b5-1124-4808-a6a3-8aff93b0ee50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:40.646929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-538436b5-1124-4808-a6a3-8aff93b0ee50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:40.647438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-538436b5-1124-4808-a6a3-8aff93b0ee50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:40.648972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-538436b5-1124-4808-a6a3-8aff93b0ee50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:40.649678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-538436b5-1124-4808-a6a3-8aff93b0ee50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:40.650134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-538436b5-1124-4808-a6a3-8aff93b0ee50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:40.650560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-538436b5-1124-4808-a6a3-8aff93b0ee50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:40.680557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-538436b5-1124-4808-a6a3-8aff93b0ee50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Aug 31 00:41:40.681108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 750/1425] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:41:40.753574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-568a59b8-1272-4f9b-b232-ed6054d2ee18 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:40.755716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-568a59b8-1272-4f9b-b232-ed6054d2ee18 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:40.762750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568a59b8-1272-4f9b-b232-ed6054d2ee18 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:40.763264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568a59b8-1272-4f9b-b232-ed6054d2ee18 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:40.763695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568a59b8-1272-4f9b-b232-ed6054d2ee18 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:40.764367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568a59b8-1272-4f9b-b232-ed6054d2ee18 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:40.764808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568a59b8-1272-4f9b-b232-ed6054d2ee18 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:40.765222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568a59b8-1272-4f9b-b232-ed6054d2ee18 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:40.794762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-568a59b8-1272-4f9b-b232-ed6054d2ee18 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045187 Aug 31 00:41:40.795343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 676/1426] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:41.693006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-10c816bc-a17d-450d-a754-c35ef7ab0cb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:41.695174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-10c816bc-a17d-450d-a754-c35ef7ab0cb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:41.701626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10c816bc-a17d-450d-a754-c35ef7ab0cb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:41.702110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10c816bc-a17d-450d-a754-c35ef7ab0cb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:41.702552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10c816bc-a17d-450d-a754-c35ef7ab0cb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:41.703284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10c816bc-a17d-450d-a754-c35ef7ab0cb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:41.703738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10c816bc-a17d-450d-a754-c35ef7ab0cb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:41.704162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10c816bc-a17d-450d-a754-c35ef7ab0cb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:41.739997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-10c816bc-a17d-450d-a754-c35ef7ab0cb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051010 Aug 31 00:41:41.740551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 751/1427] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:41 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:41.807070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-04b32b3f-f534-4781-aff8-c32fd453f9cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:41.809169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-04b32b3f-f534-4781-aff8-c32fd453f9cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:41.815455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04b32b3f-f534-4781-aff8-c32fd453f9cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:41.815927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04b32b3f-f534-4781-aff8-c32fd453f9cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:41.816355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04b32b3f-f534-4781-aff8-c32fd453f9cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:41.817026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04b32b3f-f534-4781-aff8-c32fd453f9cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:41.817464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04b32b3f-f534-4781-aff8-c32fd453f9cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:41.817876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04b32b3f-f534-4781-aff8-c32fd453f9cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:41.846602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-04b32b3f-f534-4781-aff8-c32fd453f9cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044118 Aug 31 00:41:41.847226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 677/1428] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:42.753509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-195f12c5-8eb4-4dec-8d65-d8d0347b49f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:42.755705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-195f12c5-8eb4-4dec-8d65-d8d0347b49f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:42.762180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-195f12c5-8eb4-4dec-8d65-d8d0347b49f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:42.762656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-195f12c5-8eb4-4dec-8d65-d8d0347b49f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:42.763116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-195f12c5-8eb4-4dec-8d65-d8d0347b49f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:42.763803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-195f12c5-8eb4-4dec-8d65-d8d0347b49f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:42.764252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-195f12c5-8eb4-4dec-8d65-d8d0347b49f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:42.764669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-195f12c5-8eb4-4dec-8d65-d8d0347b49f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:42.791493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:42.796845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-195f12c5-8eb4-4dec-8d65-d8d0347b49f8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047406 Aug 31 00:41:42.797414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 752/1429] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:42 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:42.859665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1869375b-e5e5-409c-a1df-4b9fe2ef03e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:42.861792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1869375b-e5e5-409c-a1df-4b9fe2ef03e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:42.868486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1869375b-e5e5-409c-a1df-4b9fe2ef03e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:42.869041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1869375b-e5e5-409c-a1df-4b9fe2ef03e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:42.869505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1869375b-e5e5-409c-a1df-4b9fe2ef03e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:42.870186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1869375b-e5e5-409c-a1df-4b9fe2ef03e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:42.870629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1869375b-e5e5-409c-a1df-4b9fe2ef03e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:42.871063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1869375b-e5e5-409c-a1df-4b9fe2ef03e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:42.900222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1869375b-e5e5-409c-a1df-4b9fe2ef03e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044783 Aug 31 00:41:42.900765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 678/1430] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:43.809962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a1ea7399-b3d2-4881-8688-2163896fb6af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:43.812134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a1ea7399-b3d2-4881-8688-2163896fb6af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:43.818500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ea7399-b3d2-4881-8688-2163896fb6af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:43.818985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ea7399-b3d2-4881-8688-2163896fb6af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:43.819509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ea7399-b3d2-4881-8688-2163896fb6af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:43.820548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ea7399-b3d2-4881-8688-2163896fb6af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:43.821005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ea7399-b3d2-4881-8688-2163896fb6af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:43.821432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ea7399-b3d2-4881-8688-2163896fb6af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:43.850413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a1ea7399-b3d2-4881-8688-2163896fb6af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Aug 31 00:41:43.852158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 753/1431] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:41:43.912619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c6413716-f10a-4342-a85a-ce94b14643d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:43.915455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c6413716-f10a-4342-a85a-ce94b14643d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:43.921822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6413716-f10a-4342-a85a-ce94b14643d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:43.922292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6413716-f10a-4342-a85a-ce94b14643d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:43.922710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6413716-f10a-4342-a85a-ce94b14643d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:43.923423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6413716-f10a-4342-a85a-ce94b14643d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:43.923863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6413716-f10a-4342-a85a-ce94b14643d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:43.924274 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6413716-f10a-4342-a85a-ce94b14643d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:43.953300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c6413716-f10a-4342-a85a-ce94b14643d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044607 Aug 31 00:41:43.953842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 679/1432] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:44.864968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b44c19db-ea68-4c8d-9fa6-803b3d9af6b7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:44.867726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b44c19db-ea68-4c8d-9fa6-803b3d9af6b7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:44.874023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b44c19db-ea68-4c8d-9fa6-803b3d9af6b7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:44.874494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b44c19db-ea68-4c8d-9fa6-803b3d9af6b7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:44.874918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b44c19db-ea68-4c8d-9fa6-803b3d9af6b7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:44.875622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b44c19db-ea68-4c8d-9fa6-803b3d9af6b7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:44.876065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b44c19db-ea68-4c8d-9fa6-803b3d9af6b7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:44.876479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b44c19db-ea68-4c8d-9fa6-803b3d9af6b7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:44.906442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b44c19db-ea68-4c8d-9fa6-803b3d9af6b7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 Aug 31 00:41:44.906986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 754/1433] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:44.965660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-eef69528-7741-4b28-b3b9-588b1036088d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:44.967814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eef69528-7741-4b28-b3b9-588b1036088d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:44.974418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eef69528-7741-4b28-b3b9-588b1036088d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:44.974884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eef69528-7741-4b28-b3b9-588b1036088d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:44.975353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eef69528-7741-4b28-b3b9-588b1036088d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:44.976031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eef69528-7741-4b28-b3b9-588b1036088d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:44.976467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eef69528-7741-4b28-b3b9-588b1036088d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:44.976875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eef69528-7741-4b28-b3b9-588b1036088d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:45.007784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-eef69528-7741-4b28-b3b9-588b1036088d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045298 Aug 31 00:41:45.008353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 680/1434] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:45.920019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0c9d35f2-c376-48a5-94cf-8f8b21c1484d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:45.922156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0c9d35f2-c376-48a5-94cf-8f8b21c1484d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:45.928670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c9d35f2-c376-48a5-94cf-8f8b21c1484d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:45.929349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c9d35f2-c376-48a5-94cf-8f8b21c1484d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:45.929691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c9d35f2-c376-48a5-94cf-8f8b21c1484d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:45.930296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c9d35f2-c376-48a5-94cf-8f8b21c1484d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:45.930746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c9d35f2-c376-48a5-94cf-8f8b21c1484d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:45.931197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c9d35f2-c376-48a5-94cf-8f8b21c1484d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:45.961819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0c9d35f2-c376-48a5-94cf-8f8b21c1484d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 Aug 31 00:41:45.962357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 755/1435] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:46.020135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bf1f8c47-7171-43c9-af35-f4d64078db02 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:46.022239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bf1f8c47-7171-43c9-af35-f4d64078db02 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:46.029215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf1f8c47-7171-43c9-af35-f4d64078db02 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:46.029696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf1f8c47-7171-43c9-af35-f4d64078db02 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:46.030132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf1f8c47-7171-43c9-af35-f4d64078db02 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:46.030815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf1f8c47-7171-43c9-af35-f4d64078db02 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:46.031324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf1f8c47-7171-43c9-af35-f4d64078db02 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:46.031749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf1f8c47-7171-43c9-af35-f4d64078db02 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:46.061411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bf1f8c47-7171-43c9-af35-f4d64078db02 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045235 Aug 31 00:41:46.061978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 681/1436] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:46.974023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8eafc5b2-14a7-4e36-ac19-efc7caf3f98e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:46.976934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8eafc5b2-14a7-4e36-ac19-efc7caf3f98e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:46.983570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8eafc5b2-14a7-4e36-ac19-efc7caf3f98e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:46.984041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8eafc5b2-14a7-4e36-ac19-efc7caf3f98e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:46.984469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8eafc5b2-14a7-4e36-ac19-efc7caf3f98e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:46.985155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8eafc5b2-14a7-4e36-ac19-efc7caf3f98e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:46.985596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8eafc5b2-14a7-4e36-ac19-efc7caf3f98e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:46.986006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8eafc5b2-14a7-4e36-ac19-efc7caf3f98e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:47.016798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8eafc5b2-14a7-4e36-ac19-efc7caf3f98e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046711 Aug 31 00:41:47.017346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 756/1437] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:46 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:47.073640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e6b6e321-2f04-459f-9eca-b49b5f4ff268 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:47.075848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e6b6e321-2f04-459f-9eca-b49b5f4ff268 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:47.082320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6b6e321-2f04-459f-9eca-b49b5f4ff268 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:47.082800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6b6e321-2f04-459f-9eca-b49b5f4ff268 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:47.083273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6b6e321-2f04-459f-9eca-b49b5f4ff268 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:47.083955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6b6e321-2f04-459f-9eca-b49b5f4ff268 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:47.084403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6b6e321-2f04-459f-9eca-b49b5f4ff268 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:47.084822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6b6e321-2f04-459f-9eca-b49b5f4ff268 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:47.089145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:47.115810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e6b6e321-2f04-459f-9eca-b49b5f4ff268 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046344 Aug 31 00:41:47.116392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 682/1438] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:48.030075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-395fe786-2a2a-4225-b0ef-a3d472d66a71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:48.032234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-395fe786-2a2a-4225-b0ef-a3d472d66a71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:48.039383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395fe786-2a2a-4225-b0ef-a3d472d66a71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:48.039865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395fe786-2a2a-4225-b0ef-a3d472d66a71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:48.040297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395fe786-2a2a-4225-b0ef-a3d472d66a71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:48.040982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395fe786-2a2a-4225-b0ef-a3d472d66a71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:48.041437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395fe786-2a2a-4225-b0ef-a3d472d66a71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:48.041860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-395fe786-2a2a-4225-b0ef-a3d472d66a71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:48.070788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-395fe786-2a2a-4225-b0ef-a3d472d66a71 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Aug 31 00:41:48.071360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 757/1439] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:48.128387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bff9e103-fda8-4fba-9462-8ad81b0405fa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:48.130478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bff9e103-fda8-4fba-9462-8ad81b0405fa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:48.136961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bff9e103-fda8-4fba-9462-8ad81b0405fa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:48.137427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bff9e103-fda8-4fba-9462-8ad81b0405fa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:48.137848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bff9e103-fda8-4fba-9462-8ad81b0405fa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:48.138519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bff9e103-fda8-4fba-9462-8ad81b0405fa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:48.138958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bff9e103-fda8-4fba-9462-8ad81b0405fa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:48.139401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bff9e103-fda8-4fba-9462-8ad81b0405fa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:48.169154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bff9e103-fda8-4fba-9462-8ad81b0405fa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044749 Aug 31 00:41:48.169702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 683/1440] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:49.084831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd55a7f2-8d74-4fa3-ade1-cf0c29c83545 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:49.087073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dd55a7f2-8d74-4fa3-ade1-cf0c29c83545 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:49.093485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd55a7f2-8d74-4fa3-ade1-cf0c29c83545 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:49.093964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd55a7f2-8d74-4fa3-ade1-cf0c29c83545 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:49.094397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd55a7f2-8d74-4fa3-ade1-cf0c29c83545 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:49.095114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd55a7f2-8d74-4fa3-ade1-cf0c29c83545 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:49.095568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd55a7f2-8d74-4fa3-ade1-cf0c29c83545 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:49.095987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd55a7f2-8d74-4fa3-ade1-cf0c29c83545 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:49.126805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dd55a7f2-8d74-4fa3-ade1-cf0c29c83545 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046059 Aug 31 00:41:49.127384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 758/1441] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:49.182082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e82005fe-9170-4c3c-ad0f-bf6cbe53bdc8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:49.184204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e82005fe-9170-4c3c-ad0f-bf6cbe53bdc8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:49.190576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82005fe-9170-4c3c-ad0f-bf6cbe53bdc8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:49.191058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82005fe-9170-4c3c-ad0f-bf6cbe53bdc8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:49.191513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82005fe-9170-4c3c-ad0f-bf6cbe53bdc8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:49.192188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82005fe-9170-4c3c-ad0f-bf6cbe53bdc8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:49.192631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82005fe-9170-4c3c-ad0f-bf6cbe53bdc8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:49.193054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e82005fe-9170-4c3c-ad0f-bf6cbe53bdc8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:49.221941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e82005fe-9170-4c3c-ad0f-bf6cbe53bdc8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044354 Aug 31 00:41:49.222488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 684/1442] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:50.139422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-53b03b8f-b5df-4559-b3f1-7423cebac936 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:50.141484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-53b03b8f-b5df-4559-b3f1-7423cebac936 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:50.147864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53b03b8f-b5df-4559-b3f1-7423cebac936 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:50.148337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53b03b8f-b5df-4559-b3f1-7423cebac936 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:50.148760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53b03b8f-b5df-4559-b3f1-7423cebac936 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:50.149434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53b03b8f-b5df-4559-b3f1-7423cebac936 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:50.149875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53b03b8f-b5df-4559-b3f1-7423cebac936 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:50.150285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53b03b8f-b5df-4559-b3f1-7423cebac936 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:50.187051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-53b03b8f-b5df-4559-b3f1-7423cebac936 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051617 Aug 31 00:41:50.187621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 759/1443] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:50.235596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-69f08ee2-deb9-4623-a44c-742d40e615c7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:50.237854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-69f08ee2-deb9-4623-a44c-742d40e615c7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:50.244457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f08ee2-deb9-4623-a44c-742d40e615c7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:50.244932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f08ee2-deb9-4623-a44c-742d40e615c7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:50.245365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f08ee2-deb9-4623-a44c-742d40e615c7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:50.246043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f08ee2-deb9-4623-a44c-742d40e615c7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:50.246491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f08ee2-deb9-4623-a44c-742d40e615c7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:50.246911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f08ee2-deb9-4623-a44c-742d40e615c7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:50.276723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-69f08ee2-deb9-4623-a44c-742d40e615c7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045386 Aug 31 00:41:50.277267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 685/1444] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:51.200238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8e7b94a3-ea1f-4bb3-8f39-ccfb8e90d117 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:51.202363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8e7b94a3-ea1f-4bb3-8f39-ccfb8e90d117 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:51.208539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e7b94a3-ea1f-4bb3-8f39-ccfb8e90d117 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:51.209000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e7b94a3-ea1f-4bb3-8f39-ccfb8e90d117 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:51.209469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e7b94a3-ea1f-4bb3-8f39-ccfb8e90d117 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:51.210203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e7b94a3-ea1f-4bb3-8f39-ccfb8e90d117 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:51.210737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e7b94a3-ea1f-4bb3-8f39-ccfb8e90d117 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:51.211223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e7b94a3-ea1f-4bb3-8f39-ccfb8e90d117 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:51.242163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8e7b94a3-ea1f-4bb3-8f39-ccfb8e90d117 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Aug 31 00:41:51.242714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 760/1445] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:51.289542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e259028a-d953-4626-a1eb-9d45c7934858 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:51.291597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e259028a-d953-4626-a1eb-9d45c7934858 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:51.297923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e259028a-d953-4626-a1eb-9d45c7934858 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:51.298393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e259028a-d953-4626-a1eb-9d45c7934858 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:51.298819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e259028a-d953-4626-a1eb-9d45c7934858 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:51.299526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e259028a-d953-4626-a1eb-9d45c7934858 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:51.299984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e259028a-d953-4626-a1eb-9d45c7934858 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:51.300395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e259028a-d953-4626-a1eb-9d45c7934858 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:51.330843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e259028a-d953-4626-a1eb-9d45c7934858 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045789 Aug 31 00:41:51.331448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 686/1446] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:52.253901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d5cb26cd-e668-478e-b335-fd27e028f934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:52.255970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d5cb26cd-e668-478e-b335-fd27e028f934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:52.263081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5cb26cd-e668-478e-b335-fd27e028f934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:52.263564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5cb26cd-e668-478e-b335-fd27e028f934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:52.263998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5cb26cd-e668-478e-b335-fd27e028f934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:52.264682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5cb26cd-e668-478e-b335-fd27e028f934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:52.265131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5cb26cd-e668-478e-b335-fd27e028f934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:52.265552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5cb26cd-e668-478e-b335-fd27e028f934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:52.295794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d5cb26cd-e668-478e-b335-fd27e028f934 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045968 Aug 31 00:41:52.296348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 761/1447] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:52.343620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-51c77279-5b80-4257-a5ac-c46a91880d56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:52.345805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-51c77279-5b80-4257-a5ac-c46a91880d56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:52.352840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51c77279-5b80-4257-a5ac-c46a91880d56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:52.353350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51c77279-5b80-4257-a5ac-c46a91880d56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:52.353804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51c77279-5b80-4257-a5ac-c46a91880d56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:52.354522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51c77279-5b80-4257-a5ac-c46a91880d56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:52.354980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51c77279-5b80-4257-a5ac-c46a91880d56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:52.355426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51c77279-5b80-4257-a5ac-c46a91880d56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:52.386909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-51c77279-5b80-4257-a5ac-c46a91880d56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047429 Aug 31 00:41:52.387493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 687/1448] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:53.308625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ea37c34-d43d-449b-a62b-feb1239e123b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:53.310792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ea37c34-d43d-449b-a62b-feb1239e123b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:53.317282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea37c34-d43d-449b-a62b-feb1239e123b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:53.317765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea37c34-d43d-449b-a62b-feb1239e123b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:53.318201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea37c34-d43d-449b-a62b-feb1239e123b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:53.318920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea37c34-d43d-449b-a62b-feb1239e123b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:53.319559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea37c34-d43d-449b-a62b-feb1239e123b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:53.320284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ea37c34-d43d-449b-a62b-feb1239e123b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:53.350192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ea37c34-d43d-449b-a62b-feb1239e123b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Aug 31 00:41:53.351491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 762/1449] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:53 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:53.400194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9e541451-54d0-4713-8e4a-5219805d359c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:53.402224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9e541451-54d0-4713-8e4a-5219805d359c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:53.408609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e541451-54d0-4713-8e4a-5219805d359c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:53.409088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e541451-54d0-4713-8e4a-5219805d359c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:53.409518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e541451-54d0-4713-8e4a-5219805d359c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:53.410202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e541451-54d0-4713-8e4a-5219805d359c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:53.410650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e541451-54d0-4713-8e4a-5219805d359c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:53.411091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e541451-54d0-4713-8e4a-5219805d359c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:53.440357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9e541451-54d0-4713-8e4a-5219805d359c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044966 Aug 31 00:41:53.440925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 688/1450] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:53 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:54.363316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fe30b90d-0569-4015-b6c6-cb5f6fc2199b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:54.365514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fe30b90d-0569-4015-b6c6-cb5f6fc2199b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:54.372005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe30b90d-0569-4015-b6c6-cb5f6fc2199b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:54.372487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe30b90d-0569-4015-b6c6-cb5f6fc2199b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:54.372921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe30b90d-0569-4015-b6c6-cb5f6fc2199b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:54.373606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe30b90d-0569-4015-b6c6-cb5f6fc2199b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:54.374054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe30b90d-0569-4015-b6c6-cb5f6fc2199b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:54.374473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe30b90d-0569-4015-b6c6-cb5f6fc2199b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:54.405832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fe30b90d-0569-4015-b6c6-cb5f6fc2199b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046440 Aug 31 00:41:54.406393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 763/1451] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:54 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:54.452845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-23e59c55-b4d0-4d79-8761-65c2d133f4ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:54.454932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-23e59c55-b4d0-4d79-8761-65c2d133f4ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:54.462487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e59c55-b4d0-4d79-8761-65c2d133f4ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:54.462956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e59c55-b4d0-4d79-8761-65c2d133f4ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:54.463407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e59c55-b4d0-4d79-8761-65c2d133f4ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:54.464081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e59c55-b4d0-4d79-8761-65c2d133f4ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:54.464526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e59c55-b4d0-4d79-8761-65c2d133f4ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:54.464936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e59c55-b4d0-4d79-8761-65c2d133f4ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:54.495108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-23e59c55-b4d0-4d79-8761-65c2d133f4ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046186 Aug 31 00:41:54.495675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 689/1452] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:55.417927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8cbf8a74-f638-40d3-aa38-65b3cd66dd2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:55.420103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8cbf8a74-f638-40d3-aa38-65b3cd66dd2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:55.426458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cbf8a74-f638-40d3-aa38-65b3cd66dd2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:55.426935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cbf8a74-f638-40d3-aa38-65b3cd66dd2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:55.427387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cbf8a74-f638-40d3-aa38-65b3cd66dd2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:55.428072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cbf8a74-f638-40d3-aa38-65b3cd66dd2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:55.428521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cbf8a74-f638-40d3-aa38-65b3cd66dd2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:55.429481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cbf8a74-f638-40d3-aa38-65b3cd66dd2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:55.460311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8cbf8a74-f638-40d3-aa38-65b3cd66dd2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 Aug 31 00:41:55.460891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 764/1453] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:55 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:55.508633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-276bdd26-d575-4008-8ec7-cf49c5574be4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:55.510763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-276bdd26-d575-4008-8ec7-cf49c5574be4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:55.517164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-276bdd26-d575-4008-8ec7-cf49c5574be4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:55.517648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-276bdd26-d575-4008-8ec7-cf49c5574be4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:55.518072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-276bdd26-d575-4008-8ec7-cf49c5574be4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:55.518784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-276bdd26-d575-4008-8ec7-cf49c5574be4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:55.519254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-276bdd26-d575-4008-8ec7-cf49c5574be4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:55.519678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-276bdd26-d575-4008-8ec7-cf49c5574be4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:55.548400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-276bdd26-d575-4008-8ec7-cf49c5574be4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044383 Aug 31 00:41:55.548906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 690/1454] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:56.472783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9eb31fb9-c82e-4e7a-8c3d-d8fe13c26702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:56.474901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9eb31fb9-c82e-4e7a-8c3d-d8fe13c26702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:56.482561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eb31fb9-c82e-4e7a-8c3d-d8fe13c26702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:56.483066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eb31fb9-c82e-4e7a-8c3d-d8fe13c26702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:56.483503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eb31fb9-c82e-4e7a-8c3d-d8fe13c26702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:56.484200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eb31fb9-c82e-4e7a-8c3d-d8fe13c26702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:56.484656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eb31fb9-c82e-4e7a-8c3d-d8fe13c26702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:56.485081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eb31fb9-c82e-4e7a-8c3d-d8fe13c26702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:56.520080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9eb31fb9-c82e-4e7a-8c3d-d8fe13c26702 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049175 Aug 31 00:41:56.522174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 765/1455] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:56.561212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d8261826-298b-4b58-9ad6-221194558242 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:56.563346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d8261826-298b-4b58-9ad6-221194558242 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:56.565626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=58 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:56.571327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8261826-298b-4b58-9ad6-221194558242 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:56.571812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8261826-298b-4b58-9ad6-221194558242 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:56.572247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8261826-298b-4b58-9ad6-221194558242 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:56.572937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8261826-298b-4b58-9ad6-221194558242 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:56.573389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8261826-298b-4b58-9ad6-221194558242 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:56.573811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8261826-298b-4b58-9ad6-221194558242 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:56.604270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d8261826-298b-4b58-9ad6-221194558242 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046987 Aug 31 00:41:56.604837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 691/1456] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:57.534245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a009b392-0a3c-411e-9140-1a2333f301d5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:57.536293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a009b392-0a3c-411e-9140-1a2333f301d5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:57.542987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a009b392-0a3c-411e-9140-1a2333f301d5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:57.543494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a009b392-0a3c-411e-9140-1a2333f301d5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:57.543920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a009b392-0a3c-411e-9140-1a2333f301d5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:57.544603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a009b392-0a3c-411e-9140-1a2333f301d5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:57.545049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a009b392-0a3c-411e-9140-1a2333f301d5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:57.545466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a009b392-0a3c-411e-9140-1a2333f301d5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:57.576250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a009b392-0a3c-411e-9140-1a2333f301d5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Aug 31 00:41:57.576824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 766/1457] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:57.617440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0e0c9480-8c80-415f-9424-2feeee122e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:57.619568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0e0c9480-8c80-415f-9424-2feeee122e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:57.625903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e0c9480-8c80-415f-9424-2feeee122e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:57.626595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e0c9480-8c80-415f-9424-2feeee122e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:57.627028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e0c9480-8c80-415f-9424-2feeee122e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:57.627740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e0c9480-8c80-415f-9424-2feeee122e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:57.628187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e0c9480-8c80-415f-9424-2feeee122e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:57.628699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e0c9480-8c80-415f-9424-2feeee122e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:57.659110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0e0c9480-8c80-415f-9424-2feeee122e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046044 Aug 31 00:41:57.659687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 692/1458] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:58.588829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-263efee0-fc6d-4686-9be8-a617d9d965c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:58.590980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-263efee0-fc6d-4686-9be8-a617d9d965c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:58.597490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263efee0-fc6d-4686-9be8-a617d9d965c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:58.597971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263efee0-fc6d-4686-9be8-a617d9d965c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:58.598400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263efee0-fc6d-4686-9be8-a617d9d965c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:58.599113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263efee0-fc6d-4686-9be8-a617d9d965c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:58.599563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263efee0-fc6d-4686-9be8-a617d9d965c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:58.599986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263efee0-fc6d-4686-9be8-a617d9d965c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:58.630034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-263efee0-fc6d-4686-9be8-a617d9d965c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045324 Aug 31 00:41:58.630595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 767/1459] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:41:58.673857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ad6c42f4-4850-4fc9-a80a-112e1afcc702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:58.675975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ad6c42f4-4850-4fc9-a80a-112e1afcc702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:58.683092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6c42f4-4850-4fc9-a80a-112e1afcc702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:58.683565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6c42f4-4850-4fc9-a80a-112e1afcc702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:58.683987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6c42f4-4850-4fc9-a80a-112e1afcc702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:58.684664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6c42f4-4850-4fc9-a80a-112e1afcc702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:58.685110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6c42f4-4850-4fc9-a80a-112e1afcc702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:58.685519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6c42f4-4850-4fc9-a80a-112e1afcc702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:58.715568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ad6c42f4-4850-4fc9-a80a-112e1afcc702 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046704 Aug 31 00:41:58.716139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 693/1460] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:59.643943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bfad9480-dbaf-4da3-a714-8f8b8909b49f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:59.646182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bfad9480-dbaf-4da3-a714-8f8b8909b49f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:59.649455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=58 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:59.654906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfad9480-dbaf-4da3-a714-8f8b8909b49f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:59.655424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfad9480-dbaf-4da3-a714-8f8b8909b49f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:59.655888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfad9480-dbaf-4da3-a714-8f8b8909b49f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:59.656573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfad9480-dbaf-4da3-a714-8f8b8909b49f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:59.657018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfad9480-dbaf-4da3-a714-8f8b8909b49f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:59.657433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfad9480-dbaf-4da3-a714-8f8b8909b49f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:59.687710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bfad9480-dbaf-4da3-a714-8f8b8909b49f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049085 Aug 31 00:41:59.688264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 768/1461] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:59.729188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fcf71f29-2cf7-4e65-8fc1-23218f9fa770 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:59.731611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fcf71f29-2cf7-4e65-8fc1-23218f9fa770 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:59.738242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcf71f29-2cf7-4e65-8fc1-23218f9fa770 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:59.738717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcf71f29-2cf7-4e65-8fc1-23218f9fa770 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:59.739176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcf71f29-2cf7-4e65-8fc1-23218f9fa770 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:59.739878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcf71f29-2cf7-4e65-8fc1-23218f9fa770 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:59.740310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcf71f29-2cf7-4e65-8fc1-23218f9fa770 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:59.740729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcf71f29-2cf7-4e65-8fc1-23218f9fa770 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:59.771377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fcf71f29-2cf7-4e65-8fc1-23218f9fa770 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047196 Aug 31 00:41:59.771936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 694/1462] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:41:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:00.701134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2b9be8ee-0ba5-4dc2-91ba-4b78dde24876 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:00.703305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2b9be8ee-0ba5-4dc2-91ba-4b78dde24876 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:00.709920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9be8ee-0ba5-4dc2-91ba-4b78dde24876 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:00.710715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9be8ee-0ba5-4dc2-91ba-4b78dde24876 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:00.711200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9be8ee-0ba5-4dc2-91ba-4b78dde24876 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:00.711935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9be8ee-0ba5-4dc2-91ba-4b78dde24876 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:00.712389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9be8ee-0ba5-4dc2-91ba-4b78dde24876 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:00.712815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9be8ee-0ba5-4dc2-91ba-4b78dde24876 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:00.729504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:00.744108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2b9be8ee-0ba5-4dc2-91ba-4b78dde24876 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047016 Aug 31 00:42:00.744679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 769/1463] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:00.783715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ae421b2f-e0bf-49de-b3c9-388af6611387 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:00.785880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ae421b2f-e0bf-49de-b3c9-388af6611387 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:00.792934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae421b2f-e0bf-49de-b3c9-388af6611387 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:00.793421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae421b2f-e0bf-49de-b3c9-388af6611387 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:00.793859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae421b2f-e0bf-49de-b3c9-388af6611387 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:00.794557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae421b2f-e0bf-49de-b3c9-388af6611387 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:00.795006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae421b2f-e0bf-49de-b3c9-388af6611387 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:00.795458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae421b2f-e0bf-49de-b3c9-388af6611387 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:00.826814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ae421b2f-e0bf-49de-b3c9-388af6611387 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047017 Aug 31 00:42:00.827418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 695/1464] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:01.756426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-55fa38cb-0041-45db-b6b4-d266f06cdd96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:01.759116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-55fa38cb-0041-45db-b6b4-d266f06cdd96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:01.765609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55fa38cb-0041-45db-b6b4-d266f06cdd96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:01.766087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55fa38cb-0041-45db-b6b4-d266f06cdd96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:01.766513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55fa38cb-0041-45db-b6b4-d266f06cdd96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:01.767226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55fa38cb-0041-45db-b6b4-d266f06cdd96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:01.767677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55fa38cb-0041-45db-b6b4-d266f06cdd96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:01.768096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55fa38cb-0041-45db-b6b4-d266f06cdd96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:01.798329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-55fa38cb-0041-45db-b6b4-d266f06cdd96 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045783 Aug 31 00:42:01.798900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 770/1465] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:01.840138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b1671a70-5281-4a07-9934-44f8f717d519 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:01.842230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b1671a70-5281-4a07-9934-44f8f717d519 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:01.848603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1671a70-5281-4a07-9934-44f8f717d519 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:01.849078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1671a70-5281-4a07-9934-44f8f717d519 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:01.849508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1671a70-5281-4a07-9934-44f8f717d519 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:01.850191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1671a70-5281-4a07-9934-44f8f717d519 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:01.850673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1671a70-5281-4a07-9934-44f8f717d519 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:01.851197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1671a70-5281-4a07-9934-44f8f717d519 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:01.880405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b1671a70-5281-4a07-9934-44f8f717d519 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044406 Aug 31 00:42:01.880955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 696/1466] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:02.811413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1e84570e-e779-4ed3-b194-124936e416bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:02.813539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1e84570e-e779-4ed3-b194-124936e416bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:02.820225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84570e-e779-4ed3-b194-124936e416bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:02.820698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84570e-e779-4ed3-b194-124936e416bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:02.821125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84570e-e779-4ed3-b194-124936e416bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:02.821819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84570e-e779-4ed3-b194-124936e416bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:02.822274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84570e-e779-4ed3-b194-124936e416bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:02.822693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84570e-e779-4ed3-b194-124936e416bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:02.853140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1e84570e-e779-4ed3-b194-124936e416bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Aug 31 00:42:02.853699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 771/1467] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:02.893465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-81c25c69-d693-4808-a301-10a7d292f499 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:02.895553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-81c25c69-d693-4808-a301-10a7d292f499 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:02.907208 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81c25c69-d693-4808-a301-10a7d292f499 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:02.907710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81c25c69-d693-4808-a301-10a7d292f499 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:02.908149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81c25c69-d693-4808-a301-10a7d292f499 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:02.909185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81c25c69-d693-4808-a301-10a7d292f499 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:02.909705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81c25c69-d693-4808-a301-10a7d292f499 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:02.910137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81c25c69-d693-4808-a301-10a7d292f499 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:02.940076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-81c25c69-d693-4808-a301-10a7d292f499 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050650 Aug 31 00:42:02.940625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 697/1468] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:03.865498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aefa8e3f-078f-42a4-890d-92dc5e76b6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:03.867869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aefa8e3f-078f-42a4-890d-92dc5e76b6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:03.874315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aefa8e3f-078f-42a4-890d-92dc5e76b6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.874798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aefa8e3f-078f-42a4-890d-92dc5e76b6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.875298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aefa8e3f-078f-42a4-890d-92dc5e76b6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.876022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aefa8e3f-078f-42a4-890d-92dc5e76b6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.876475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aefa8e3f-078f-42a4-890d-92dc5e76b6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.876897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aefa8e3f-078f-42a4-890d-92dc5e76b6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.907516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aefa8e3f-078f-42a4-890d-92dc5e76b6f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046082 Aug 31 00:42:03.908072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 772/1469] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:03.953022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1e5263f8-8609-4b4d-bb97-a6c679df71e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:03.955215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1e5263f8-8609-4b4d-bb97-a6c679df71e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:03.962981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e5263f8-8609-4b4d-bb97-a6c679df71e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.963496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e5263f8-8609-4b4d-bb97-a6c679df71e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.963929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e5263f8-8609-4b4d-bb97-a6c679df71e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.964617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e5263f8-8609-4b4d-bb97-a6c679df71e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.965098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e5263f8-8609-4b4d-bb97-a6c679df71e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.965519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e5263f8-8609-4b4d-bb97-a6c679df71e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.992238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:03.998414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1e5263f8-8609-4b4d-bb97-a6c679df71e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049698 Aug 31 00:42:03.998985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 698/1470] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:04.920706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-83eabcc2-51c0-4a5e-a49e-8c00a231b745 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:04.922849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-83eabcc2-51c0-4a5e-a49e-8c00a231b745 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:04.930316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83eabcc2-51c0-4a5e-a49e-8c00a231b745 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:04.930798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83eabcc2-51c0-4a5e-a49e-8c00a231b745 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:04.931265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83eabcc2-51c0-4a5e-a49e-8c00a231b745 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:04.931962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83eabcc2-51c0-4a5e-a49e-8c00a231b745 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:04.932413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83eabcc2-51c0-4a5e-a49e-8c00a231b745 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:04.932839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83eabcc2-51c0-4a5e-a49e-8c00a231b745 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:04.962448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-83eabcc2-51c0-4a5e-a49e-8c00a231b745 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045960 Aug 31 00:42:04.962989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 773/1471] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:05.010035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93d9a387-0acd-4ad5-9fcc-8c9f5f8d8772 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:05.012152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-93d9a387-0acd-4ad5-9fcc-8c9f5f8d8772 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:05.018579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d9a387-0acd-4ad5-9fcc-8c9f5f8d8772 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:05.019085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d9a387-0acd-4ad5-9fcc-8c9f5f8d8772 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:05.019521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d9a387-0acd-4ad5-9fcc-8c9f5f8d8772 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:05.020204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d9a387-0acd-4ad5-9fcc-8c9f5f8d8772 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:05.020669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d9a387-0acd-4ad5-9fcc-8c9f5f8d8772 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:05.021087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93d9a387-0acd-4ad5-9fcc-8c9f5f8d8772 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:05.050654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-93d9a387-0acd-4ad5-9fcc-8c9f5f8d8772 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044641 Aug 31 00:42:05.051231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 699/1472] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:42:05.974922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bc87e2d7-ff7c-4007-ab13-485955c8c2df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:05.977759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bc87e2d7-ff7c-4007-ab13-485955c8c2df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:05.984478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc87e2d7-ff7c-4007-ab13-485955c8c2df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:05.984960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc87e2d7-ff7c-4007-ab13-485955c8c2df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:05.985395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc87e2d7-ff7c-4007-ab13-485955c8c2df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:05.986087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc87e2d7-ff7c-4007-ab13-485955c8c2df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:05.986540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc87e2d7-ff7c-4007-ab13-485955c8c2df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:05.986962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc87e2d7-ff7c-4007-ab13-485955c8c2df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:06.016927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bc87e2d7-ff7c-4007-ab13-485955c8c2df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046049 Aug 31 00:42:06.017488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 774/1473] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:06.063704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2ad709ce-2e52-426e-80e5-8a18dcfe0f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:06.065839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2ad709ce-2e52-426e-80e5-8a18dcfe0f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:06.072496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad709ce-2e52-426e-80e5-8a18dcfe0f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:06.072974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad709ce-2e52-426e-80e5-8a18dcfe0f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:06.073420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad709ce-2e52-426e-80e5-8a18dcfe0f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:06.074097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad709ce-2e52-426e-80e5-8a18dcfe0f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:06.074543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad709ce-2e52-426e-80e5-8a18dcfe0f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:06.074962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad709ce-2e52-426e-80e5-8a18dcfe0f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:06.105770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2ad709ce-2e52-426e-80e5-8a18dcfe0f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046029 Aug 31 00:42:06.106579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 700/1474] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:07.028801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e301ee64-7f9a-48fa-8158-b8499156a061 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:07.030966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e301ee64-7f9a-48fa-8158-b8499156a061 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:07.037662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e301ee64-7f9a-48fa-8158-b8499156a061 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:07.038700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e301ee64-7f9a-48fa-8158-b8499156a061 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:07.039251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e301ee64-7f9a-48fa-8158-b8499156a061 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:07.039949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e301ee64-7f9a-48fa-8158-b8499156a061 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:07.040400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e301ee64-7f9a-48fa-8158-b8499156a061 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:07.040817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e301ee64-7f9a-48fa-8158-b8499156a061 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:07.070573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e301ee64-7f9a-48fa-8158-b8499156a061 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 Aug 31 00:42:07.071130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 775/1475] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:07.118629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e908dde0-3b69-4f44-b8ce-2badf8f05151 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:07.120809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e908dde0-3b69-4f44-b8ce-2badf8f05151 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:07.127421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e908dde0-3b69-4f44-b8ce-2badf8f05151 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:07.127894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e908dde0-3b69-4f44-b8ce-2badf8f05151 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:07.128316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e908dde0-3b69-4f44-b8ce-2badf8f05151 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:07.128988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e908dde0-3b69-4f44-b8ce-2badf8f05151 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:07.129427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e908dde0-3b69-4f44-b8ce-2badf8f05151 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:07.129838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e908dde0-3b69-4f44-b8ce-2badf8f05151 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:07.159696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e908dde0-3b69-4f44-b8ce-2badf8f05151 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045804 Aug 31 00:42:07.160240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 701/1476] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:08.082884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-43a3bec5-5f06-4bef-a8c7-1403904b3628 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:08.085848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-43a3bec5-5f06-4bef-a8c7-1403904b3628 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:08.092232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43a3bec5-5f06-4bef-a8c7-1403904b3628 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:08.092706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43a3bec5-5f06-4bef-a8c7-1403904b3628 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:08.093133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43a3bec5-5f06-4bef-a8c7-1403904b3628 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:08.093816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43a3bec5-5f06-4bef-a8c7-1403904b3628 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:08.094258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43a3bec5-5f06-4bef-a8c7-1403904b3628 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:08.094668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43a3bec5-5f06-4bef-a8c7-1403904b3628 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:08.125578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-43a3bec5-5f06-4bef-a8c7-1403904b3628 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 Aug 31 00:42:08.126138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 776/1477] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:08.172363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a02044ed-96c0-4566-b566-a9dd661914a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:08.174543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a02044ed-96c0-4566-b566-a9dd661914a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:08.181543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a02044ed-96c0-4566-b566-a9dd661914a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:08.182025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a02044ed-96c0-4566-b566-a9dd661914a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:08.182456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a02044ed-96c0-4566-b566-a9dd661914a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:08.183166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a02044ed-96c0-4566-b566-a9dd661914a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:08.183619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a02044ed-96c0-4566-b566-a9dd661914a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:08.184040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a02044ed-96c0-4566-b566-a9dd661914a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:08.214221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a02044ed-96c0-4566-b566-a9dd661914a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045950 Aug 31 00:42:08.214798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 702/1478] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:09.138426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-03ac44e7-6822-418d-92d9-5a9d9710600f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:09.140573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-03ac44e7-6822-418d-92d9-5a9d9710600f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:09.146995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03ac44e7-6822-418d-92d9-5a9d9710600f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.147536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03ac44e7-6822-418d-92d9-5a9d9710600f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.147975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03ac44e7-6822-418d-92d9-5a9d9710600f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.148665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03ac44e7-6822-418d-92d9-5a9d9710600f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.149152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03ac44e7-6822-418d-92d9-5a9d9710600f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.149575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03ac44e7-6822-418d-92d9-5a9d9710600f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.179401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-03ac44e7-6822-418d-92d9-5a9d9710600f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Aug 31 00:42:09.179954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 777/1479] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:09.226318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-264dd4f9-63d5-4db9-9f97-68bc11839eae tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:09.228532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-264dd4f9-63d5-4db9-9f97-68bc11839eae tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:09.235003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264dd4f9-63d5-4db9-9f97-68bc11839eae tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.235614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264dd4f9-63d5-4db9-9f97-68bc11839eae tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.236048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264dd4f9-63d5-4db9-9f97-68bc11839eae tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.236714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264dd4f9-63d5-4db9-9f97-68bc11839eae tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.237176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264dd4f9-63d5-4db9-9f97-68bc11839eae tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.237587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-264dd4f9-63d5-4db9-9f97-68bc11839eae tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.267312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-264dd4f9-63d5-4db9-9f97-68bc11839eae tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045383 Aug 31 00:42:09.267790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 703/1480] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:10.191751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c61b8f3d-4314-4738-ae1c-2fe351fa78ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:10.193831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c61b8f3d-4314-4738-ae1c-2fe351fa78ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:10.201001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c61b8f3d-4314-4738-ae1c-2fe351fa78ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.201484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c61b8f3d-4314-4738-ae1c-2fe351fa78ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.201920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c61b8f3d-4314-4738-ae1c-2fe351fa78ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.202621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c61b8f3d-4314-4738-ae1c-2fe351fa78ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.203103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c61b8f3d-4314-4738-ae1c-2fe351fa78ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.203535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c61b8f3d-4314-4738-ae1c-2fe351fa78ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.233782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c61b8f3d-4314-4738-ae1c-2fe351fa78ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046025 Aug 31 00:42:10.234336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 778/1481] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:10.279571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6484d3fe-9cf5-4392-9518-e45a692abf4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:10.281723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6484d3fe-9cf5-4392-9518-e45a692abf4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:10.288123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6484d3fe-9cf5-4392-9518-e45a692abf4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.288697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6484d3fe-9cf5-4392-9518-e45a692abf4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.289129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6484d3fe-9cf5-4392-9518-e45a692abf4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.289808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6484d3fe-9cf5-4392-9518-e45a692abf4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.290250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6484d3fe-9cf5-4392-9518-e45a692abf4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.290665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6484d3fe-9cf5-4392-9518-e45a692abf4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.320239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6484d3fe-9cf5-4392-9518-e45a692abf4b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044605 Aug 31 00:42:10.320766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 704/1482] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:11.246462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7aa7be31-b513-46b2-b552-8f82fbfbe33a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:11.248596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7aa7be31-b513-46b2-b552-8f82fbfbe33a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:11.254931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aa7be31-b513-46b2-b552-8f82fbfbe33a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.255433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aa7be31-b513-46b2-b552-8f82fbfbe33a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.255857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aa7be31-b513-46b2-b552-8f82fbfbe33a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.256567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aa7be31-b513-46b2-b552-8f82fbfbe33a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.257012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aa7be31-b513-46b2-b552-8f82fbfbe33a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.257425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aa7be31-b513-46b2-b552-8f82fbfbe33a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.286543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7aa7be31-b513-46b2-b552-8f82fbfbe33a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044052 Aug 31 00:42:11.287117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 779/1483] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:11.332853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-421d3251-636d-46b3-804f-cff1079af435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:11.335481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-421d3251-636d-46b3-804f-cff1079af435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:11.341836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-421d3251-636d-46b3-804f-cff1079af435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.342310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-421d3251-636d-46b3-804f-cff1079af435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.342744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-421d3251-636d-46b3-804f-cff1079af435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.343450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-421d3251-636d-46b3-804f-cff1079af435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.343903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-421d3251-636d-46b3-804f-cff1079af435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.344324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-421d3251-636d-46b3-804f-cff1079af435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.375012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-421d3251-636d-46b3-804f-cff1079af435 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046267 Aug 31 00:42:11.375605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 705/1484] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:12.299548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b9f345a8-9786-4ec3-8e9e-88770c6adfd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:12.301728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b9f345a8-9786-4ec3-8e9e-88770c6adfd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:12.308162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f345a8-9786-4ec3-8e9e-88770c6adfd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.308642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f345a8-9786-4ec3-8e9e-88770c6adfd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.309106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f345a8-9786-4ec3-8e9e-88770c6adfd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.309786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f345a8-9786-4ec3-8e9e-88770c6adfd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.310233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f345a8-9786-4ec3-8e9e-88770c6adfd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.310651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f345a8-9786-4ec3-8e9e-88770c6adfd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.340862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b9f345a8-9786-4ec3-8e9e-88770c6adfd7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Aug 31 00:42:12.341419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 780/1485] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:12.388340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-84e95518-c297-47c9-95a3-fb492fa90a22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:12.390464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-84e95518-c297-47c9-95a3-fb492fa90a22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:12.396980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84e95518-c297-47c9-95a3-fb492fa90a22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.397989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84e95518-c297-47c9-95a3-fb492fa90a22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.398504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84e95518-c297-47c9-95a3-fb492fa90a22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.399223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84e95518-c297-47c9-95a3-fb492fa90a22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.399684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84e95518-c297-47c9-95a3-fb492fa90a22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.400088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84e95518-c297-47c9-95a3-fb492fa90a22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.428943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-84e95518-c297-47c9-95a3-fb492fa90a22 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044403 Aug 31 00:42:12.429497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 706/1486] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:42:13.353961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ba396570-cfea-4a8e-b404-1deca89c66c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:13.356092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ba396570-cfea-4a8e-b404-1deca89c66c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:13.362645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba396570-cfea-4a8e-b404-1deca89c66c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.363158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba396570-cfea-4a8e-b404-1deca89c66c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.363588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba396570-cfea-4a8e-b404-1deca89c66c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.364264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba396570-cfea-4a8e-b404-1deca89c66c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.364706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba396570-cfea-4a8e-b404-1deca89c66c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.365119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba396570-cfea-4a8e-b404-1deca89c66c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.393847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ba396570-cfea-4a8e-b404-1deca89c66c3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Aug 31 00:42:13.394385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 781/1487] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:13.441304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-035f8bf2-0b4e-4b0f-8b99-4ba98942a1bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:13.443528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-035f8bf2-0b4e-4b0f-8b99-4ba98942a1bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:13.449975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-035f8bf2-0b4e-4b0f-8b99-4ba98942a1bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.450456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-035f8bf2-0b4e-4b0f-8b99-4ba98942a1bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.450904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-035f8bf2-0b4e-4b0f-8b99-4ba98942a1bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.451604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-035f8bf2-0b4e-4b0f-8b99-4ba98942a1bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.452053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-035f8bf2-0b4e-4b0f-8b99-4ba98942a1bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.452477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-035f8bf2-0b4e-4b0f-8b99-4ba98942a1bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.483184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-035f8bf2-0b4e-4b0f-8b99-4ba98942a1bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045738 Aug 31 00:42:13.483747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 707/1488] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:14.406857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f5118c00-d402-40df-af03-2bed64b27de6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:14.409031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f5118c00-d402-40df-af03-2bed64b27de6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:14.415647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5118c00-d402-40df-af03-2bed64b27de6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.416126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5118c00-d402-40df-af03-2bed64b27de6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.416564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5118c00-d402-40df-af03-2bed64b27de6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.417250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5118c00-d402-40df-af03-2bed64b27de6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.417700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5118c00-d402-40df-af03-2bed64b27de6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.418119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5118c00-d402-40df-af03-2bed64b27de6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.447767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f5118c00-d402-40df-af03-2bed64b27de6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Aug 31 00:42:14.448317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 782/1489] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:14.497827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5547b4f2-08b5-4e69-b433-328a05a3d54d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:14.499942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5547b4f2-08b5-4e69-b433-328a05a3d54d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:14.506221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5547b4f2-08b5-4e69-b433-328a05a3d54d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.507660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5547b4f2-08b5-4e69-b433-328a05a3d54d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.508089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5547b4f2-08b5-4e69-b433-328a05a3d54d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.508762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5547b4f2-08b5-4e69-b433-328a05a3d54d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.509225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5547b4f2-08b5-4e69-b433-328a05a3d54d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.509640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5547b4f2-08b5-4e69-b433-328a05a3d54d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.537946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5547b4f2-08b5-4e69-b433-328a05a3d54d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045352 Aug 31 00:42:14.538483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 708/1490] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:15.459517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a287de0d-60f5-4c3f-b018-4c4080f6f24b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:15.461685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a287de0d-60f5-4c3f-b018-4c4080f6f24b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:15.468116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a287de0d-60f5-4c3f-b018-4c4080f6f24b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.468623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a287de0d-60f5-4c3f-b018-4c4080f6f24b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.469051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a287de0d-60f5-4c3f-b018-4c4080f6f24b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.469732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a287de0d-60f5-4c3f-b018-4c4080f6f24b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.470180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a287de0d-60f5-4c3f-b018-4c4080f6f24b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.470596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a287de0d-60f5-4c3f-b018-4c4080f6f24b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.500617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a287de0d-60f5-4c3f-b018-4c4080f6f24b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Aug 31 00:42:15.501162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 783/1491] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:15.550573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f25e34d1-ea3a-46f0-9395-c8fafcb49e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:15.552637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f25e34d1-ea3a-46f0-9395-c8fafcb49e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:15.559799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f25e34d1-ea3a-46f0-9395-c8fafcb49e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.560275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f25e34d1-ea3a-46f0-9395-c8fafcb49e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.560692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f25e34d1-ea3a-46f0-9395-c8fafcb49e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.561371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f25e34d1-ea3a-46f0-9395-c8fafcb49e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.561813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f25e34d1-ea3a-46f0-9395-c8fafcb49e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.562228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f25e34d1-ea3a-46f0-9395-c8fafcb49e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.591389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f25e34d1-ea3a-46f0-9395-c8fafcb49e46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044816 Aug 31 00:42:15.591931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 709/1492] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:16.513639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9214a89a-a390-4234-92bf-62fa16e0182a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:16.515918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9214a89a-a390-4234-92bf-62fa16e0182a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:16.524439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9214a89a-a390-4234-92bf-62fa16e0182a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:16.524927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9214a89a-a390-4234-92bf-62fa16e0182a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:16.525367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9214a89a-a390-4234-92bf-62fa16e0182a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:16.526078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9214a89a-a390-4234-92bf-62fa16e0182a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:16.526527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9214a89a-a390-4234-92bf-62fa16e0182a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:16.526948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9214a89a-a390-4234-92bf-62fa16e0182a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:16.564937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9214a89a-a390-4234-92bf-62fa16e0182a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053223 Aug 31 00:42:16.566572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 784/1493] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:16.605125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ea286354-6579-42a8-bfe9-849e87d4c88d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:16.607604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ea286354-6579-42a8-bfe9-849e87d4c88d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:16.616836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea286354-6579-42a8-bfe9-849e87d4c88d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:16.617716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea286354-6579-42a8-bfe9-849e87d4c88d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:16.618516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea286354-6579-42a8-bfe9-849e87d4c88d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:16.619484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea286354-6579-42a8-bfe9-849e87d4c88d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:16.619941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea286354-6579-42a8-bfe9-849e87d4c88d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:16.620564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea286354-6579-42a8-bfe9-849e87d4c88d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:16.656770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ea286354-6579-42a8-bfe9-849e87d4c88d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056802 Aug 31 00:42:16.657340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 710/1494] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:17.578912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e5c36739-295c-414e-b137-61bfb8aad4aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:17.581081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e5c36739-295c-414e-b137-61bfb8aad4aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:17.588167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5c36739-295c-414e-b137-61bfb8aad4aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.588645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5c36739-295c-414e-b137-61bfb8aad4aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.589075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5c36739-295c-414e-b137-61bfb8aad4aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.589760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5c36739-295c-414e-b137-61bfb8aad4aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.590207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5c36739-295c-414e-b137-61bfb8aad4aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.590624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5c36739-295c-414e-b137-61bfb8aad4aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.620160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e5c36739-295c-414e-b137-61bfb8aad4aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Aug 31 00:42:17.620716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 785/1495] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:17.669999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-066e0251-16d7-4416-9295-2b1ba4b37529 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:17.672188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-066e0251-16d7-4416-9295-2b1ba4b37529 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:17.678505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-066e0251-16d7-4416-9295-2b1ba4b37529 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.678972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-066e0251-16d7-4416-9295-2b1ba4b37529 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.679433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-066e0251-16d7-4416-9295-2b1ba4b37529 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.680137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-066e0251-16d7-4416-9295-2b1ba4b37529 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.680583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-066e0251-16d7-4416-9295-2b1ba4b37529 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.681004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-066e0251-16d7-4416-9295-2b1ba4b37529 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.710659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-066e0251-16d7-4416-9295-2b1ba4b37529 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044487 Aug 31 00:42:17.711278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 711/1496] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:18.631684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e391cfcc-afc5-41b9-9d1e-89592ad35838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:18.633914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e391cfcc-afc5-41b9-9d1e-89592ad35838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:18.640336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e391cfcc-afc5-41b9-9d1e-89592ad35838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.640818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e391cfcc-afc5-41b9-9d1e-89592ad35838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.641252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e391cfcc-afc5-41b9-9d1e-89592ad35838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.641945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e391cfcc-afc5-41b9-9d1e-89592ad35838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.642397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e391cfcc-afc5-41b9-9d1e-89592ad35838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.642818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e391cfcc-afc5-41b9-9d1e-89592ad35838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.646404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:18.672449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e391cfcc-afc5-41b9-9d1e-89592ad35838 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Aug 31 00:42:18.672999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 786/1497] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:18 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:18.722758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-67f05849-5cc2-489d-9455-56bb14d9a018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:18.726341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-67f05849-5cc2-489d-9455-56bb14d9a018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:18.732989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67f05849-5cc2-489d-9455-56bb14d9a018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.733497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67f05849-5cc2-489d-9455-56bb14d9a018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.733933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67f05849-5cc2-489d-9455-56bb14d9a018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.734618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67f05849-5cc2-489d-9455-56bb14d9a018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.735091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67f05849-5cc2-489d-9455-56bb14d9a018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.735516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67f05849-5cc2-489d-9455-56bb14d9a018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.765266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-67f05849-5cc2-489d-9455-56bb14d9a018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046867 Aug 31 00:42:18.765816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 712/1498] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:19.685292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fa8fc602-d9ab-41f4-b45e-bb309f64c69c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.687408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fa8fc602-d9ab-41f4-b45e-bb309f64c69c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:19.693721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa8fc602-d9ab-41f4-b45e-bb309f64c69c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.695009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa8fc602-d9ab-41f4-b45e-bb309f64c69c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.695462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa8fc602-d9ab-41f4-b45e-bb309f64c69c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.696142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa8fc602-d9ab-41f4-b45e-bb309f64c69c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.696590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa8fc602-d9ab-41f4-b45e-bb309f64c69c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.697007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa8fc602-d9ab-41f4-b45e-bb309f64c69c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.726795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fa8fc602-d9ab-41f4-b45e-bb309f64c69c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045410 Aug 31 00:42:19.727373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 787/1499] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:19.777695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-06a8eec4-d06d-437d-8502-583f58a337e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.779856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-06a8eec4-d06d-437d-8502-583f58a337e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:19.786277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a8eec4-d06d-437d-8502-583f58a337e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.786751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a8eec4-d06d-437d-8502-583f58a337e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.787216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a8eec4-d06d-437d-8502-583f58a337e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.788099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a8eec4-d06d-437d-8502-583f58a337e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.788549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a8eec4-d06d-437d-8502-583f58a337e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.788967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a8eec4-d06d-437d-8502-583f58a337e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.818201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-06a8eec4-d06d-437d-8502-583f58a337e8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044401 Aug 31 00:42:19.818755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 713/1500] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:20.739105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8e8eccf1-a917-4e01-be4c-ebd2de653363 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:20.741782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8e8eccf1-a917-4e01-be4c-ebd2de653363 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:20.747830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e8eccf1-a917-4e01-be4c-ebd2de653363 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.748307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e8eccf1-a917-4e01-be4c-ebd2de653363 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.748736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e8eccf1-a917-4e01-be4c-ebd2de653363 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.749410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e8eccf1-a917-4e01-be4c-ebd2de653363 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.749853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e8eccf1-a917-4e01-be4c-ebd2de653363 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.750264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e8eccf1-a917-4e01-be4c-ebd2de653363 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.781220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8e8eccf1-a917-4e01-be4c-ebd2de653363 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046137 Aug 31 00:42:20.781788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 788/1501] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:20.830066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8550df46-ad0f-41e7-872f-c49d94db48d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:20.832190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8550df46-ad0f-41e7-872f-c49d94db48d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:20.838631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8550df46-ad0f-41e7-872f-c49d94db48d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.839139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8550df46-ad0f-41e7-872f-c49d94db48d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.839569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8550df46-ad0f-41e7-872f-c49d94db48d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.840246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8550df46-ad0f-41e7-872f-c49d94db48d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.840689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8550df46-ad0f-41e7-872f-c49d94db48d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.841106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8550df46-ad0f-41e7-872f-c49d94db48d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.871319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8550df46-ad0f-41e7-872f-c49d94db48d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045091 Aug 31 00:42:20.871877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 714/1502] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:21.794093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bbe1fd8b-73dd-4709-a36b-c22c98542b4b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:21.796218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bbe1fd8b-73dd-4709-a36b-c22c98542b4b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:21.802548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbe1fd8b-73dd-4709-a36b-c22c98542b4b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.803017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbe1fd8b-73dd-4709-a36b-c22c98542b4b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.804103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbe1fd8b-73dd-4709-a36b-c22c98542b4b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.804870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbe1fd8b-73dd-4709-a36b-c22c98542b4b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.805341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbe1fd8b-73dd-4709-a36b-c22c98542b4b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.805765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbe1fd8b-73dd-4709-a36b-c22c98542b4b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.834431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bbe1fd8b-73dd-4709-a36b-c22c98542b4b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044310 Aug 31 00:42:21.835513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 789/1503] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:21 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:21.885778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-15773ac8-bc22-4cea-bbc9-bca833b44043 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:21.889476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-15773ac8-bc22-4cea-bbc9-bca833b44043 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:21.896682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15773ac8-bc22-4cea-bbc9-bca833b44043 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.897857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15773ac8-bc22-4cea-bbc9-bca833b44043 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.898517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15773ac8-bc22-4cea-bbc9-bca833b44043 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.899238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15773ac8-bc22-4cea-bbc9-bca833b44043 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.899691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15773ac8-bc22-4cea-bbc9-bca833b44043 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.900112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15773ac8-bc22-4cea-bbc9-bca833b44043 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.916804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:21.931787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-15773ac8-bc22-4cea-bbc9-bca833b44043 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051849 Aug 31 00:42:21.932357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 715/1504] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:22.845894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-88d61eab-0ea7-4604-acc5-5f13cab11a31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:22.848039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-88d61eab-0ea7-4604-acc5-5f13cab11a31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:22.856149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88d61eab-0ea7-4604-acc5-5f13cab11a31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.857126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88d61eab-0ea7-4604-acc5-5f13cab11a31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.857939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88d61eab-0ea7-4604-acc5-5f13cab11a31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.858920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88d61eab-0ea7-4604-acc5-5f13cab11a31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.859410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88d61eab-0ea7-4604-acc5-5f13cab11a31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.859948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88d61eab-0ea7-4604-acc5-5f13cab11a31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.889997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-88d61eab-0ea7-4604-acc5-5f13cab11a31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048030 Aug 31 00:42:22.890542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 790/1505] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:22 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:22.947763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-16e134d3-ad97-427b-ab33-438b336d336e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:22.949837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-16e134d3-ad97-427b-ab33-438b336d336e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:22.956142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16e134d3-ad97-427b-ab33-438b336d336e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.956612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16e134d3-ad97-427b-ab33-438b336d336e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.957039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16e134d3-ad97-427b-ab33-438b336d336e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.957706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16e134d3-ad97-427b-ab33-438b336d336e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.958147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16e134d3-ad97-427b-ab33-438b336d336e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.958564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16e134d3-ad97-427b-ab33-438b336d336e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.992779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-16e134d3-ad97-427b-ab33-438b336d336e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047585 Aug 31 00:42:22.993843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 716/1506] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:23.901963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-15e111c7-41ac-42f0-b8ec-059fbdc9fdd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:23.904169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-15e111c7-41ac-42f0-b8ec-059fbdc9fdd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:23.910546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15e111c7-41ac-42f0-b8ec-059fbdc9fdd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.911024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15e111c7-41ac-42f0-b8ec-059fbdc9fdd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.911481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15e111c7-41ac-42f0-b8ec-059fbdc9fdd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.912160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15e111c7-41ac-42f0-b8ec-059fbdc9fdd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.913114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15e111c7-41ac-42f0-b8ec-059fbdc9fdd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.913530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15e111c7-41ac-42f0-b8ec-059fbdc9fdd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.942871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-15e111c7-41ac-42f0-b8ec-059fbdc9fdd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Aug 31 00:42:23.943444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 791/1507] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:24.004604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d1b18c01-9f6d-4b15-88d7-df978d77cf9e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:24.006971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d1b18c01-9f6d-4b15-88d7-df978d77cf9e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:24.013513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b18c01-9f6d-4b15-88d7-df978d77cf9e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:24.013967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b18c01-9f6d-4b15-88d7-df978d77cf9e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:24.014400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b18c01-9f6d-4b15-88d7-df978d77cf9e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:24.015110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b18c01-9f6d-4b15-88d7-df978d77cf9e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:24.015566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b18c01-9f6d-4b15-88d7-df978d77cf9e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:24.015986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b18c01-9f6d-4b15-88d7-df978d77cf9e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:24.046142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d1b18c01-9f6d-4b15-88d7-df978d77cf9e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045441 Aug 31 00:42:24.046715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 717/1508] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:24.955404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-56e99a14-c3e3-43a6-a4d0-fb6fdb13c042 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:24.957580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-56e99a14-c3e3-43a6-a4d0-fb6fdb13c042 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:24.964598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e99a14-c3e3-43a6-a4d0-fb6fdb13c042 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:24.965079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e99a14-c3e3-43a6-a4d0-fb6fdb13c042 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:24.965509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e99a14-c3e3-43a6-a4d0-fb6fdb13c042 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:24.966196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e99a14-c3e3-43a6-a4d0-fb6fdb13c042 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:24.966645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e99a14-c3e3-43a6-a4d0-fb6fdb13c042 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:24.967096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e99a14-c3e3-43a6-a4d0-fb6fdb13c042 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:24.998473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-56e99a14-c3e3-43a6-a4d0-fb6fdb13c042 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047024 Aug 31 00:42:24.999064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 792/1509] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:25.058995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-165524e7-3039-41a2-a3a9-3e08ba0f2d30 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:25.061120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-165524e7-3039-41a2-a3a9-3e08ba0f2d30 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:25.067477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-165524e7-3039-41a2-a3a9-3e08ba0f2d30 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:25.067958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-165524e7-3039-41a2-a3a9-3e08ba0f2d30 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:25.068391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-165524e7-3039-41a2-a3a9-3e08ba0f2d30 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:25.069862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-165524e7-3039-41a2-a3a9-3e08ba0f2d30 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:25.070525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-165524e7-3039-41a2-a3a9-3e08ba0f2d30 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:25.071020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-165524e7-3039-41a2-a3a9-3e08ba0f2d30 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:25.101728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-165524e7-3039-41a2-a3a9-3e08ba0f2d30 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046699 Aug 31 00:42:25.102280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 718/1510] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:26.010090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-84f7ab23-74b4-44f3-934a-39d715ea938c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:26.012218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-84f7ab23-74b4-44f3-934a-39d715ea938c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:26.018587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84f7ab23-74b4-44f3-934a-39d715ea938c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:26.019090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84f7ab23-74b4-44f3-934a-39d715ea938c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:26.019525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84f7ab23-74b4-44f3-934a-39d715ea938c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:26.020205 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84f7ab23-74b4-44f3-934a-39d715ea938c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:26.020647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84f7ab23-74b4-44f3-934a-39d715ea938c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:26.021061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84f7ab23-74b4-44f3-934a-39d715ea938c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:26.051217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-84f7ab23-74b4-44f3-934a-39d715ea938c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045254 Aug 31 00:42:26.051763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 793/1511] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:26 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:26.114061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-42c17967-722c-441d-9287-a89c36cf280c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:26.116257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-42c17967-722c-441d-9287-a89c36cf280c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:26.122610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42c17967-722c-441d-9287-a89c36cf280c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:26.123116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42c17967-722c-441d-9287-a89c36cf280c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:26.123548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42c17967-722c-441d-9287-a89c36cf280c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:26.124220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42c17967-722c-441d-9287-a89c36cf280c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:26.124662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42c17967-722c-441d-9287-a89c36cf280c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:26.125076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42c17967-722c-441d-9287-a89c36cf280c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:26.154560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-42c17967-722c-441d-9287-a89c36cf280c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044447 Aug 31 00:42:26.155121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 719/1512] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:27.063376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-516f22bc-a5dd-4402-a21d-1891ab4eed67 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:27.065485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-516f22bc-a5dd-4402-a21d-1891ab4eed67 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:27.071989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-516f22bc-a5dd-4402-a21d-1891ab4eed67 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:27.072463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-516f22bc-a5dd-4402-a21d-1891ab4eed67 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:27.072892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-516f22bc-a5dd-4402-a21d-1891ab4eed67 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.073573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-516f22bc-a5dd-4402-a21d-1891ab4eed67 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:27.074196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-516f22bc-a5dd-4402-a21d-1891ab4eed67 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:27.074618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-516f22bc-a5dd-4402-a21d-1891ab4eed67 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.105128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-516f22bc-a5dd-4402-a21d-1891ab4eed67 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045695 Aug 31 00:42:27.105708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 794/1513] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:27 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:27.166348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-aa4c29be-4879-4fa1-88f9-8135269cd267 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:27.168524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-aa4c29be-4879-4fa1-88f9-8135269cd267 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:27.170797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=58 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:27.175879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa4c29be-4879-4fa1-88f9-8135269cd267 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:27.176360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa4c29be-4879-4fa1-88f9-8135269cd267 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:27.176790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa4c29be-4879-4fa1-88f9-8135269cd267 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.177469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa4c29be-4879-4fa1-88f9-8135269cd267 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:27.177917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa4c29be-4879-4fa1-88f9-8135269cd267 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:27.178925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa4c29be-4879-4fa1-88f9-8135269cd267 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.213356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-aa4c29be-4879-4fa1-88f9-8135269cd267 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051167 Aug 31 00:42:27.214312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 720/1514] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:28.117676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-794d21ed-1840-4863-90c1-021d5017f1ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:28.119868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-794d21ed-1840-4863-90c1-021d5017f1ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:28.126512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794d21ed-1840-4863-90c1-021d5017f1ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:28.126980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794d21ed-1840-4863-90c1-021d5017f1ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:28.127450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794d21ed-1840-4863-90c1-021d5017f1ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:28.128146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794d21ed-1840-4863-90c1-021d5017f1ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:28.128600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794d21ed-1840-4863-90c1-021d5017f1ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:28.129021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794d21ed-1840-4863-90c1-021d5017f1ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:28.159453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-794d21ed-1840-4863-90c1-021d5017f1ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046511 Aug 31 00:42:28.160016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 795/1515] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:28.228286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e0d036bb-e30d-4173-a99a-6de67c2b0d0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:28.230459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e0d036bb-e30d-4173-a99a-6de67c2b0d0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:28.237103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0d036bb-e30d-4173-a99a-6de67c2b0d0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:28.237599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0d036bb-e30d-4173-a99a-6de67c2b0d0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:28.238018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0d036bb-e30d-4173-a99a-6de67c2b0d0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:28.238692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0d036bb-e30d-4173-a99a-6de67c2b0d0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:28.239385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0d036bb-e30d-4173-a99a-6de67c2b0d0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:28.239587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0d036bb-e30d-4173-a99a-6de67c2b0d0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:28.271384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e0d036bb-e30d-4173-a99a-6de67c2b0d0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047221 Aug 31 00:42:28.271985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 721/1516] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:29.171608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-197737b1-e0e0-4cc0-a223-e14e104209ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:29.173656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-197737b1-e0e0-4cc0-a223-e14e104209ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:29.180124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-197737b1-e0e0-4cc0-a223-e14e104209ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.180610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-197737b1-e0e0-4cc0-a223-e14e104209ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.181085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-197737b1-e0e0-4cc0-a223-e14e104209ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.181916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-197737b1-e0e0-4cc0-a223-e14e104209ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.182380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-197737b1-e0e0-4cc0-a223-e14e104209ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.182803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-197737b1-e0e0-4cc0-a223-e14e104209ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.212910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-197737b1-e0e0-4cc0-a223-e14e104209ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Aug 31 00:42:29.213465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 796/1517] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:29.283656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-72844d91-8de7-4377-a356-d029674e9a29 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:29.285836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-72844d91-8de7-4377-a356-d029674e9a29 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:29.292254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72844d91-8de7-4377-a356-d029674e9a29 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.292728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72844d91-8de7-4377-a356-d029674e9a29 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.293154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72844d91-8de7-4377-a356-d029674e9a29 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.293826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72844d91-8de7-4377-a356-d029674e9a29 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.294270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72844d91-8de7-4377-a356-d029674e9a29 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.294685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72844d91-8de7-4377-a356-d029674e9a29 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.324384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-72844d91-8de7-4377-a356-d029674e9a29 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044627 Aug 31 00:42:29.324946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 722/1518] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:30.225808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04158c50-a8ce-4022-9996-296ac9b26979 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:30.228185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-04158c50-a8ce-4022-9996-296ac9b26979 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:30.230481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=58 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:30.236167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04158c50-a8ce-4022-9996-296ac9b26979 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:30.236658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04158c50-a8ce-4022-9996-296ac9b26979 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:30.237092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04158c50-a8ce-4022-9996-296ac9b26979 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:30.237784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04158c50-a8ce-4022-9996-296ac9b26979 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:30.238237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04158c50-a8ce-4022-9996-296ac9b26979 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:30.238690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04158c50-a8ce-4022-9996-296ac9b26979 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:30.269206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-04158c50-a8ce-4022-9996-296ac9b26979 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047972 Aug 31 00:42:30.269763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 797/1519] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:30.337486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fcb63e8d-89ed-4905-9fff-56307c8c52a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:30.339658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fcb63e8d-89ed-4905-9fff-56307c8c52a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:30.347590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcb63e8d-89ed-4905-9fff-56307c8c52a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:30.348075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcb63e8d-89ed-4905-9fff-56307c8c52a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:30.348564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcb63e8d-89ed-4905-9fff-56307c8c52a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:30.349302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcb63e8d-89ed-4905-9fff-56307c8c52a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:30.349998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcb63e8d-89ed-4905-9fff-56307c8c52a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:30.351066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcb63e8d-89ed-4905-9fff-56307c8c52a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:30.387180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fcb63e8d-89ed-4905-9fff-56307c8c52a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054233 Aug 31 00:42:30.387743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 723/1520] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:31.282540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4fd43ba6-0f62-4370-a95b-428261f5845f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:31.284773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4fd43ba6-0f62-4370-a95b-428261f5845f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:31.291584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd43ba6-0f62-4370-a95b-428261f5845f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:31.292073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd43ba6-0f62-4370-a95b-428261f5845f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:31.292510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd43ba6-0f62-4370-a95b-428261f5845f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:31.293208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd43ba6-0f62-4370-a95b-428261f5845f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:31.293661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd43ba6-0f62-4370-a95b-428261f5845f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:31.294083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd43ba6-0f62-4370-a95b-428261f5845f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:31.325485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4fd43ba6-0f62-4370-a95b-428261f5845f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047047 Aug 31 00:42:31.326047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 798/1521] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:31.399619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-28b500cd-dccd-409c-a255-f480ae42f828 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:31.401841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-28b500cd-dccd-409c-a255-f480ae42f828 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:31.408120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28b500cd-dccd-409c-a255-f480ae42f828 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:31.408590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28b500cd-dccd-409c-a255-f480ae42f828 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:31.409015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28b500cd-dccd-409c-a255-f480ae42f828 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:31.409682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28b500cd-dccd-409c-a255-f480ae42f828 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:31.410120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28b500cd-dccd-409c-a255-f480ae42f828 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:31.410529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28b500cd-dccd-409c-a255-f480ae42f828 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:31.440551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-28b500cd-dccd-409c-a255-f480ae42f828 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044927 Aug 31 00:42:31.441099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 724/1522] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:32.338397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-93492fad-4f14-4c51-a707-df4ef0456d97 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:32.340540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-93492fad-4f14-4c51-a707-df4ef0456d97 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:32.346963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93492fad-4f14-4c51-a707-df4ef0456d97 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:32.347478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93492fad-4f14-4c51-a707-df4ef0456d97 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:32.347912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93492fad-4f14-4c51-a707-df4ef0456d97 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:32.348602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93492fad-4f14-4c51-a707-df4ef0456d97 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:32.349053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93492fad-4f14-4c51-a707-df4ef0456d97 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:32.349475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93492fad-4f14-4c51-a707-df4ef0456d97 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:32.378480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-93492fad-4f14-4c51-a707-df4ef0456d97 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Aug 31 00:42:32.379054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 799/1523] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:32.452947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-64a7a15e-3115-4291-b72e-17059bbe1d6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:32.455059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-64a7a15e-3115-4291-b72e-17059bbe1d6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:32.462250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64a7a15e-3115-4291-b72e-17059bbe1d6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:32.462726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64a7a15e-3115-4291-b72e-17059bbe1d6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:32.463201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64a7a15e-3115-4291-b72e-17059bbe1d6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:32.463890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64a7a15e-3115-4291-b72e-17059bbe1d6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:32.464336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64a7a15e-3115-4291-b72e-17059bbe1d6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:32.464758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64a7a15e-3115-4291-b72e-17059bbe1d6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:32.494164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-64a7a15e-3115-4291-b72e-17059bbe1d6b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045149 Aug 31 00:42:32.494730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 725/1524] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:33.391897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd23e62a-ad1c-46d7-900f-30b7012b2150 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:33.394009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dd23e62a-ad1c-46d7-900f-30b7012b2150 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:33.401051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd23e62a-ad1c-46d7-900f-30b7012b2150 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:33.401526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd23e62a-ad1c-46d7-900f-30b7012b2150 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:33.401956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd23e62a-ad1c-46d7-900f-30b7012b2150 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:33.402638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd23e62a-ad1c-46d7-900f-30b7012b2150 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:33.403128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd23e62a-ad1c-46d7-900f-30b7012b2150 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:33.403549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd23e62a-ad1c-46d7-900f-30b7012b2150 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:33.434050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dd23e62a-ad1c-46d7-900f-30b7012b2150 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046090 Aug 31 00:42:33.434615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 800/1525] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:33 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:33.506128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-aa93b488-5a27-444f-aa77-873c75395930 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:33.508336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-aa93b488-5a27-444f-aa77-873c75395930 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:33.514679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa93b488-5a27-444f-aa77-873c75395930 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:33.515174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa93b488-5a27-444f-aa77-873c75395930 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:33.515597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa93b488-5a27-444f-aa77-873c75395930 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:33.516269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa93b488-5a27-444f-aa77-873c75395930 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:33.516705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa93b488-5a27-444f-aa77-873c75395930 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:33.517114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa93b488-5a27-444f-aa77-873c75395930 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:33.547511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-aa93b488-5a27-444f-aa77-873c75395930 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045259 Aug 31 00:42:33.548079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 726/1526] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:33 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:34.446106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bbb14e23-e1eb-4a8a-b2f9-d39eed2c633c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:34.448274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bbb14e23-e1eb-4a8a-b2f9-d39eed2c633c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:34.454699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbb14e23-e1eb-4a8a-b2f9-d39eed2c633c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:34.455201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbb14e23-e1eb-4a8a-b2f9-d39eed2c633c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:34.455631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbb14e23-e1eb-4a8a-b2f9-d39eed2c633c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:34.456309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbb14e23-e1eb-4a8a-b2f9-d39eed2c633c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:34.456756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbb14e23-e1eb-4a8a-b2f9-d39eed2c633c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:34.457169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bbb14e23-e1eb-4a8a-b2f9-d39eed2c633c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:34.486573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bbb14e23-e1eb-4a8a-b2f9-d39eed2c633c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Aug 31 00:42:34.487134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 801/1527] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:34 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:34.560612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-94c81a8e-4624-49d4-bb45-b2866c7f8a91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:34.562861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-94c81a8e-4624-49d4-bb45-b2866c7f8a91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:34.569746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94c81a8e-4624-49d4-bb45-b2866c7f8a91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:34.570213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94c81a8e-4624-49d4-bb45-b2866c7f8a91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:34.570721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94c81a8e-4624-49d4-bb45-b2866c7f8a91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:34.571371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94c81a8e-4624-49d4-bb45-b2866c7f8a91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:34.571842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94c81a8e-4624-49d4-bb45-b2866c7f8a91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:34.572255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94c81a8e-4624-49d4-bb45-b2866c7f8a91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:34.601629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-94c81a8e-4624-49d4-bb45-b2866c7f8a91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044925 Aug 31 00:42:34.602154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 727/1528] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:35.499755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cd5906d9-7d81-40fb-bd63-324877f99633 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:35.501868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cd5906d9-7d81-40fb-bd63-324877f99633 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:35.508472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd5906d9-7d81-40fb-bd63-324877f99633 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:35.508945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd5906d9-7d81-40fb-bd63-324877f99633 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:35.509375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd5906d9-7d81-40fb-bd63-324877f99633 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:35.510058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd5906d9-7d81-40fb-bd63-324877f99633 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:35.510511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd5906d9-7d81-40fb-bd63-324877f99633 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:35.510933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd5906d9-7d81-40fb-bd63-324877f99633 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:35.535898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:35.541693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cd5906d9-7d81-40fb-bd63-324877f99633 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045950 Aug 31 00:42:35.542245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 802/1529] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:35.613820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9da74abe-42e5-4406-9696-67ea14cafcf1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:35.616134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9da74abe-42e5-4406-9696-67ea14cafcf1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:35.622678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9da74abe-42e5-4406-9696-67ea14cafcf1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:35.623192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9da74abe-42e5-4406-9696-67ea14cafcf1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:35.623624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9da74abe-42e5-4406-9696-67ea14cafcf1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:35.624302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9da74abe-42e5-4406-9696-67ea14cafcf1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:35.624749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9da74abe-42e5-4406-9696-67ea14cafcf1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:35.625164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9da74abe-42e5-4406-9696-67ea14cafcf1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:35.657266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9da74abe-42e5-4406-9696-67ea14cafcf1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047338 Aug 31 00:42:35.657824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 728/1530] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:36.555116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-83baacff-34eb-40a0-98b6-2b02cf8b4a9e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:36.557169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-83baacff-34eb-40a0-98b6-2b02cf8b4a9e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:36.563532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83baacff-34eb-40a0-98b6-2b02cf8b4a9e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:36.564012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83baacff-34eb-40a0-98b6-2b02cf8b4a9e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:36.564447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83baacff-34eb-40a0-98b6-2b02cf8b4a9e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:36.565129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83baacff-34eb-40a0-98b6-2b02cf8b4a9e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:36.565580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83baacff-34eb-40a0-98b6-2b02cf8b4a9e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:36.566001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83baacff-34eb-40a0-98b6-2b02cf8b4a9e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:36.596021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-83baacff-34eb-40a0-98b6-2b02cf8b4a9e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045810 Aug 31 00:42:36.596574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 803/1531] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:36.669806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-97c59a49-d19f-4138-9b65-907269316f6f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:36.671908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-97c59a49-d19f-4138-9b65-907269316f6f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:36.678351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97c59a49-d19f-4138-9b65-907269316f6f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:36.679540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97c59a49-d19f-4138-9b65-907269316f6f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:36.679969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97c59a49-d19f-4138-9b65-907269316f6f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:36.680644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97c59a49-d19f-4138-9b65-907269316f6f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:36.681084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97c59a49-d19f-4138-9b65-907269316f6f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:36.681495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97c59a49-d19f-4138-9b65-907269316f6f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:36.711146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-97c59a49-d19f-4138-9b65-907269316f6f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045251 Aug 31 00:42:36.711712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 729/1532] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:37.609437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a0dcb5b8-9a26-4f84-b70b-a826c618eadf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:37.611614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a0dcb5b8-9a26-4f84-b70b-a826c618eadf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:37.618502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0dcb5b8-9a26-4f84-b70b-a826c618eadf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:37.618985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0dcb5b8-9a26-4f84-b70b-a826c618eadf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:37.619451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0dcb5b8-9a26-4f84-b70b-a826c618eadf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:37.620167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0dcb5b8-9a26-4f84-b70b-a826c618eadf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:37.620615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0dcb5b8-9a26-4f84-b70b-a826c618eadf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:37.621033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0dcb5b8-9a26-4f84-b70b-a826c618eadf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:37.651304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a0dcb5b8-9a26-4f84-b70b-a826c618eadf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046075 Aug 31 00:42:37.651862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 804/1533] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:37 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:37.723573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-06455dfa-bdfb-45fc-a108-394cc4fb646b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:37.725716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-06455dfa-bdfb-45fc-a108-394cc4fb646b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:37.727769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:42:37.727919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:42:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments (ip 10.222.0.67) !!! Aug 31 00:42:37.728922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:42:37.729066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:42:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments (ip 10.222.0.67) !!! Aug 31 00:42:37.885070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06455dfa-bdfb-45fc-a108-394cc4fb646b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:37.885462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06455dfa-bdfb-45fc-a108-394cc4fb646b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:37.885900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06455dfa-bdfb-45fc-a108-394cc4fb646b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:37.886604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06455dfa-bdfb-45fc-a108-394cc4fb646b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:37.887075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06455dfa-bdfb-45fc-a108-394cc4fb646b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:37.887501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06455dfa-bdfb-45fc-a108-394cc4fb646b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:37.918979 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-06455dfa-bdfb-45fc-a108-394cc4fb646b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.199520 Aug 31 00:42:37.919566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 730/1534] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:38.664012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1e8be8a9-00c0-4c44-86f1-041eb4ec5b8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:38.666155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1e8be8a9-00c0-4c44-86f1-041eb4ec5b8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:38.668277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:42:38.668421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:42:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments (ip 10.222.0.67) !!! Aug 31 00:42:38.676911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e8be8a9-00c0-4c44-86f1-041eb4ec5b8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:38.677387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e8be8a9-00c0-4c44-86f1-041eb4ec5b8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:38.677845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e8be8a9-00c0-4c44-86f1-041eb4ec5b8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:38.679311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e8be8a9-00c0-4c44-86f1-041eb4ec5b8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:38.679751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e8be8a9-00c0-4c44-86f1-041eb4ec5b8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:38.680169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e8be8a9-00c0-4c44-86f1-041eb4ec5b8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:38.711222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1e8be8a9-00c0-4c44-86f1-041eb4ec5b8d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051339 Aug 31 00:42:38.711811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 805/1535] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:38.932891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d0a98b9d-d923-4ed4-9ef6-176318ba3c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:38.934896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d0a98b9d-d923-4ed4-9ef6-176318ba3c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:38.940821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a98b9d-d923-4ed4-9ef6-176318ba3c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:38.941292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a98b9d-d923-4ed4-9ef6-176318ba3c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:38.941720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a98b9d-d923-4ed4-9ef6-176318ba3c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:38.942398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a98b9d-d923-4ed4-9ef6-176318ba3c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:38.942843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a98b9d-d923-4ed4-9ef6-176318ba3c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:38.943293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d0a98b9d-d923-4ed4-9ef6-176318ba3c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:38.971727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d0a98b9d-d923-4ed4-9ef6-176318ba3c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043723 Aug 31 00:42:38.972277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 731/1536] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:39.723565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8fc83bd0-27e2-4bf5-bac0-a3ae1f2b1bce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:39.726335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8fc83bd0-27e2-4bf5-bac0-a3ae1f2b1bce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:39.732978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fc83bd0-27e2-4bf5-bac0-a3ae1f2b1bce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.733465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fc83bd0-27e2-4bf5-bac0-a3ae1f2b1bce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.733889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fc83bd0-27e2-4bf5-bac0-a3ae1f2b1bce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:39.734571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fc83bd0-27e2-4bf5-bac0-a3ae1f2b1bce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.735021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fc83bd0-27e2-4bf5-bac0-a3ae1f2b1bce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.735461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fc83bd0-27e2-4bf5-bac0-a3ae1f2b1bce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:39.765669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8fc83bd0-27e2-4bf5-bac0-a3ae1f2b1bce tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046016 Aug 31 00:42:39.766260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 806/1537] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:39 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:39.984985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b43f4b5b-aac7-46d4-8ed6-ce0526f010f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:39.986983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b43f4b5b-aac7-46d4-8ed6-ce0526f010f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:39.993758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b43f4b5b-aac7-46d4-8ed6-ce0526f010f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.994228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b43f4b5b-aac7-46d4-8ed6-ce0526f010f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.994653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b43f4b5b-aac7-46d4-8ed6-ce0526f010f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:39.995365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b43f4b5b-aac7-46d4-8ed6-ce0526f010f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.995807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b43f4b5b-aac7-46d4-8ed6-ce0526f010f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.996216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b43f4b5b-aac7-46d4-8ed6-ce0526f010f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:39.999937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:40.025931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b43f4b5b-aac7-46d4-8ed6-ce0526f010f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045229 Aug 31 00:42:40.026467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 732/1538] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:40.778389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4ccf4045-be8d-468d-9b0a-969973387999 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:40.780593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4ccf4045-be8d-468d-9b0a-969973387999 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:40.787335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ccf4045-be8d-468d-9b0a-969973387999 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:40.787821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ccf4045-be8d-468d-9b0a-969973387999 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:40.788253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ccf4045-be8d-468d-9b0a-969973387999 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:40.788946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ccf4045-be8d-468d-9b0a-969973387999 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:40.789396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ccf4045-be8d-468d-9b0a-969973387999 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:40.789821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ccf4045-be8d-468d-9b0a-969973387999 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:40.819985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4ccf4045-be8d-468d-9b0a-969973387999 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045629 Aug 31 00:42:40.820535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 807/1539] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:41.038667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-079b12ed-652b-480a-a513-d5ca9279edde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:41.041629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-079b12ed-652b-480a-a513-d5ca9279edde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:41.047266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079b12ed-652b-480a-a513-d5ca9279edde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:41.047748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079b12ed-652b-480a-a513-d5ca9279edde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:41.048182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079b12ed-652b-480a-a513-d5ca9279edde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:41.048873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079b12ed-652b-480a-a513-d5ca9279edde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:41.049324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079b12ed-652b-480a-a513-d5ca9279edde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:41.049750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-079b12ed-652b-480a-a513-d5ca9279edde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:41.079959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-079b12ed-652b-480a-a513-d5ca9279edde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045535 Aug 31 00:42:41.080506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 733/1540] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:41.832659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f021f7a9-eb82-422e-971c-eea49810cb18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:41.835617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f021f7a9-eb82-422e-971c-eea49810cb18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:41.842046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f021f7a9-eb82-422e-971c-eea49810cb18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:41.842531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f021f7a9-eb82-422e-971c-eea49810cb18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:41.842966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f021f7a9-eb82-422e-971c-eea49810cb18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:41.843698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f021f7a9-eb82-422e-971c-eea49810cb18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:41.844179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f021f7a9-eb82-422e-971c-eea49810cb18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:41.844601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f021f7a9-eb82-422e-971c-eea49810cb18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:41.875162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f021f7a9-eb82-422e-971c-eea49810cb18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Aug 31 00:42:41.876391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 808/1541] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:41 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:42.092211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-76769d3b-1455-43d0-b1b3-b1853e3e9b5b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:42.094271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-76769d3b-1455-43d0-b1b3-b1853e3e9b5b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:42.101082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76769d3b-1455-43d0-b1b3-b1853e3e9b5b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:42.101565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76769d3b-1455-43d0-b1b3-b1853e3e9b5b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:42.101999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76769d3b-1455-43d0-b1b3-b1853e3e9b5b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:42.102681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76769d3b-1455-43d0-b1b3-b1853e3e9b5b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:42.103192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76769d3b-1455-43d0-b1b3-b1853e3e9b5b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:42.103611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76769d3b-1455-43d0-b1b3-b1853e3e9b5b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:42.133260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-76769d3b-1455-43d0-b1b3-b1853e3e9b5b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045118 Aug 31 00:42:42.133805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 734/1542] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:42.887659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-617af8ab-cb8e-4923-a0f0-75bef2559db0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:42.889792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-617af8ab-cb8e-4923-a0f0-75bef2559db0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:42.896675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-617af8ab-cb8e-4923-a0f0-75bef2559db0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:42.897185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-617af8ab-cb8e-4923-a0f0-75bef2559db0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:42.897606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-617af8ab-cb8e-4923-a0f0-75bef2559db0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:42.898272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-617af8ab-cb8e-4923-a0f0-75bef2559db0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:42.898714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-617af8ab-cb8e-4923-a0f0-75bef2559db0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:42.899152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-617af8ab-cb8e-4923-a0f0-75bef2559db0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:42.929185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-617af8ab-cb8e-4923-a0f0-75bef2559db0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Aug 31 00:42:42.930057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 809/1543] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:42 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:43.146014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-04044b84-bb4a-452b-abc5-8e0b49657561 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:43.148748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-04044b84-bb4a-452b-abc5-8e0b49657561 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:43.155311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04044b84-bb4a-452b-abc5-8e0b49657561 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:43.155792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04044b84-bb4a-452b-abc5-8e0b49657561 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:43.156225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04044b84-bb4a-452b-abc5-8e0b49657561 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:43.156912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04044b84-bb4a-452b-abc5-8e0b49657561 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:43.157365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04044b84-bb4a-452b-abc5-8e0b49657561 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:43.157789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04044b84-bb4a-452b-abc5-8e0b49657561 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:43.188894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-04044b84-bb4a-452b-abc5-8e0b49657561 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047053 Aug 31 00:42:43.189431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 735/1544] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:43.941857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-572087ef-2bc6-483a-82da-89149f747c92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:43.944579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-572087ef-2bc6-483a-82da-89149f747c92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:43.951127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-572087ef-2bc6-483a-82da-89149f747c92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:43.951608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-572087ef-2bc6-483a-82da-89149f747c92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:43.952041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-572087ef-2bc6-483a-82da-89149f747c92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:43.952727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-572087ef-2bc6-483a-82da-89149f747c92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:43.953202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-572087ef-2bc6-483a-82da-89149f747c92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:43.953621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-572087ef-2bc6-483a-82da-89149f747c92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:43.989647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-572087ef-2bc6-483a-82da-89149f747c92 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051698 Aug 31 00:42:43.990215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 810/1545] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:44.201381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7aa25eb1-866e-4fd3-a800-6ef090ae6774 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:44.203440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7aa25eb1-866e-4fd3-a800-6ef090ae6774 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:44.210045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aa25eb1-866e-4fd3-a800-6ef090ae6774 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:44.210519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aa25eb1-866e-4fd3-a800-6ef090ae6774 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:44.210951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aa25eb1-866e-4fd3-a800-6ef090ae6774 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:44.211664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aa25eb1-866e-4fd3-a800-6ef090ae6774 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:44.212114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aa25eb1-866e-4fd3-a800-6ef090ae6774 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:44.212537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aa25eb1-866e-4fd3-a800-6ef090ae6774 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:44.242617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7aa25eb1-866e-4fd3-a800-6ef090ae6774 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045266 Aug 31 00:42:44.243187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 736/1546] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:45.002149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d0525ef-d8cb-4d6f-8a1d-f5aff3b706a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:45.004285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d0525ef-d8cb-4d6f-8a1d-f5aff3b706a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:45.011386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0525ef-d8cb-4d6f-8a1d-f5aff3b706a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:45.011863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0525ef-d8cb-4d6f-8a1d-f5aff3b706a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:45.012290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0525ef-d8cb-4d6f-8a1d-f5aff3b706a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:45.012963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0525ef-d8cb-4d6f-8a1d-f5aff3b706a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:45.013408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0525ef-d8cb-4d6f-8a1d-f5aff3b706a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:45.013819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d0525ef-d8cb-4d6f-8a1d-f5aff3b706a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:45.044981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d0525ef-d8cb-4d6f-8a1d-f5aff3b706a8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Aug 31 00:42:45.045542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 811/1547] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:45.255382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f42f0540-82da-402e-9aa3-93e70d5b8c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:45.258013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f42f0540-82da-402e-9aa3-93e70d5b8c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:45.264357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f42f0540-82da-402e-9aa3-93e70d5b8c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:45.264834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f42f0540-82da-402e-9aa3-93e70d5b8c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:45.265264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f42f0540-82da-402e-9aa3-93e70d5b8c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:45.265943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f42f0540-82da-402e-9aa3-93e70d5b8c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:45.266390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f42f0540-82da-402e-9aa3-93e70d5b8c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:45.266808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f42f0540-82da-402e-9aa3-93e70d5b8c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:45.295538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f42f0540-82da-402e-9aa3-93e70d5b8c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044289 Aug 31 00:42:45.296075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 737/1548] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:46.057717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-24010a53-8ebc-46d2-b589-d8b1940f7773 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:46.059886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-24010a53-8ebc-46d2-b589-d8b1940f7773 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:46.066348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24010a53-8ebc-46d2-b589-d8b1940f7773 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:46.066826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24010a53-8ebc-46d2-b589-d8b1940f7773 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:46.067293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24010a53-8ebc-46d2-b589-d8b1940f7773 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:46.067979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24010a53-8ebc-46d2-b589-d8b1940f7773 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:46.068428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24010a53-8ebc-46d2-b589-d8b1940f7773 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:46.068867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24010a53-8ebc-46d2-b589-d8b1940f7773 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:46.106209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-24010a53-8ebc-46d2-b589-d8b1940f7773 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052311 Aug 31 00:42:46.107478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 812/1549] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:46 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:46.308528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d5944cd6-7c21-4f41-b4e5-ce023c2e9edf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:46.310557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d5944cd6-7c21-4f41-b4e5-ce023c2e9edf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:46.316993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5944cd6-7c21-4f41-b4e5-ce023c2e9edf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:46.317469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5944cd6-7c21-4f41-b4e5-ce023c2e9edf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:46.317904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5944cd6-7c21-4f41-b4e5-ce023c2e9edf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:46.319133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5944cd6-7c21-4f41-b4e5-ce023c2e9edf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:46.319891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5944cd6-7c21-4f41-b4e5-ce023c2e9edf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:46.320326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5944cd6-7c21-4f41-b4e5-ce023c2e9edf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:46.350069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d5944cd6-7c21-4f41-b4e5-ce023c2e9edf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045624 Aug 31 00:42:46.350888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 738/1550] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:47.124548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2562f19d-e7e8-458a-9dbb-6cb8be729254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:47.126657 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2562f19d-e7e8-458a-9dbb-6cb8be729254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:47.133171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2562f19d-e7e8-458a-9dbb-6cb8be729254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:47.133646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2562f19d-e7e8-458a-9dbb-6cb8be729254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:47.134068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2562f19d-e7e8-458a-9dbb-6cb8be729254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:47.134741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2562f19d-e7e8-458a-9dbb-6cb8be729254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:47.135215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2562f19d-e7e8-458a-9dbb-6cb8be729254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:47.135631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2562f19d-e7e8-458a-9dbb-6cb8be729254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:47.165328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2562f19d-e7e8-458a-9dbb-6cb8be729254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049870 Aug 31 00:42:47.165880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 813/1551] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:47 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:47.362939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-368e44f9-11f8-42e3-8bcd-f39477e33b7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:47.365118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-368e44f9-11f8-42e3-8bcd-f39477e33b7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:47.372369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368e44f9-11f8-42e3-8bcd-f39477e33b7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:47.372848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368e44f9-11f8-42e3-8bcd-f39477e33b7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:47.373279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368e44f9-11f8-42e3-8bcd-f39477e33b7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:47.373969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368e44f9-11f8-42e3-8bcd-f39477e33b7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:47.374419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368e44f9-11f8-42e3-8bcd-f39477e33b7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:47.374841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-368e44f9-11f8-42e3-8bcd-f39477e33b7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:47.404221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-368e44f9-11f8-42e3-8bcd-f39477e33b7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045255 Aug 31 00:42:47.404787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 739/1552] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:42:48.177455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-70bdcd06-098c-4a3b-bc08-34dc723a2549 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:48.179845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-70bdcd06-098c-4a3b-bc08-34dc723a2549 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:48.186317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bdcd06-098c-4a3b-bc08-34dc723a2549 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:48.186795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bdcd06-098c-4a3b-bc08-34dc723a2549 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:48.187266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bdcd06-098c-4a3b-bc08-34dc723a2549 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:48.187956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bdcd06-098c-4a3b-bc08-34dc723a2549 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:48.188409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bdcd06-098c-4a3b-bc08-34dc723a2549 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:48.188834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bdcd06-098c-4a3b-bc08-34dc723a2549 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:48.219422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-70bdcd06-098c-4a3b-bc08-34dc723a2549 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Aug 31 00:42:48.219974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 814/1553] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:48.417145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-978d00f8-879d-4363-bef2-f29795ad35ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:48.419321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-978d00f8-879d-4363-bef2-f29795ad35ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:48.425941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d00f8-879d-4363-bef2-f29795ad35ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:48.426422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d00f8-879d-4363-bef2-f29795ad35ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:48.426856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d00f8-879d-4363-bef2-f29795ad35ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:48.427590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d00f8-879d-4363-bef2-f29795ad35ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:48.428611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d00f8-879d-4363-bef2-f29795ad35ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:48.429356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d00f8-879d-4363-bef2-f29795ad35ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:48.460904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-978d00f8-879d-4363-bef2-f29795ad35ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048069 Aug 31 00:42:48.461485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 740/1554] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:49.232128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d078e15-aa73-4490-9393-63114d286ce5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:49.234266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d078e15-aa73-4490-9393-63114d286ce5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:49.243311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d078e15-aa73-4490-9393-63114d286ce5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:49.243809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d078e15-aa73-4490-9393-63114d286ce5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:49.244680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d078e15-aa73-4490-9393-63114d286ce5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:49.245548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d078e15-aa73-4490-9393-63114d286ce5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:49.246947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d078e15-aa73-4490-9393-63114d286ce5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:49.247414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d078e15-aa73-4490-9393-63114d286ce5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:49.281853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d078e15-aa73-4490-9393-63114d286ce5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053879 Aug 31 00:42:49.282413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 815/1555] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:49.472975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7673554c-27b9-4dcf-aaf3-ac03146d4258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:49.475656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7673554c-27b9-4dcf-aaf3-ac03146d4258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:49.482379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7673554c-27b9-4dcf-aaf3-ac03146d4258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:49.482798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7673554c-27b9-4dcf-aaf3-ac03146d4258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:49.483268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7673554c-27b9-4dcf-aaf3-ac03146d4258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:49.483955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7673554c-27b9-4dcf-aaf3-ac03146d4258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:49.484403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7673554c-27b9-4dcf-aaf3-ac03146d4258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:49.484824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7673554c-27b9-4dcf-aaf3-ac03146d4258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:49.514135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7673554c-27b9-4dcf-aaf3-ac03146d4258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045244 Aug 31 00:42:49.514685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 741/1556] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:50.294514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bd6d44fb-5c21-4749-a421-f8479e7d64ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:50.296667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bd6d44fb-5c21-4749-a421-f8479e7d64ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:50.303208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6d44fb-5c21-4749-a421-f8479e7d64ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:50.303698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6d44fb-5c21-4749-a421-f8479e7d64ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:50.304257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6d44fb-5c21-4749-a421-f8479e7d64ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:50.304956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6d44fb-5c21-4749-a421-f8479e7d64ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:50.305417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6d44fb-5c21-4749-a421-f8479e7d64ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:50.305840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd6d44fb-5c21-4749-a421-f8479e7d64ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:50.336052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bd6d44fb-5c21-4749-a421-f8479e7d64ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045605 Aug 31 00:42:50.336607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 816/1557] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:50.526495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-86d14ed3-175a-4e08-a371-fbed10faa724 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:50.528637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-86d14ed3-175a-4e08-a371-fbed10faa724 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:50.535215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86d14ed3-175a-4e08-a371-fbed10faa724 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:50.535694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86d14ed3-175a-4e08-a371-fbed10faa724 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:50.536140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86d14ed3-175a-4e08-a371-fbed10faa724 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:50.536816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86d14ed3-175a-4e08-a371-fbed10faa724 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:50.537276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86d14ed3-175a-4e08-a371-fbed10faa724 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:50.537684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86d14ed3-175a-4e08-a371-fbed10faa724 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:50.579556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-86d14ed3-175a-4e08-a371-fbed10faa724 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056904 Aug 31 00:42:50.580126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 742/1558] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:51.348457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5c4c2be6-8ba2-4179-bca8-8afb9862df37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:51.351454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5c4c2be6-8ba2-4179-bca8-8afb9862df37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:51.357625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c2be6-8ba2-4179-bca8-8afb9862df37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:51.358104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c2be6-8ba2-4179-bca8-8afb9862df37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:51.358534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c2be6-8ba2-4179-bca8-8afb9862df37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:51.359244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c2be6-8ba2-4179-bca8-8afb9862df37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:51.359695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c2be6-8ba2-4179-bca8-8afb9862df37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:51.360115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c4c2be6-8ba2-4179-bca8-8afb9862df37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:51.389732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5c4c2be6-8ba2-4179-bca8-8afb9862df37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045452 Aug 31 00:42:51.390286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 817/1559] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:51.592561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4fb9a478-3705-4eba-a523-cd4be064c918 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:51.594691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4fb9a478-3705-4eba-a523-cd4be064c918 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:51.601850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fb9a478-3705-4eba-a523-cd4be064c918 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:51.602315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fb9a478-3705-4eba-a523-cd4be064c918 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:51.602742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fb9a478-3705-4eba-a523-cd4be064c918 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:51.603448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fb9a478-3705-4eba-a523-cd4be064c918 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:51.603891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fb9a478-3705-4eba-a523-cd4be064c918 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:51.604302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fb9a478-3705-4eba-a523-cd4be064c918 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:51.634067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4fb9a478-3705-4eba-a523-cd4be064c918 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045603 Aug 31 00:42:51.634610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 743/1560] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:52.402162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3d67cdb4-1283-400e-a48f-2295ee39fabc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:52.404411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3d67cdb4-1283-400e-a48f-2295ee39fabc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:52.410873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d67cdb4-1283-400e-a48f-2295ee39fabc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:52.411385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d67cdb4-1283-400e-a48f-2295ee39fabc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:52.411819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d67cdb4-1283-400e-a48f-2295ee39fabc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:52.412506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d67cdb4-1283-400e-a48f-2295ee39fabc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:52.412957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d67cdb4-1283-400e-a48f-2295ee39fabc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:52.413379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d67cdb4-1283-400e-a48f-2295ee39fabc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:52.442386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3d67cdb4-1283-400e-a48f-2295ee39fabc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Aug 31 00:42:52.442946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 818/1561] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:52.651650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-82a338d4-f9c3-4114-b179-4d3acab8b6b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:52.654415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-82a338d4-f9c3-4114-b179-4d3acab8b6b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:52.661029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82a338d4-f9c3-4114-b179-4d3acab8b6b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:52.661497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82a338d4-f9c3-4114-b179-4d3acab8b6b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:52.661922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82a338d4-f9c3-4114-b179-4d3acab8b6b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:52.662721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82a338d4-f9c3-4114-b179-4d3acab8b6b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:52.663272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82a338d4-f9c3-4114-b179-4d3acab8b6b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:52.663687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82a338d4-f9c3-4114-b179-4d3acab8b6b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:52.692259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-82a338d4-f9c3-4114-b179-4d3acab8b6b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049147 Aug 31 00:42:52.692794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 744/1562] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:53.454556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3c2434da-cd65-45ec-a2a8-1608bb89b467 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:53.456814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3c2434da-cd65-45ec-a2a8-1608bb89b467 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:53.463894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c2434da-cd65-45ec-a2a8-1608bb89b467 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:53.464370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c2434da-cd65-45ec-a2a8-1608bb89b467 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:53.464800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c2434da-cd65-45ec-a2a8-1608bb89b467 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:53.465482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c2434da-cd65-45ec-a2a8-1608bb89b467 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:53.465930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c2434da-cd65-45ec-a2a8-1608bb89b467 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:53.466350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c2434da-cd65-45ec-a2a8-1608bb89b467 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:53.484149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:53.497820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3c2434da-cd65-45ec-a2a8-1608bb89b467 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047191 Aug 31 00:42:53.498380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 819/1563] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:53 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:53.705342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6aff5473-d462-4630-99d7-863495395805 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:53.707508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6aff5473-d462-4630-99d7-863495395805 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:53.714411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6aff5473-d462-4630-99d7-863495395805 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:53.714887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6aff5473-d462-4630-99d7-863495395805 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:53.715363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6aff5473-d462-4630-99d7-863495395805 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:53.716045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6aff5473-d462-4630-99d7-863495395805 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:53.716493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6aff5473-d462-4630-99d7-863495395805 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:53.716911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6aff5473-d462-4630-99d7-863495395805 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:53.747804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6aff5473-d462-4630-99d7-863495395805 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046560 Aug 31 00:42:53.748626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 745/1564] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:53 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:54.510708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5de8fc58-8fce-4406-9259-b0fbbc1852a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:54.512879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5de8fc58-8fce-4406-9259-b0fbbc1852a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:54.519290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5de8fc58-8fce-4406-9259-b0fbbc1852a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:54.519769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5de8fc58-8fce-4406-9259-b0fbbc1852a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:54.520221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5de8fc58-8fce-4406-9259-b0fbbc1852a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:54.520888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5de8fc58-8fce-4406-9259-b0fbbc1852a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:54.521339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5de8fc58-8fce-4406-9259-b0fbbc1852a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:54.521809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5de8fc58-8fce-4406-9259-b0fbbc1852a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:54.551331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5de8fc58-8fce-4406-9259-b0fbbc1852a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045210 Aug 31 00:42:54.551881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 820/1565] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:54 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:54.760916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1081529e-74f8-4614-bdde-d29bfbfc63f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:54.762941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1081529e-74f8-4614-bdde-d29bfbfc63f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:54.769311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1081529e-74f8-4614-bdde-d29bfbfc63f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:54.769790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1081529e-74f8-4614-bdde-d29bfbfc63f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:54.770256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1081529e-74f8-4614-bdde-d29bfbfc63f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:54.770940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1081529e-74f8-4614-bdde-d29bfbfc63f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:54.771484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1081529e-74f8-4614-bdde-d29bfbfc63f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:54.772013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1081529e-74f8-4614-bdde-d29bfbfc63f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:54.801321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1081529e-74f8-4614-bdde-d29bfbfc63f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044482 Aug 31 00:42:54.801860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 746/1566] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:55.564831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd0dc449-d1a2-4b87-9e8b-b2312e82ff09 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:55.566951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dd0dc449-d1a2-4b87-9e8b-b2312e82ff09 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:55.574025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0dc449-d1a2-4b87-9e8b-b2312e82ff09 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:55.574469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0dc449-d1a2-4b87-9e8b-b2312e82ff09 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:55.574896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0dc449-d1a2-4b87-9e8b-b2312e82ff09 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:55.575672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0dc449-d1a2-4b87-9e8b-b2312e82ff09 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:55.576118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0dc449-d1a2-4b87-9e8b-b2312e82ff09 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:55.576534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd0dc449-d1a2-4b87-9e8b-b2312e82ff09 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:55.606201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dd0dc449-d1a2-4b87-9e8b-b2312e82ff09 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Aug 31 00:42:55.607028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 821/1567] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:55 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:55.814383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-af901154-3c1d-481f-97f1-240d251954af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:55.816559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-af901154-3c1d-481f-97f1-240d251954af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:55.824172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af901154-3c1d-481f-97f1-240d251954af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:55.824590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af901154-3c1d-481f-97f1-240d251954af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:55.825025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af901154-3c1d-481f-97f1-240d251954af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:55.825716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af901154-3c1d-481f-97f1-240d251954af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:55.826166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af901154-3c1d-481f-97f1-240d251954af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:55.826586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af901154-3c1d-481f-97f1-240d251954af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:55.856963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-af901154-3c1d-481f-97f1-240d251954af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046295 Aug 31 00:42:55.857533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 747/1568] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:56.618734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8f95b909-c22b-4d0b-bdf8-2ca7ee434a2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:56.620861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8f95b909-c22b-4d0b-bdf8-2ca7ee434a2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:56.627508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f95b909-c22b-4d0b-bdf8-2ca7ee434a2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:56.627988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f95b909-c22b-4d0b-bdf8-2ca7ee434a2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:56.628419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f95b909-c22b-4d0b-bdf8-2ca7ee434a2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:56.629108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f95b909-c22b-4d0b-bdf8-2ca7ee434a2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:56.629560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f95b909-c22b-4d0b-bdf8-2ca7ee434a2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:56.629981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f95b909-c22b-4d0b-bdf8-2ca7ee434a2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:56.659168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8f95b909-c22b-4d0b-bdf8-2ca7ee434a2a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Aug 31 00:42:56.659721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 822/1569] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:56.870068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-17f33103-a550-45d9-8812-2d38c358ca47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:56.872118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-17f33103-a550-45d9-8812-2d38c358ca47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:56.878603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17f33103-a550-45d9-8812-2d38c358ca47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:56.879134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17f33103-a550-45d9-8812-2d38c358ca47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:56.879572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17f33103-a550-45d9-8812-2d38c358ca47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:56.880250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17f33103-a550-45d9-8812-2d38c358ca47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:56.880696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17f33103-a550-45d9-8812-2d38c358ca47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:56.881694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-17f33103-a550-45d9-8812-2d38c358ca47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:56.906701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:56.911454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-17f33103-a550-45d9-8812-2d38c358ca47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045672 Aug 31 00:42:56.911999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 748/1570] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:57.736120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2ac79382-7ffc-4d5c-8ac1-4b640b410caf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:57.738372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2ac79382-7ffc-4d5c-8ac1-4b640b410caf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:57.745064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ac79382-7ffc-4d5c-8ac1-4b640b410caf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:57.745536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ac79382-7ffc-4d5c-8ac1-4b640b410caf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:57.745962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ac79382-7ffc-4d5c-8ac1-4b640b410caf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:57.746639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ac79382-7ffc-4d5c-8ac1-4b640b410caf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:57.747110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ac79382-7ffc-4d5c-8ac1-4b640b410caf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:57.747532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ac79382-7ffc-4d5c-8ac1-4b640b410caf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:57.777188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2ac79382-7ffc-4d5c-8ac1-4b640b410caf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109018 Aug 31 00:42:57.777752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 823/1571] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:57.923545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-03f96314-4716-42f4-a542-0cfe4be86e85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:57.925722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-03f96314-4716-42f4-a542-0cfe4be86e85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:57.929162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=58 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:57.934433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03f96314-4716-42f4-a542-0cfe4be86e85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:57.934912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03f96314-4716-42f4-a542-0cfe4be86e85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:57.935378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03f96314-4716-42f4-a542-0cfe4be86e85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:57.936065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03f96314-4716-42f4-a542-0cfe4be86e85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:57.936509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03f96314-4716-42f4-a542-0cfe4be86e85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:57.936929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03f96314-4716-42f4-a542-0cfe4be86e85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:57.966752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-03f96314-4716-42f4-a542-0cfe4be86e85 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047168 Aug 31 00:42:57.967347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 749/1572] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:58.790032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-89988945-2455-47a3-aa95-40d5c22ea5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:58.792232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-89988945-2455-47a3-aa95-40d5c22ea5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:58.798714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89988945-2455-47a3-aa95-40d5c22ea5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:58.799113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89988945-2455-47a3-aa95-40d5c22ea5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:58.799546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89988945-2455-47a3-aa95-40d5c22ea5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:58.800231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89988945-2455-47a3-aa95-40d5c22ea5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:58.800682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89988945-2455-47a3-aa95-40d5c22ea5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:58.801104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89988945-2455-47a3-aa95-40d5c22ea5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:58.831602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-89988945-2455-47a3-aa95-40d5c22ea5d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045997 Aug 31 00:42:58.832158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 824/1573] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:58.979599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-21d14ce8-2682-4969-9ecb-e07e9fdb40bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:58.981992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-21d14ce8-2682-4969-9ecb-e07e9fdb40bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:58.988426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21d14ce8-2682-4969-9ecb-e07e9fdb40bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:58.988910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21d14ce8-2682-4969-9ecb-e07e9fdb40bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:58.989345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21d14ce8-2682-4969-9ecb-e07e9fdb40bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:58.990037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21d14ce8-2682-4969-9ecb-e07e9fdb40bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:58.991017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21d14ce8-2682-4969-9ecb-e07e9fdb40bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:58.991473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21d14ce8-2682-4969-9ecb-e07e9fdb40bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:59.022392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-21d14ce8-2682-4969-9ecb-e07e9fdb40bd tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046877 Aug 31 00:42:59.022949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 750/1574] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:42:59.844263 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bc6a505c-06c1-488f-971a-7bde63e70d47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:59.846426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bc6a505c-06c1-488f-971a-7bde63e70d47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:59.848534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:42:59.848676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:42:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments (ip 10.222.0.67) !!! Aug 31 00:42:59.854755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc6a505c-06c1-488f-971a-7bde63e70d47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:59.855550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc6a505c-06c1-488f-971a-7bde63e70d47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:59.855691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc6a505c-06c1-488f-971a-7bde63e70d47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:59.856397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc6a505c-06c1-488f-971a-7bde63e70d47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:59.857111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc6a505c-06c1-488f-971a-7bde63e70d47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:59.857531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc6a505c-06c1-488f-971a-7bde63e70d47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:59.891308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bc6a505c-06c1-488f-971a-7bde63e70d47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050937 Aug 31 00:42:59.891867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 825/1575] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:00.034119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5f760739-356c-44f1-95e1-f1520b94d1c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:00.036272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5f760739-356c-44f1-95e1-f1520b94d1c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:00.043319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f760739-356c-44f1-95e1-f1520b94d1c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:00.043795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f760739-356c-44f1-95e1-f1520b94d1c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:00.044219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f760739-356c-44f1-95e1-f1520b94d1c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:00.044909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f760739-356c-44f1-95e1-f1520b94d1c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:00.045348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f760739-356c-44f1-95e1-f1520b94d1c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:00.045759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f760739-356c-44f1-95e1-f1520b94d1c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:00.076733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5f760739-356c-44f1-95e1-f1520b94d1c4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046782 Aug 31 00:43:00.077510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 751/1576] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:00.903662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-98decf86-96c1-4265-8027-0eddcfa6d732 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:00.905864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-98decf86-96c1-4265-8027-0eddcfa6d732 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:00.908258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=58 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:00.914297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98decf86-96c1-4265-8027-0eddcfa6d732 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:00.914777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98decf86-96c1-4265-8027-0eddcfa6d732 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:00.915248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98decf86-96c1-4265-8027-0eddcfa6d732 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:00.915944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98decf86-96c1-4265-8027-0eddcfa6d732 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:00.916402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98decf86-96c1-4265-8027-0eddcfa6d732 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:00.916825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98decf86-96c1-4265-8027-0eddcfa6d732 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:00.947561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-98decf86-96c1-4265-8027-0eddcfa6d732 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047683 Aug 31 00:43:00.948165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 826/1577] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:01.090787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a8f5dbc7-3ea4-4324-b029-04606545ea42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:01.092957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a8f5dbc7-3ea4-4324-b029-04606545ea42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:01.099296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8f5dbc7-3ea4-4324-b029-04606545ea42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:01.100602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8f5dbc7-3ea4-4324-b029-04606545ea42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:01.101046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8f5dbc7-3ea4-4324-b029-04606545ea42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:01.101736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8f5dbc7-3ea4-4324-b029-04606545ea42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:01.102183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8f5dbc7-3ea4-4324-b029-04606545ea42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:01.102602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8f5dbc7-3ea4-4324-b029-04606545ea42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:01.131866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a8f5dbc7-3ea4-4324-b029-04606545ea42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045230 Aug 31 00:43:01.132393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 752/1578] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:01.960551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-64bfe2e6-a5c8-4c91-9a3a-46dc4d385d4e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:01.962704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-64bfe2e6-a5c8-4c91-9a3a-46dc4d385d4e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:01.969130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64bfe2e6-a5c8-4c91-9a3a-46dc4d385d4e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:01.969607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64bfe2e6-a5c8-4c91-9a3a-46dc4d385d4e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:01.970042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64bfe2e6-a5c8-4c91-9a3a-46dc4d385d4e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:01.970774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64bfe2e6-a5c8-4c91-9a3a-46dc4d385d4e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:01.971254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64bfe2e6-a5c8-4c91-9a3a-46dc4d385d4e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:01.971671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64bfe2e6-a5c8-4c91-9a3a-46dc4d385d4e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:02.002532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-64bfe2e6-a5c8-4c91-9a3a-46dc4d385d4e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046491 Aug 31 00:43:02.003097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 827/1579] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:02.144382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8a4ec591-83a0-4939-977c-f0971d4ec214 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:02.147224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8a4ec591-83a0-4939-977c-f0971d4ec214 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:02.153803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4ec591-83a0-4939-977c-f0971d4ec214 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:02.154275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4ec591-83a0-4939-977c-f0971d4ec214 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:02.154699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4ec591-83a0-4939-977c-f0971d4ec214 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:02.155398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4ec591-83a0-4939-977c-f0971d4ec214 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:02.155838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4ec591-83a0-4939-977c-f0971d4ec214 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:02.156249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4ec591-83a0-4939-977c-f0971d4ec214 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:02.185618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8a4ec591-83a0-4939-977c-f0971d4ec214 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045248 Aug 31 00:43:02.186155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 753/1580] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:03.015122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fa7a69fa-ae8d-4ac4-9f3d-faeeb4837de0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:03.017522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fa7a69fa-ae8d-4ac4-9f3d-faeeb4837de0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:03.025800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa7a69fa-ae8d-4ac4-9f3d-faeeb4837de0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:03.026280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa7a69fa-ae8d-4ac4-9f3d-faeeb4837de0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:03.026713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa7a69fa-ae8d-4ac4-9f3d-faeeb4837de0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:03.027462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa7a69fa-ae8d-4ac4-9f3d-faeeb4837de0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:03.027910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa7a69fa-ae8d-4ac4-9f3d-faeeb4837de0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:03.028327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa7a69fa-ae8d-4ac4-9f3d-faeeb4837de0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:03.058134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fa7a69fa-ae8d-4ac4-9f3d-faeeb4837de0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046964 Aug 31 00:43:03.058679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 828/1581] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:03.198667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-afb817ac-fcdd-4a4f-add3-cce4864c7354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:03.200840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-afb817ac-fcdd-4a4f-add3-cce4864c7354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:03.207206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb817ac-fcdd-4a4f-add3-cce4864c7354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:03.207683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb817ac-fcdd-4a4f-add3-cce4864c7354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:03.208113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb817ac-fcdd-4a4f-add3-cce4864c7354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:03.208787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb817ac-fcdd-4a4f-add3-cce4864c7354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:03.209999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb817ac-fcdd-4a4f-add3-cce4864c7354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:03.210423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afb817ac-fcdd-4a4f-add3-cce4864c7354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:03.239275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-afb817ac-fcdd-4a4f-add3-cce4864c7354 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044685 Aug 31 00:43:03.239813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 754/1582] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:04.070061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5df6be02-3155-41e5-a01e-8b12f9ffb4f0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:04.072182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5df6be02-3155-41e5-a01e-8b12f9ffb4f0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:04.078612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5df6be02-3155-41e5-a01e-8b12f9ffb4f0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:04.079111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5df6be02-3155-41e5-a01e-8b12f9ffb4f0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:04.079541 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5df6be02-3155-41e5-a01e-8b12f9ffb4f0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:04.080253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5df6be02-3155-41e5-a01e-8b12f9ffb4f0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:04.080697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5df6be02-3155-41e5-a01e-8b12f9ffb4f0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:04.081160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5df6be02-3155-41e5-a01e-8b12f9ffb4f0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:04.111232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5df6be02-3155-41e5-a01e-8b12f9ffb4f0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045232 Aug 31 00:43:04.111802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 829/1583] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:43:04.252417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3550729d-3bc0-4038-9eea-3fc5cad6e643 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:04.254459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3550729d-3bc0-4038-9eea-3fc5cad6e643 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:04.261174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3550729d-3bc0-4038-9eea-3fc5cad6e643 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:04.261653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3550729d-3bc0-4038-9eea-3fc5cad6e643 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:04.262081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3550729d-3bc0-4038-9eea-3fc5cad6e643 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:04.262771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3550729d-3bc0-4038-9eea-3fc5cad6e643 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:04.263251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3550729d-3bc0-4038-9eea-3fc5cad6e643 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:04.263671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3550729d-3bc0-4038-9eea-3fc5cad6e643 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:04.293573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3550729d-3bc0-4038-9eea-3fc5cad6e643 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045173 Aug 31 00:43:04.294120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 755/1584] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:05.123565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b0357e9a-a33b-4fc2-97b0-7fef6885f3f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:05.125681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b0357e9a-a33b-4fc2-97b0-7fef6885f3f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:05.132257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b0357e9a-a33b-4fc2-97b0-7fef6885f3f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:05.132734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b0357e9a-a33b-4fc2-97b0-7fef6885f3f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:05.133165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b0357e9a-a33b-4fc2-97b0-7fef6885f3f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:05.133849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b0357e9a-a33b-4fc2-97b0-7fef6885f3f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:05.134297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b0357e9a-a33b-4fc2-97b0-7fef6885f3f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:05.134717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b0357e9a-a33b-4fc2-97b0-7fef6885f3f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:05.165010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b0357e9a-a33b-4fc2-97b0-7fef6885f3f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Aug 31 00:43:05.165564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 830/1585] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:05.306837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5494558a-b6a3-43cd-9d18-090e8471df63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:05.309017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5494558a-b6a3-43cd-9d18-090e8471df63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:05.315404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5494558a-b6a3-43cd-9d18-090e8471df63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:05.315924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5494558a-b6a3-43cd-9d18-090e8471df63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:05.316389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5494558a-b6a3-43cd-9d18-090e8471df63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:05.317030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5494558a-b6a3-43cd-9d18-090e8471df63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:05.317479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5494558a-b6a3-43cd-9d18-090e8471df63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:05.317903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5494558a-b6a3-43cd-9d18-090e8471df63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:05.348056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5494558a-b6a3-43cd-9d18-090e8471df63 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046154 Aug 31 00:43:05.348612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 756/1586] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:06.177388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b9d13833-c840-4d00-b480-fc6c71db226e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:06.179802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b9d13833-c840-4d00-b480-fc6c71db226e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:06.186163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9d13833-c840-4d00-b480-fc6c71db226e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:06.186643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9d13833-c840-4d00-b480-fc6c71db226e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:06.187104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9d13833-c840-4d00-b480-fc6c71db226e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:06.187796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9d13833-c840-4d00-b480-fc6c71db226e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:06.188251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9d13833-c840-4d00-b480-fc6c71db226e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:06.188677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9d13833-c840-4d00-b480-fc6c71db226e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:06.219756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b9d13833-c840-4d00-b480-fc6c71db226e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Aug 31 00:43:06.220305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 831/1587] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:06.362415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ca367e13-f109-4a6b-ad8d-d1664c58ceb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:06.364648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ca367e13-f109-4a6b-ad8d-d1664c58ceb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:06.371755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca367e13-f109-4a6b-ad8d-d1664c58ceb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:06.372230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca367e13-f109-4a6b-ad8d-d1664c58ceb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:06.372655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca367e13-f109-4a6b-ad8d-d1664c58ceb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:06.373326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca367e13-f109-4a6b-ad8d-d1664c58ceb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:06.373761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca367e13-f109-4a6b-ad8d-d1664c58ceb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:06.374173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca367e13-f109-4a6b-ad8d-d1664c58ceb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:06.403895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ca367e13-f109-4a6b-ad8d-d1664c58ceb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045822 Aug 31 00:43:06.404438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 757/1588] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:07.234774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d744ab85-721d-485a-bec2-bc4e16b32440 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:07.236942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d744ab85-721d-485a-bec2-bc4e16b32440 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:07.243570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d744ab85-721d-485a-bec2-bc4e16b32440 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:07.244051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d744ab85-721d-485a-bec2-bc4e16b32440 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:07.244489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d744ab85-721d-485a-bec2-bc4e16b32440 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:07.245225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d744ab85-721d-485a-bec2-bc4e16b32440 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:07.245629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d744ab85-721d-485a-bec2-bc4e16b32440 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:07.246052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d744ab85-721d-485a-bec2-bc4e16b32440 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:07.276054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d744ab85-721d-485a-bec2-bc4e16b32440 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045450 Aug 31 00:43:07.276606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 832/1589] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:07.415994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b20510ea-e028-45e8-9280-e823429a9258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:07.418093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b20510ea-e028-45e8-9280-e823429a9258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:07.424448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b20510ea-e028-45e8-9280-e823429a9258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:07.424921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b20510ea-e028-45e8-9280-e823429a9258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:07.425346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b20510ea-e028-45e8-9280-e823429a9258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:07.426016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b20510ea-e028-45e8-9280-e823429a9258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:07.426453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b20510ea-e028-45e8-9280-e823429a9258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:07.426866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b20510ea-e028-45e8-9280-e823429a9258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:07.455814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b20510ea-e028-45e8-9280-e823429a9258 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044026 Aug 31 00:43:07.456350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 758/1590] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:08.290691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a5af3ed9-b4e9-4385-86bc-f26f66e72ba0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:08.292767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a5af3ed9-b4e9-4385-86bc-f26f66e72ba0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:08.299147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5af3ed9-b4e9-4385-86bc-f26f66e72ba0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:08.299634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5af3ed9-b4e9-4385-86bc-f26f66e72ba0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:08.300068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5af3ed9-b4e9-4385-86bc-f26f66e72ba0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:08.300754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5af3ed9-b4e9-4385-86bc-f26f66e72ba0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:08.301207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5af3ed9-b4e9-4385-86bc-f26f66e72ba0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:08.301630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5af3ed9-b4e9-4385-86bc-f26f66e72ba0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:08.333177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a5af3ed9-b4e9-4385-86bc-f26f66e72ba0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048018 Aug 31 00:43:08.333737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 833/1591] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:43:08.468929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6bf65315-7bfe-4884-a454-8d418e819595 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:08.471058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6bf65315-7bfe-4884-a454-8d418e819595 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:08.478209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bf65315-7bfe-4884-a454-8d418e819595 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:08.478678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bf65315-7bfe-4884-a454-8d418e819595 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:08.479141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bf65315-7bfe-4884-a454-8d418e819595 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:08.479818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bf65315-7bfe-4884-a454-8d418e819595 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:08.480260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bf65315-7bfe-4884-a454-8d418e819595 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:08.480671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bf65315-7bfe-4884-a454-8d418e819595 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:08.510287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6bf65315-7bfe-4884-a454-8d418e819595 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045412 Aug 31 00:43:08.510847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 759/1592] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:09.345954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7774b98d-ea66-42e3-aa86-777799ee3e66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:09.348100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7774b98d-ea66-42e3-aa86-777799ee3e66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:09.354993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7774b98d-ea66-42e3-aa86-777799ee3e66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:09.355516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7774b98d-ea66-42e3-aa86-777799ee3e66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:09.355958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7774b98d-ea66-42e3-aa86-777799ee3e66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:09.356916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7774b98d-ea66-42e3-aa86-777799ee3e66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:09.357368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7774b98d-ea66-42e3-aa86-777799ee3e66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:09.357791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7774b98d-ea66-42e3-aa86-777799ee3e66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:09.390134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7774b98d-ea66-42e3-aa86-777799ee3e66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048138 Aug 31 00:43:09.390695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 834/1593] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:09.522018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-693fd919-a8a0-45a8-94d4-0fcbaf314d9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:09.524161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-693fd919-a8a0-45a8-94d4-0fcbaf314d9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:09.530271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-693fd919-a8a0-45a8-94d4-0fcbaf314d9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:09.530748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-693fd919-a8a0-45a8-94d4-0fcbaf314d9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:09.531212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-693fd919-a8a0-45a8-94d4-0fcbaf314d9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:09.531931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-693fd919-a8a0-45a8-94d4-0fcbaf314d9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:09.532382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-693fd919-a8a0-45a8-94d4-0fcbaf314d9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:09.532806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-693fd919-a8a0-45a8-94d4-0fcbaf314d9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:09.563010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-693fd919-a8a0-45a8-94d4-0fcbaf314d9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045108 Aug 31 00:43:09.563576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 760/1594] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:10.403057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3df9f367-8ea2-406f-869e-d9a5ed34f252 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:10.405178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3df9f367-8ea2-406f-869e-d9a5ed34f252 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:10.411665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df9f367-8ea2-406f-869e-d9a5ed34f252 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:10.412140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df9f367-8ea2-406f-869e-d9a5ed34f252 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:10.412568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df9f367-8ea2-406f-869e-d9a5ed34f252 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:10.413254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df9f367-8ea2-406f-869e-d9a5ed34f252 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:10.413702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df9f367-8ea2-406f-869e-d9a5ed34f252 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:10.414576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df9f367-8ea2-406f-869e-d9a5ed34f252 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:10.443208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3df9f367-8ea2-406f-869e-d9a5ed34f252 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Aug 31 00:43:10.444369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 835/1595] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:10.575793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2f174c91-09e7-468a-a725-5f0b3798986d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:10.577871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2f174c91-09e7-468a-a725-5f0b3798986d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:10.585456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f174c91-09e7-468a-a725-5f0b3798986d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:10.585933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f174c91-09e7-468a-a725-5f0b3798986d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:10.586364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f174c91-09e7-468a-a725-5f0b3798986d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:10.587069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f174c91-09e7-468a-a725-5f0b3798986d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:10.587526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f174c91-09e7-468a-a725-5f0b3798986d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:10.587945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f174c91-09e7-468a-a725-5f0b3798986d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:10.617252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2f174c91-09e7-468a-a725-5f0b3798986d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045481 Aug 31 00:43:10.617805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 761/1596] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:11.456127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2ab990c3-1e0e-4c73-8c8a-b94bfd066acc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:11.458288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2ab990c3-1e0e-4c73-8c8a-b94bfd066acc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:11.465311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ab990c3-1e0e-4c73-8c8a-b94bfd066acc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:11.465782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ab990c3-1e0e-4c73-8c8a-b94bfd066acc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:11.466210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ab990c3-1e0e-4c73-8c8a-b94bfd066acc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:11.466886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ab990c3-1e0e-4c73-8c8a-b94bfd066acc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:11.467360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ab990c3-1e0e-4c73-8c8a-b94bfd066acc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:11.467774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ab990c3-1e0e-4c73-8c8a-b94bfd066acc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:11.471500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:11.498588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2ab990c3-1e0e-4c73-8c8a-b94bfd066acc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046432 Aug 31 00:43:11.499159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 836/1597] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:11.629678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2fb00d7e-4773-4304-8eb7-939557ab6d62 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:11.631838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2fb00d7e-4773-4304-8eb7-939557ab6d62 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:11.638144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fb00d7e-4773-4304-8eb7-939557ab6d62 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:11.638620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fb00d7e-4773-4304-8eb7-939557ab6d62 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:11.639068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fb00d7e-4773-4304-8eb7-939557ab6d62 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:11.639750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fb00d7e-4773-4304-8eb7-939557ab6d62 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:11.640199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fb00d7e-4773-4304-8eb7-939557ab6d62 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:11.640622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fb00d7e-4773-4304-8eb7-939557ab6d62 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:11.670370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2fb00d7e-4773-4304-8eb7-939557ab6d62 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044752 Aug 31 00:43:11.670912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 762/1598] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:12.511751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e4be95b3-9578-44a0-9d1b-432ff6b25418 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:12.513902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e4be95b3-9578-44a0-9d1b-432ff6b25418 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:12.520006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4be95b3-9578-44a0-9d1b-432ff6b25418 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:12.520486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4be95b3-9578-44a0-9d1b-432ff6b25418 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:12.520919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4be95b3-9578-44a0-9d1b-432ff6b25418 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:12.521930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4be95b3-9578-44a0-9d1b-432ff6b25418 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:12.522380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4be95b3-9578-44a0-9d1b-432ff6b25418 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:12.522802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4be95b3-9578-44a0-9d1b-432ff6b25418 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:12.552618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e4be95b3-9578-44a0-9d1b-432ff6b25418 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Aug 31 00:43:12.553821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 837/1599] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:12.682463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-aefa7e13-8b65-45f0-93d3-c10433b13d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:12.684616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-aefa7e13-8b65-45f0-93d3-c10433b13d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:12.690875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aefa7e13-8b65-45f0-93d3-c10433b13d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:12.691378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aefa7e13-8b65-45f0-93d3-c10433b13d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:12.691801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aefa7e13-8b65-45f0-93d3-c10433b13d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:12.692469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aefa7e13-8b65-45f0-93d3-c10433b13d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:12.692908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aefa7e13-8b65-45f0-93d3-c10433b13d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:12.693651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aefa7e13-8b65-45f0-93d3-c10433b13d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:12.721962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-aefa7e13-8b65-45f0-93d3-c10433b13d50 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044064 Aug 31 00:43:12.722507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 763/1600] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:13.566060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04d287f9-80c9-4af4-83a6-b9aba90ed88e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:13.568235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-04d287f9-80c9-4af4-83a6-b9aba90ed88e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:13.575192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d287f9-80c9-4af4-83a6-b9aba90ed88e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:13.575664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d287f9-80c9-4af4-83a6-b9aba90ed88e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:13.576087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d287f9-80c9-4af4-83a6-b9aba90ed88e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:13.576762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d287f9-80c9-4af4-83a6-b9aba90ed88e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:13.577202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d287f9-80c9-4af4-83a6-b9aba90ed88e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:13.577618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d287f9-80c9-4af4-83a6-b9aba90ed88e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:13.608202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-04d287f9-80c9-4af4-83a6-b9aba90ed88e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046012 Aug 31 00:43:13.608677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 838/1601] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:13.734642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0b1e56d7-99b6-4d79-92b5-942ac8c4dd55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:13.736832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0b1e56d7-99b6-4d79-92b5-942ac8c4dd55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:13.743861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b1e56d7-99b6-4d79-92b5-942ac8c4dd55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:13.744341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b1e56d7-99b6-4d79-92b5-942ac8c4dd55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:13.744771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b1e56d7-99b6-4d79-92b5-942ac8c4dd55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:13.745469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b1e56d7-99b6-4d79-92b5-942ac8c4dd55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:13.745918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b1e56d7-99b6-4d79-92b5-942ac8c4dd55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:13.746336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b1e56d7-99b6-4d79-92b5-942ac8c4dd55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:13.777758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0b1e56d7-99b6-4d79-92b5-942ac8c4dd55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047325 Aug 31 00:43:13.778319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 764/1602] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:14.621098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1220f1c3-295e-4e93-b30a-77e63ed17930 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:14.623229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1220f1c3-295e-4e93-b30a-77e63ed17930 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:14.629636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1220f1c3-295e-4e93-b30a-77e63ed17930 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:14.630114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1220f1c3-295e-4e93-b30a-77e63ed17930 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:14.630546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1220f1c3-295e-4e93-b30a-77e63ed17930 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:14.632022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1220f1c3-295e-4e93-b30a-77e63ed17930 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:14.632476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1220f1c3-295e-4e93-b30a-77e63ed17930 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:14.632896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1220f1c3-295e-4e93-b30a-77e63ed17930 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:14.662277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1220f1c3-295e-4e93-b30a-77e63ed17930 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Aug 31 00:43:14.662784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 839/1603] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:14.790065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3acb9bf-4a7f-469b-b3b3-7fea00e938de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:14.792210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3acb9bf-4a7f-469b-b3b3-7fea00e938de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:14.798538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3acb9bf-4a7f-469b-b3b3-7fea00e938de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:14.799015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3acb9bf-4a7f-469b-b3b3-7fea00e938de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:14.799500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3acb9bf-4a7f-469b-b3b3-7fea00e938de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:14.800148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3acb9bf-4a7f-469b-b3b3-7fea00e938de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:14.800593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3acb9bf-4a7f-469b-b3b3-7fea00e938de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:14.801007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3acb9bf-4a7f-469b-b3b3-7fea00e938de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:14.817805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:14.832394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3acb9bf-4a7f-469b-b3b3-7fea00e938de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046359 Aug 31 00:43:14.832942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 765/1604] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:15.674569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7cd5d4a9-5914-4ee6-9675-ede7ceb757fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:15.676753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7cd5d4a9-5914-4ee6-9675-ede7ceb757fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:15.683432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd5d4a9-5914-4ee6-9675-ede7ceb757fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:15.683913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd5d4a9-5914-4ee6-9675-ede7ceb757fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:15.684349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd5d4a9-5914-4ee6-9675-ede7ceb757fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:15.685059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd5d4a9-5914-4ee6-9675-ede7ceb757fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:15.685514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd5d4a9-5914-4ee6-9675-ede7ceb757fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:15.685937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd5d4a9-5914-4ee6-9675-ede7ceb757fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:15.716716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7cd5d4a9-5914-4ee6-9675-ede7ceb757fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046061 Aug 31 00:43:15.717273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 840/1605] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:15.845219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-716e32b1-d835-415f-a63c-c3f7dfbc8450 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:15.847445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-716e32b1-d835-415f-a63c-c3f7dfbc8450 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:15.854155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-716e32b1-d835-415f-a63c-c3f7dfbc8450 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:15.854625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-716e32b1-d835-415f-a63c-c3f7dfbc8450 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:15.855077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-716e32b1-d835-415f-a63c-c3f7dfbc8450 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:15.855783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-716e32b1-d835-415f-a63c-c3f7dfbc8450 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:15.856224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-716e32b1-d835-415f-a63c-c3f7dfbc8450 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:15.856636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-716e32b1-d835-415f-a63c-c3f7dfbc8450 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:15.886331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-716e32b1-d835-415f-a63c-c3f7dfbc8450 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045146 Aug 31 00:43:15.886887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 766/1606] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:16.733081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ac16ae16-0647-41bb-a053-5b8998115891 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:16.736679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ac16ae16-0647-41bb-a053-5b8998115891 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:16.747383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac16ae16-0647-41bb-a053-5b8998115891 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:16.748428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac16ae16-0647-41bb-a053-5b8998115891 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:16.748876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac16ae16-0647-41bb-a053-5b8998115891 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:16.749581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac16ae16-0647-41bb-a053-5b8998115891 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:16.750037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac16ae16-0647-41bb-a053-5b8998115891 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:16.750458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac16ae16-0647-41bb-a053-5b8998115891 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:16.789949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ac16ae16-0647-41bb-a053-5b8998115891 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063463 Aug 31 00:43:16.790531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 841/1607] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:16.899683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5afe9bcf-0f59-4131-bada-18f0de9dbe84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:16.903151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5afe9bcf-0f59-4131-bada-18f0de9dbe84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:16.911123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5afe9bcf-0f59-4131-bada-18f0de9dbe84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:16.911610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5afe9bcf-0f59-4131-bada-18f0de9dbe84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:16.912068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5afe9bcf-0f59-4131-bada-18f0de9dbe84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:16.912775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5afe9bcf-0f59-4131-bada-18f0de9dbe84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:16.913216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5afe9bcf-0f59-4131-bada-18f0de9dbe84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:16.913632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5afe9bcf-0f59-4131-bada-18f0de9dbe84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:16.946082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5afe9bcf-0f59-4131-bada-18f0de9dbe84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051913 Aug 31 00:43:16.946986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 767/1608] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:17.801820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a807f30e-1941-43e5-9345-d8223be9e57e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:17.804541 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a807f30e-1941-43e5-9345-d8223be9e57e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:17.811048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a807f30e-1941-43e5-9345-d8223be9e57e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:17.811538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a807f30e-1941-43e5-9345-d8223be9e57e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:17.811962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a807f30e-1941-43e5-9345-d8223be9e57e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:17.812725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a807f30e-1941-43e5-9345-d8223be9e57e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:17.813166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a807f30e-1941-43e5-9345-d8223be9e57e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:17.813578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a807f30e-1941-43e5-9345-d8223be9e57e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:17.843184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a807f30e-1941-43e5-9345-d8223be9e57e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Aug 31 00:43:17.843733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 842/1609] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:17.958597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5dea789a-0844-4496-b9d3-a2eeb7664f2e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:17.960893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5dea789a-0844-4496-b9d3-a2eeb7664f2e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:17.967472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dea789a-0844-4496-b9d3-a2eeb7664f2e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:17.967976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dea789a-0844-4496-b9d3-a2eeb7664f2e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:17.968413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dea789a-0844-4496-b9d3-a2eeb7664f2e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:17.969110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dea789a-0844-4496-b9d3-a2eeb7664f2e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:17.969563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dea789a-0844-4496-b9d3-a2eeb7664f2e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:17.970019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dea789a-0844-4496-b9d3-a2eeb7664f2e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:18.001698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5dea789a-0844-4496-b9d3-a2eeb7664f2e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047035 Aug 31 00:43:18.002251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 768/1610] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:18.856293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ded9e040-586f-4c4d-928f-bd7ff702a95f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:18.858653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ded9e040-586f-4c4d-928f-bd7ff702a95f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:18.865116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ded9e040-586f-4c4d-928f-bd7ff702a95f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:18.865593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ded9e040-586f-4c4d-928f-bd7ff702a95f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:18.866155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ded9e040-586f-4c4d-928f-bd7ff702a95f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:18.866947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ded9e040-586f-4c4d-928f-bd7ff702a95f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:18.867418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ded9e040-586f-4c4d-928f-bd7ff702a95f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:18.867835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ded9e040-586f-4c4d-928f-bd7ff702a95f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:18.896962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ded9e040-586f-4c4d-928f-bd7ff702a95f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044726 Aug 31 00:43:18.898141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 843/1611] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:18 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:19.014114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-209eb8bf-5e24-446a-bf20-5cdffe9e9382 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:19.016323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-209eb8bf-5e24-446a-bf20-5cdffe9e9382 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:19.023813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209eb8bf-5e24-446a-bf20-5cdffe9e9382 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:19.024301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209eb8bf-5e24-446a-bf20-5cdffe9e9382 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:19.024743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209eb8bf-5e24-446a-bf20-5cdffe9e9382 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:19.025436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209eb8bf-5e24-446a-bf20-5cdffe9e9382 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:19.025890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209eb8bf-5e24-446a-bf20-5cdffe9e9382 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:19.026316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-209eb8bf-5e24-446a-bf20-5cdffe9e9382 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:19.056194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-209eb8bf-5e24-446a-bf20-5cdffe9e9382 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046068 Aug 31 00:43:19.056796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 769/1612] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:19.909151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4698799c-4726-4bc6-9fc7-f43572913513 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:19.911225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4698799c-4726-4bc6-9fc7-f43572913513 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:19.918138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4698799c-4726-4bc6-9fc7-f43572913513 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:19.918608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4698799c-4726-4bc6-9fc7-f43572913513 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:19.919030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4698799c-4726-4bc6-9fc7-f43572913513 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:19.919729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4698799c-4726-4bc6-9fc7-f43572913513 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:19.920170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4698799c-4726-4bc6-9fc7-f43572913513 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:19.920581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4698799c-4726-4bc6-9fc7-f43572913513 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:19.949829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4698799c-4726-4bc6-9fc7-f43572913513 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044670 Aug 31 00:43:19.950386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 844/1613] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:20.068206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0f02d033-413c-438f-8929-a89b43e48567 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:20.070854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0f02d033-413c-438f-8929-a89b43e48567 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:20.077191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f02d033-413c-438f-8929-a89b43e48567 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:20.077663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f02d033-413c-438f-8929-a89b43e48567 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:20.078097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f02d033-413c-438f-8929-a89b43e48567 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:20.078774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f02d033-413c-438f-8929-a89b43e48567 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:20.079257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f02d033-413c-438f-8929-a89b43e48567 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:20.079676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f02d033-413c-438f-8929-a89b43e48567 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:20.108967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0f02d033-413c-438f-8929-a89b43e48567 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044713 Aug 31 00:43:20.109505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 770/1614] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:20.962480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d22e1357-5880-44a2-b3c8-c5c954777b6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:20.964495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d22e1357-5880-44a2-b3c8-c5c954777b6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:20.970739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d22e1357-5880-44a2-b3c8-c5c954777b6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:20.971266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d22e1357-5880-44a2-b3c8-c5c954777b6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:20.971706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d22e1357-5880-44a2-b3c8-c5c954777b6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:20.972402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d22e1357-5880-44a2-b3c8-c5c954777b6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:20.972849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d22e1357-5880-44a2-b3c8-c5c954777b6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:20.973269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d22e1357-5880-44a2-b3c8-c5c954777b6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:21.004607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d22e1357-5880-44a2-b3c8-c5c954777b6c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046467 Aug 31 00:43:21.005165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 845/1615] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:21.122267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-77d397a9-6050-4688-ae73-8fa82fc1abbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:21.124413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-77d397a9-6050-4688-ae73-8fa82fc1abbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:21.130700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77d397a9-6050-4688-ae73-8fa82fc1abbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:21.131202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77d397a9-6050-4688-ae73-8fa82fc1abbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:21.131659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77d397a9-6050-4688-ae73-8fa82fc1abbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:21.132585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77d397a9-6050-4688-ae73-8fa82fc1abbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:21.133035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77d397a9-6050-4688-ae73-8fa82fc1abbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:21.133447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77d397a9-6050-4688-ae73-8fa82fc1abbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:21.161968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-77d397a9-6050-4688-ae73-8fa82fc1abbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043703 Aug 31 00:43:21.162520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 771/1616] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:22.016790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1588de51-f830-4767-8b69-ba1aed3b3761 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:22.018889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1588de51-f830-4767-8b69-ba1aed3b3761 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:22.025379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1588de51-f830-4767-8b69-ba1aed3b3761 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:22.025851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1588de51-f830-4767-8b69-ba1aed3b3761 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:22.026279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1588de51-f830-4767-8b69-ba1aed3b3761 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:22.026952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1588de51-f830-4767-8b69-ba1aed3b3761 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:22.027416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1588de51-f830-4767-8b69-ba1aed3b3761 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:22.027831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1588de51-f830-4767-8b69-ba1aed3b3761 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:22.058023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1588de51-f830-4767-8b69-ba1aed3b3761 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045106 Aug 31 00:43:22.058587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 846/1617] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:22 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:22.175057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d8539409-464c-41fa-b5dd-37cf6c37c38a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:22.177187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d8539409-464c-41fa-b5dd-37cf6c37c38a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:22.184207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8539409-464c-41fa-b5dd-37cf6c37c38a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:22.184684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8539409-464c-41fa-b5dd-37cf6c37c38a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:22.185112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8539409-464c-41fa-b5dd-37cf6c37c38a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:22.185792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8539409-464c-41fa-b5dd-37cf6c37c38a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:22.186233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8539409-464c-41fa-b5dd-37cf6c37c38a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:22.186647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8539409-464c-41fa-b5dd-37cf6c37c38a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:22.216093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d8539409-464c-41fa-b5dd-37cf6c37c38a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045002 Aug 31 00:43:22.216641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 772/1618] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:23.071628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f74c67ec-4082-414e-9587-af2abaa5c096 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:23.075721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f74c67ec-4082-414e-9587-af2abaa5c096 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:23.080604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f74c67ec-4082-414e-9587-af2abaa5c096 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:23.081125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f74c67ec-4082-414e-9587-af2abaa5c096 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:23.081544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f74c67ec-4082-414e-9587-af2abaa5c096 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:23.082241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f74c67ec-4082-414e-9587-af2abaa5c096 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:23.082696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f74c67ec-4082-414e-9587-af2abaa5c096 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:23.083163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f74c67ec-4082-414e-9587-af2abaa5c096 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:23.113970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f74c67ec-4082-414e-9587-af2abaa5c096 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 Aug 31 00:43:23.114531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 847/1619] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:23.228653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-866abfdc-040c-4e48-a7f9-703647f1c61e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:23.230775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-866abfdc-040c-4e48-a7f9-703647f1c61e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:23.237398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-866abfdc-040c-4e48-a7f9-703647f1c61e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:23.237872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-866abfdc-040c-4e48-a7f9-703647f1c61e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:23.238300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-866abfdc-040c-4e48-a7f9-703647f1c61e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:23.238976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-866abfdc-040c-4e48-a7f9-703647f1c61e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:23.239445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-866abfdc-040c-4e48-a7f9-703647f1c61e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:23.239863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-866abfdc-040c-4e48-a7f9-703647f1c61e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:23.269449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-866abfdc-040c-4e48-a7f9-703647f1c61e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044857 Aug 31 00:43:23.270005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 773/1620] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:24.126317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-34ebecb0-33b0-4807-bd26-a9fefa9bbaa8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:24.128549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-34ebecb0-33b0-4807-bd26-a9fefa9bbaa8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:24.135624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34ebecb0-33b0-4807-bd26-a9fefa9bbaa8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:24.136203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34ebecb0-33b0-4807-bd26-a9fefa9bbaa8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:24.136641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34ebecb0-33b0-4807-bd26-a9fefa9bbaa8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:24.137328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34ebecb0-33b0-4807-bd26-a9fefa9bbaa8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:24.137777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34ebecb0-33b0-4807-bd26-a9fefa9bbaa8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:24.138199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34ebecb0-33b0-4807-bd26-a9fefa9bbaa8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:24.167880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-34ebecb0-33b0-4807-bd26-a9fefa9bbaa8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Aug 31 00:43:24.168445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 848/1621] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:24.281924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4041d359-b3b4-44d7-a547-81548a38268a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:24.284105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4041d359-b3b4-44d7-a547-81548a38268a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:24.290504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4041d359-b3b4-44d7-a547-81548a38268a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:24.290983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4041d359-b3b4-44d7-a547-81548a38268a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:24.291458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4041d359-b3b4-44d7-a547-81548a38268a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:24.292140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4041d359-b3b4-44d7-a547-81548a38268a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:24.292589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4041d359-b3b4-44d7-a547-81548a38268a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:24.293009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4041d359-b3b4-44d7-a547-81548a38268a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:24.322741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4041d359-b3b4-44d7-a547-81548a38268a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044827 Aug 31 00:43:24.323307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 774/1622] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:25.180384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-54162e86-788a-416a-87eb-6c5646a552a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:25.182422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-54162e86-788a-416a-87eb-6c5646a552a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:25.189124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54162e86-788a-416a-87eb-6c5646a552a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:25.189738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54162e86-788a-416a-87eb-6c5646a552a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:25.190311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54162e86-788a-416a-87eb-6c5646a552a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:25.191149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54162e86-788a-416a-87eb-6c5646a552a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:25.191600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54162e86-788a-416a-87eb-6c5646a552a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:25.192019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54162e86-788a-416a-87eb-6c5646a552a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:25.222182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-54162e86-788a-416a-87eb-6c5646a552a6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045804 Aug 31 00:43:25.222727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 849/1623] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:25.335109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ec7adc48-eb73-43e1-9389-f73a7bfe2355 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:25.337809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ec7adc48-eb73-43e1-9389-f73a7bfe2355 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:25.344151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec7adc48-eb73-43e1-9389-f73a7bfe2355 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:25.344622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec7adc48-eb73-43e1-9389-f73a7bfe2355 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:25.345046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec7adc48-eb73-43e1-9389-f73a7bfe2355 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:25.345960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec7adc48-eb73-43e1-9389-f73a7bfe2355 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:25.346403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec7adc48-eb73-43e1-9389-f73a7bfe2355 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:25.346814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec7adc48-eb73-43e1-9389-f73a7bfe2355 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:25.380569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ec7adc48-eb73-43e1-9389-f73a7bfe2355 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049655 Aug 31 00:43:25.381115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 775/1624] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:43:26.234916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-427eefe2-7243-488f-8669-89fef6c5894f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:26.236985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-427eefe2-7243-488f-8669-89fef6c5894f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:26.244044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-427eefe2-7243-488f-8669-89fef6c5894f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:26.244525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-427eefe2-7243-488f-8669-89fef6c5894f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:26.244961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-427eefe2-7243-488f-8669-89fef6c5894f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:26.245645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-427eefe2-7243-488f-8669-89fef6c5894f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:26.246102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-427eefe2-7243-488f-8669-89fef6c5894f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:26.246525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-427eefe2-7243-488f-8669-89fef6c5894f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:26.276224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-427eefe2-7243-488f-8669-89fef6c5894f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Aug 31 00:43:26.276775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 850/1625] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:26 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:26.393795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7fdf2fa4-731f-4cdc-9c97-7a8e14215539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:26.395982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7fdf2fa4-731f-4cdc-9c97-7a8e14215539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:26.403560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fdf2fa4-731f-4cdc-9c97-7a8e14215539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:26.404048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fdf2fa4-731f-4cdc-9c97-7a8e14215539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:26.404481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fdf2fa4-731f-4cdc-9c97-7a8e14215539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:26.405172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fdf2fa4-731f-4cdc-9c97-7a8e14215539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:26.405622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fdf2fa4-731f-4cdc-9c97-7a8e14215539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:26.406042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fdf2fa4-731f-4cdc-9c97-7a8e14215539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:26.436798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7fdf2fa4-731f-4cdc-9c97-7a8e14215539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047045 Aug 31 00:43:26.437344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 776/1626] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:27.288888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4d1a1ff6-5308-4df9-a214-6d197d31e87a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:27.291297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4d1a1ff6-5308-4df9-a214-6d197d31e87a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:27.297724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d1a1ff6-5308-4df9-a214-6d197d31e87a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:27.298195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d1a1ff6-5308-4df9-a214-6d197d31e87a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:27.298618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d1a1ff6-5308-4df9-a214-6d197d31e87a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:27.299322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d1a1ff6-5308-4df9-a214-6d197d31e87a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:27.299771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d1a1ff6-5308-4df9-a214-6d197d31e87a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:27.300188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d1a1ff6-5308-4df9-a214-6d197d31e87a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:27.330246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4d1a1ff6-5308-4df9-a214-6d197d31e87a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045453 Aug 31 00:43:27.330793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 851/1627] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:27 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:27.450750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4666afa7-ffc3-4ff8-bb0c-54f3241c2823 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:27.452888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4666afa7-ffc3-4ff8-bb0c-54f3241c2823 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:27.459277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4666afa7-ffc3-4ff8-bb0c-54f3241c2823 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:27.459745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4666afa7-ffc3-4ff8-bb0c-54f3241c2823 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:27.460166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4666afa7-ffc3-4ff8-bb0c-54f3241c2823 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:27.460838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4666afa7-ffc3-4ff8-bb0c-54f3241c2823 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:27.461444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4666afa7-ffc3-4ff8-bb0c-54f3241c2823 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:27.461855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4666afa7-ffc3-4ff8-bb0c-54f3241c2823 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:27.490690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4666afa7-ffc3-4ff8-bb0c-54f3241c2823 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043858 Aug 31 00:43:27.491271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 777/1628] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:28.341866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-43c33018-e89c-40cc-a15f-72196b1ca206 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:28.344074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-43c33018-e89c-40cc-a15f-72196b1ca206 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:28.351002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c33018-e89c-40cc-a15f-72196b1ca206 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:28.351543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c33018-e89c-40cc-a15f-72196b1ca206 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:28.352518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c33018-e89c-40cc-a15f-72196b1ca206 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:28.353644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c33018-e89c-40cc-a15f-72196b1ca206 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:28.354100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c33018-e89c-40cc-a15f-72196b1ca206 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:28.354526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-43c33018-e89c-40cc-a15f-72196b1ca206 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:28.380883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:28.386879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-43c33018-e89c-40cc-a15f-72196b1ca206 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048990 Aug 31 00:43:28.387465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 852/1629] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:28.503700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-803f0599-7daa-4016-b4ea-8a7081cbd248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:28.505836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-803f0599-7daa-4016-b4ea-8a7081cbd248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:28.508636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=58 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:28.513902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-803f0599-7daa-4016-b4ea-8a7081cbd248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:28.514456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-803f0599-7daa-4016-b4ea-8a7081cbd248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:28.514902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-803f0599-7daa-4016-b4ea-8a7081cbd248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:28.515616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-803f0599-7daa-4016-b4ea-8a7081cbd248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:28.516070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-803f0599-7daa-4016-b4ea-8a7081cbd248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:28.516490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-803f0599-7daa-4016-b4ea-8a7081cbd248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:28.546378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-803f0599-7daa-4016-b4ea-8a7081cbd248 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046665 Aug 31 00:43:28.546931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 778/1630] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:29.399344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3a2e2ce4-ce22-4269-a6f6-a1c1f0455b41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:29.402193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3a2e2ce4-ce22-4269-a6f6-a1c1f0455b41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:29.409198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a2e2ce4-ce22-4269-a6f6-a1c1f0455b41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:29.409677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a2e2ce4-ce22-4269-a6f6-a1c1f0455b41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:29.410107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a2e2ce4-ce22-4269-a6f6-a1c1f0455b41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:29.410800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a2e2ce4-ce22-4269-a6f6-a1c1f0455b41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:29.411279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a2e2ce4-ce22-4269-a6f6-a1c1f0455b41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:29.411699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a2e2ce4-ce22-4269-a6f6-a1c1f0455b41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:29.444992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3a2e2ce4-ce22-4269-a6f6-a1c1f0455b41 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049682 Aug 31 00:43:29.446208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 853/1631] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:29.558495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7fa30083-a583-4ad7-892d-2b2629650f56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:29.560675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7fa30083-a583-4ad7-892d-2b2629650f56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:29.567157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fa30083-a583-4ad7-892d-2b2629650f56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:29.567643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fa30083-a583-4ad7-892d-2b2629650f56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:29.568077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fa30083-a583-4ad7-892d-2b2629650f56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:29.568765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fa30083-a583-4ad7-892d-2b2629650f56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:29.569215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fa30083-a583-4ad7-892d-2b2629650f56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:29.569636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7fa30083-a583-4ad7-892d-2b2629650f56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:29.599783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7fa30083-a583-4ad7-892d-2b2629650f56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045861 Aug 31 00:43:29.600337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 779/1632] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:30.459426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e818df34-f2a6-4642-b7da-f0315f10b1f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:30.461955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e818df34-f2a6-4642-b7da-f0315f10b1f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:30.468407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e818df34-f2a6-4642-b7da-f0315f10b1f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:30.468891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e818df34-f2a6-4642-b7da-f0315f10b1f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:30.469353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e818df34-f2a6-4642-b7da-f0315f10b1f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:30.470059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e818df34-f2a6-4642-b7da-f0315f10b1f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:30.470581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e818df34-f2a6-4642-b7da-f0315f10b1f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:30.471113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e818df34-f2a6-4642-b7da-f0315f10b1f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:30.502878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e818df34-f2a6-4642-b7da-f0315f10b1f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047599 Aug 31 00:43:30.503461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 854/1633] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:30.611832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5cce574a-d251-41eb-9523-f871bc031475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:30.613940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5cce574a-d251-41eb-9523-f871bc031475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:30.620974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cce574a-d251-41eb-9523-f871bc031475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:30.621444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cce574a-d251-41eb-9523-f871bc031475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:30.621870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cce574a-d251-41eb-9523-f871bc031475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:30.622547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cce574a-d251-41eb-9523-f871bc031475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:30.622987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cce574a-d251-41eb-9523-f871bc031475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:30.623430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cce574a-d251-41eb-9523-f871bc031475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:30.651546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5cce574a-d251-41eb-9523-f871bc031475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043673 Aug 31 00:43:30.652082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 780/1634] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:31.515772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ed3cbbd-5feb-45a7-a260-875cb2020e36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:31.517840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ed3cbbd-5feb-45a7-a260-875cb2020e36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:31.520268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=58 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:31.526096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ed3cbbd-5feb-45a7-a260-875cb2020e36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:31.526574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ed3cbbd-5feb-45a7-a260-875cb2020e36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:31.527010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ed3cbbd-5feb-45a7-a260-875cb2020e36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:31.527733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ed3cbbd-5feb-45a7-a260-875cb2020e36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:31.528187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ed3cbbd-5feb-45a7-a260-875cb2020e36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:31.528610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ed3cbbd-5feb-45a7-a260-875cb2020e36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:31.557985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ed3cbbd-5feb-45a7-a260-875cb2020e36 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Aug 31 00:43:31.558567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 855/1635] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:31.663931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8263f320-5d2d-49bf-8512-13ade8d16d36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:31.666163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8263f320-5d2d-49bf-8512-13ade8d16d36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:31.672590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8263f320-5d2d-49bf-8512-13ade8d16d36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:31.673063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8263f320-5d2d-49bf-8512-13ade8d16d36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:31.673490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8263f320-5d2d-49bf-8512-13ade8d16d36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:31.674171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8263f320-5d2d-49bf-8512-13ade8d16d36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:31.674615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8263f320-5d2d-49bf-8512-13ade8d16d36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:31.675043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8263f320-5d2d-49bf-8512-13ade8d16d36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:31.705727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8263f320-5d2d-49bf-8512-13ade8d16d36 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045771 Aug 31 00:43:31.706270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 781/1636] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:32.569544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-10110a0d-7376-4d66-80d4-30b52336c08c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:32.572348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-10110a0d-7376-4d66-80d4-30b52336c08c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:32.578914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10110a0d-7376-4d66-80d4-30b52336c08c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:32.579415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10110a0d-7376-4d66-80d4-30b52336c08c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:32.579840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10110a0d-7376-4d66-80d4-30b52336c08c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:32.580514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10110a0d-7376-4d66-80d4-30b52336c08c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:32.580958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10110a0d-7376-4d66-80d4-30b52336c08c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:32.581374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10110a0d-7376-4d66-80d4-30b52336c08c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:32.610181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-10110a0d-7376-4d66-80d4-30b52336c08c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Aug 31 00:43:32.610721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 856/1637] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:32.717910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-51861305-3126-495f-b581-fe45a4eec2df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:32.720052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-51861305-3126-495f-b581-fe45a4eec2df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:32.726346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51861305-3126-495f-b581-fe45a4eec2df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:32.726817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51861305-3126-495f-b581-fe45a4eec2df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:32.727276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51861305-3126-495f-b581-fe45a4eec2df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:32.728474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51861305-3126-495f-b581-fe45a4eec2df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:32.728914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51861305-3126-495f-b581-fe45a4eec2df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:32.729326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51861305-3126-495f-b581-fe45a4eec2df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:32.733193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:32.760321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-51861305-3126-495f-b581-fe45a4eec2df tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046289 Aug 31 00:43:32.760895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 782/1638] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:33.622582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-41c70ff7-fc20-4967-b25c-1ed520664f14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:33.624717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-41c70ff7-fc20-4967-b25c-1ed520664f14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:33.631182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41c70ff7-fc20-4967-b25c-1ed520664f14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:33.631656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41c70ff7-fc20-4967-b25c-1ed520664f14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:33.632107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41c70ff7-fc20-4967-b25c-1ed520664f14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:33.632765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41c70ff7-fc20-4967-b25c-1ed520664f14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:33.633214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41c70ff7-fc20-4967-b25c-1ed520664f14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:33.633631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41c70ff7-fc20-4967-b25c-1ed520664f14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:33.663054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-41c70ff7-fc20-4967-b25c-1ed520664f14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Aug 31 00:43:33.663614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 857/1639] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:33 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:33.772935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-66e67d5a-f295-47c8-a9d7-65868ee2fe17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:33.775707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-66e67d5a-f295-47c8-a9d7-65868ee2fe17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:33.782442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66e67d5a-f295-47c8-a9d7-65868ee2fe17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:33.782917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66e67d5a-f295-47c8-a9d7-65868ee2fe17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:33.783385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66e67d5a-f295-47c8-a9d7-65868ee2fe17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:33.784075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66e67d5a-f295-47c8-a9d7-65868ee2fe17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:33.784523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66e67d5a-f295-47c8-a9d7-65868ee2fe17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:33.784948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66e67d5a-f295-47c8-a9d7-65868ee2fe17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:33.816018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-66e67d5a-f295-47c8-a9d7-65868ee2fe17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047063 Aug 31 00:43:33.816593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 783/1640] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:33 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:43:34.675483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-59c97cca-87c4-4202-872e-11a1683aefdd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:34.677606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-59c97cca-87c4-4202-872e-11a1683aefdd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:34.684514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-59c97cca-87c4-4202-872e-11a1683aefdd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:34.685031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-59c97cca-87c4-4202-872e-11a1683aefdd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:34.685448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-59c97cca-87c4-4202-872e-11a1683aefdd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:34.686130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-59c97cca-87c4-4202-872e-11a1683aefdd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:34.686577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-59c97cca-87c4-4202-872e-11a1683aefdd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:34.686990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-59c97cca-87c4-4202-872e-11a1683aefdd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:34.716675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-59c97cca-87c4-4202-872e-11a1683aefdd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045246 Aug 31 00:43:34.717236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 858/1641] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:34 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:34.829101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d5cf1b8c-7af0-48f4-91de-a129817899c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:34.831284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d5cf1b8c-7af0-48f4-91de-a129817899c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:34.837657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5cf1b8c-7af0-48f4-91de-a129817899c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:34.838131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5cf1b8c-7af0-48f4-91de-a129817899c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:34.838558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5cf1b8c-7af0-48f4-91de-a129817899c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:34.839267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5cf1b8c-7af0-48f4-91de-a129817899c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:34.839715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5cf1b8c-7af0-48f4-91de-a129817899c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:34.840133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5cf1b8c-7af0-48f4-91de-a129817899c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:34.870227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d5cf1b8c-7af0-48f4-91de-a129817899c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045136 Aug 31 00:43:34.870777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 784/1642] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:35.729015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1b12d0cf-b861-4830-9023-80cafcef44ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:35.731156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1b12d0cf-b861-4830-9023-80cafcef44ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:35.737824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b12d0cf-b861-4830-9023-80cafcef44ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:35.738299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b12d0cf-b861-4830-9023-80cafcef44ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:35.738730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b12d0cf-b861-4830-9023-80cafcef44ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:35.739501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b12d0cf-b861-4830-9023-80cafcef44ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:35.739953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b12d0cf-b861-4830-9023-80cafcef44ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:35.740374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b12d0cf-b861-4830-9023-80cafcef44ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:35.771636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1b12d0cf-b861-4830-9023-80cafcef44ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046615 Aug 31 00:43:35.772187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 859/1643] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:35.882323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ccd723a1-d856-40f7-88dc-ea18451dd03e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:35.885537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ccd723a1-d856-40f7-88dc-ea18451dd03e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:35.892050 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccd723a1-d856-40f7-88dc-ea18451dd03e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:35.892587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccd723a1-d856-40f7-88dc-ea18451dd03e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:35.893020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccd723a1-d856-40f7-88dc-ea18451dd03e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:35.893708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccd723a1-d856-40f7-88dc-ea18451dd03e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:35.894185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccd723a1-d856-40f7-88dc-ea18451dd03e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:35.894628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccd723a1-d856-40f7-88dc-ea18451dd03e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:35.924125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ccd723a1-d856-40f7-88dc-ea18451dd03e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045784 Aug 31 00:43:35.924669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 785/1644] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:36.784923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a743e9be-e325-44e8-948d-ed898d45fd1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:36.787144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a743e9be-e325-44e8-948d-ed898d45fd1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:36.795965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a743e9be-e325-44e8-948d-ed898d45fd1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:36.796448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a743e9be-e325-44e8-948d-ed898d45fd1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:36.796882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a743e9be-e325-44e8-948d-ed898d45fd1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:36.797575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a743e9be-e325-44e8-948d-ed898d45fd1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:36.798027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a743e9be-e325-44e8-948d-ed898d45fd1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:36.798515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a743e9be-e325-44e8-948d-ed898d45fd1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:36.831731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a743e9be-e325-44e8-948d-ed898d45fd1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050866 Aug 31 00:43:36.832304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 860/1645] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:36.936640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-638d94bf-e3f3-4a36-ac41-e84016036ae0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:36.938768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-638d94bf-e3f3-4a36-ac41-e84016036ae0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:36.945104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-638d94bf-e3f3-4a36-ac41-e84016036ae0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:36.945573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-638d94bf-e3f3-4a36-ac41-e84016036ae0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:36.945999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-638d94bf-e3f3-4a36-ac41-e84016036ae0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:36.947243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-638d94bf-e3f3-4a36-ac41-e84016036ae0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:36.947697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-638d94bf-e3f3-4a36-ac41-e84016036ae0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:36.948103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-638d94bf-e3f3-4a36-ac41-e84016036ae0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:36.978247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-638d94bf-e3f3-4a36-ac41-e84016036ae0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045556 Aug 31 00:43:36.978844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 786/1646] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:37.843830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5f9ce0de-4e41-4df9-adca-0fab86a7d9cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:37.845941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5f9ce0de-4e41-4df9-adca-0fab86a7d9cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:37.852474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f9ce0de-4e41-4df9-adca-0fab86a7d9cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:37.853455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f9ce0de-4e41-4df9-adca-0fab86a7d9cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:37.853880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f9ce0de-4e41-4df9-adca-0fab86a7d9cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:37.854556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f9ce0de-4e41-4df9-adca-0fab86a7d9cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:37.854997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f9ce0de-4e41-4df9-adca-0fab86a7d9cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:37.855434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f9ce0de-4e41-4df9-adca-0fab86a7d9cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:37.885345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5f9ce0de-4e41-4df9-adca-0fab86a7d9cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 Aug 31 00:43:37.886079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 861/1647] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:37 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:37.990893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9c9b2997-e2e7-4586-8af9-474792c1c878 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:37.993069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9c9b2997-e2e7-4586-8af9-474792c1c878 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:38.000464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c9b2997-e2e7-4586-8af9-474792c1c878 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:38.000946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c9b2997-e2e7-4586-8af9-474792c1c878 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:38.001389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c9b2997-e2e7-4586-8af9-474792c1c878 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:38.002106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c9b2997-e2e7-4586-8af9-474792c1c878 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:38.002558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c9b2997-e2e7-4586-8af9-474792c1c878 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:38.003006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c9b2997-e2e7-4586-8af9-474792c1c878 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:38.032722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9c9b2997-e2e7-4586-8af9-474792c1c878 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045875 Aug 31 00:43:38.033277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 787/1648] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:38.898086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-35ebf83e-c898-4a6f-97db-578862702cb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:38.900413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-35ebf83e-c898-4a6f-97db-578862702cb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:38.906744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35ebf83e-c898-4a6f-97db-578862702cb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:38.907262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35ebf83e-c898-4a6f-97db-578862702cb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:38.907699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35ebf83e-c898-4a6f-97db-578862702cb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:38.908382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35ebf83e-c898-4a6f-97db-578862702cb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:38.908829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35ebf83e-c898-4a6f-97db-578862702cb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:38.909247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35ebf83e-c898-4a6f-97db-578862702cb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:38.938936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-35ebf83e-c898-4a6f-97db-578862702cb6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Aug 31 00:43:38.939522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 862/1649] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:39.045268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bf0f3882-4c29-4950-b4d5-42bd3afebd4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:39.047507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bf0f3882-4c29-4950-b4d5-42bd3afebd4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:39.053487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf0f3882-4c29-4950-b4d5-42bd3afebd4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:39.053968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf0f3882-4c29-4950-b4d5-42bd3afebd4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:39.054401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf0f3882-4c29-4950-b4d5-42bd3afebd4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:39.055117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf0f3882-4c29-4950-b4d5-42bd3afebd4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:39.055570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf0f3882-4c29-4950-b4d5-42bd3afebd4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:39.055993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf0f3882-4c29-4950-b4d5-42bd3afebd4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:39.086214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bf0f3882-4c29-4950-b4d5-42bd3afebd4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045037 Aug 31 00:43:39.086766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 788/1650] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:39.952037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9a4c460a-ca67-4c2f-a1d1-056fdb91e61e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:39.954104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9a4c460a-ca67-4c2f-a1d1-056fdb91e61e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:39.960727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a4c460a-ca67-4c2f-a1d1-056fdb91e61e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:39.961206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a4c460a-ca67-4c2f-a1d1-056fdb91e61e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:39.961636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a4c460a-ca67-4c2f-a1d1-056fdb91e61e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:39.962324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a4c460a-ca67-4c2f-a1d1-056fdb91e61e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:39.963509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a4c460a-ca67-4c2f-a1d1-056fdb91e61e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:39.963932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a4c460a-ca67-4c2f-a1d1-056fdb91e61e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:39.993759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9a4c460a-ca67-4c2f-a1d1-056fdb91e61e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045743 Aug 31 00:43:39.994394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 863/1651] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:39 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:40.099205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-82568e6e-c05a-49bc-9ef9-3f6562be3384 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:40.101317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-82568e6e-c05a-49bc-9ef9-3f6562be3384 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:40.108379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82568e6e-c05a-49bc-9ef9-3f6562be3384 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:40.108848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82568e6e-c05a-49bc-9ef9-3f6562be3384 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:40.109272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82568e6e-c05a-49bc-9ef9-3f6562be3384 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:40.109948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82568e6e-c05a-49bc-9ef9-3f6562be3384 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:40.110386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82568e6e-c05a-49bc-9ef9-3f6562be3384 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:40.110798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82568e6e-c05a-49bc-9ef9-3f6562be3384 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:40.139995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-82568e6e-c05a-49bc-9ef9-3f6562be3384 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044870 Aug 31 00:43:40.140535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 789/1652] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:41.005870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4c2a5c5f-07d1-42ce-9230-acc5647e82a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:41.008034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4c2a5c5f-07d1-42ce-9230-acc5647e82a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:41.014976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c2a5c5f-07d1-42ce-9230-acc5647e82a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:41.015477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c2a5c5f-07d1-42ce-9230-acc5647e82a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:41.015902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c2a5c5f-07d1-42ce-9230-acc5647e82a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:41.016578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c2a5c5f-07d1-42ce-9230-acc5647e82a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:41.017022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c2a5c5f-07d1-42ce-9230-acc5647e82a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:41.017438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c2a5c5f-07d1-42ce-9230-acc5647e82a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:41.046059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4c2a5c5f-07d1-42ce-9230-acc5647e82a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044103 Aug 31 00:43:41.046606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 864/1653] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:41 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:41.152448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4950d728-c5dd-41ff-bf51-8dce47a3b684 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:41.154582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4950d728-c5dd-41ff-bf51-8dce47a3b684 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:41.160978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4950d728-c5dd-41ff-bf51-8dce47a3b684 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:41.161464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4950d728-c5dd-41ff-bf51-8dce47a3b684 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:41.161898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4950d728-c5dd-41ff-bf51-8dce47a3b684 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:41.162583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4950d728-c5dd-41ff-bf51-8dce47a3b684 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:41.163055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4950d728-c5dd-41ff-bf51-8dce47a3b684 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:41.163475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4950d728-c5dd-41ff-bf51-8dce47a3b684 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:41.192889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4950d728-c5dd-41ff-bf51-8dce47a3b684 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044557 Aug 31 00:43:41.193434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 790/1654] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:42.058425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1d7272ff-82dd-4fde-b304-d9888b3e43e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:42.060575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1d7272ff-82dd-4fde-b304-d9888b3e43e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:42.067146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d7272ff-82dd-4fde-b304-d9888b3e43e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:42.067760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d7272ff-82dd-4fde-b304-d9888b3e43e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:42.068193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d7272ff-82dd-4fde-b304-d9888b3e43e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:42.068883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d7272ff-82dd-4fde-b304-d9888b3e43e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:42.069332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d7272ff-82dd-4fde-b304-d9888b3e43e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:42.069754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d7272ff-82dd-4fde-b304-d9888b3e43e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:42.100880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1d7272ff-82dd-4fde-b304-d9888b3e43e0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046886 Aug 31 00:43:42.101444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 865/1655] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:42 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:42.206262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8cf32f9b-aa07-4a44-bd86-73c3e6b0f09e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:42.208395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8cf32f9b-aa07-4a44-bd86-73c3e6b0f09e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:42.215494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cf32f9b-aa07-4a44-bd86-73c3e6b0f09e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:42.215965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cf32f9b-aa07-4a44-bd86-73c3e6b0f09e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:42.216386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cf32f9b-aa07-4a44-bd86-73c3e6b0f09e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:42.217061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cf32f9b-aa07-4a44-bd86-73c3e6b0f09e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:42.217503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cf32f9b-aa07-4a44-bd86-73c3e6b0f09e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:42.217917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cf32f9b-aa07-4a44-bd86-73c3e6b0f09e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:42.247444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8cf32f9b-aa07-4a44-bd86-73c3e6b0f09e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045030 Aug 31 00:43:42.247937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 791/1656] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:43.113677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2be3d2aa-6a67-4b0a-b5f7-8b1c5dfa8387 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:43.115709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2be3d2aa-6a67-4b0a-b5f7-8b1c5dfa8387 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:43.122722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2be3d2aa-6a67-4b0a-b5f7-8b1c5dfa8387 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:43.123254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2be3d2aa-6a67-4b0a-b5f7-8b1c5dfa8387 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:43.123684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2be3d2aa-6a67-4b0a-b5f7-8b1c5dfa8387 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:43.124366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2be3d2aa-6a67-4b0a-b5f7-8b1c5dfa8387 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:43.124815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2be3d2aa-6a67-4b0a-b5f7-8b1c5dfa8387 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:43.125235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2be3d2aa-6a67-4b0a-b5f7-8b1c5dfa8387 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:43.154232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2be3d2aa-6a67-4b0a-b5f7-8b1c5dfa8387 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Aug 31 00:43:43.154784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 866/1657] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:43.260572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9bd0b519-1bc2-4a9d-b589-4d7d9490109c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:43.262661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9bd0b519-1bc2-4a9d-b589-4d7d9490109c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:43.269041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9bd0b519-1bc2-4a9d-b589-4d7d9490109c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:43.269517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9bd0b519-1bc2-4a9d-b589-4d7d9490109c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:43.269946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9bd0b519-1bc2-4a9d-b589-4d7d9490109c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:43.270632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9bd0b519-1bc2-4a9d-b589-4d7d9490109c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:43.271098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9bd0b519-1bc2-4a9d-b589-4d7d9490109c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:43.271524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9bd0b519-1bc2-4a9d-b589-4d7d9490109c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:43.301013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9bd0b519-1bc2-4a9d-b589-4d7d9490109c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045155 Aug 31 00:43:43.301563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 792/1658] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:44.166758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-595e72bb-12a1-4233-979b-dd073f33297c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:44.170300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-595e72bb-12a1-4233-979b-dd073f33297c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:44.177486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-595e72bb-12a1-4233-979b-dd073f33297c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:44.177970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-595e72bb-12a1-4233-979b-dd073f33297c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:44.178404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-595e72bb-12a1-4233-979b-dd073f33297c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:44.179194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-595e72bb-12a1-4233-979b-dd073f33297c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:44.179645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-595e72bb-12a1-4233-979b-dd073f33297c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:44.180066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-595e72bb-12a1-4233-979b-dd073f33297c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:44.210499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-595e72bb-12a1-4233-979b-dd073f33297c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048600 Aug 31 00:43:44.211061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 867/1659] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:44.313536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ff943a91-af05-47b3-9591-e7397c9e81a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:44.315897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ff943a91-af05-47b3-9591-e7397c9e81a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:44.322853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff943a91-af05-47b3-9591-e7397c9e81a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:44.323440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff943a91-af05-47b3-9591-e7397c9e81a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:44.323872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff943a91-af05-47b3-9591-e7397c9e81a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:44.324584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff943a91-af05-47b3-9591-e7397c9e81a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:44.325032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff943a91-af05-47b3-9591-e7397c9e81a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:44.325454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff943a91-af05-47b3-9591-e7397c9e81a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:44.354111 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ff943a91-af05-47b3-9591-e7397c9e81a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044511 Aug 31 00:43:44.354659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 793/1660] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:45.222365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-87920867-49c1-4c40-87b5-bcd1d9fe56b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:45.224502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-87920867-49c1-4c40-87b5-bcd1d9fe56b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:45.231568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87920867-49c1-4c40-87b5-bcd1d9fe56b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:45.232316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87920867-49c1-4c40-87b5-bcd1d9fe56b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:45.232753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87920867-49c1-4c40-87b5-bcd1d9fe56b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:45.233444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87920867-49c1-4c40-87b5-bcd1d9fe56b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:45.233896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87920867-49c1-4c40-87b5-bcd1d9fe56b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:45.234317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87920867-49c1-4c40-87b5-bcd1d9fe56b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:45.264475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-87920867-49c1-4c40-87b5-bcd1d9fe56b8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046152 Aug 31 00:43:45.265033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 868/1661] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:45.365995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cc1e3815-df18-4a40-ae38-e1d17c947582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:45.368173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cc1e3815-df18-4a40-ae38-e1d17c947582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:45.374567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc1e3815-df18-4a40-ae38-e1d17c947582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:45.375068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc1e3815-df18-4a40-ae38-e1d17c947582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:45.375498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc1e3815-df18-4a40-ae38-e1d17c947582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:45.376176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc1e3815-df18-4a40-ae38-e1d17c947582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:45.376619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc1e3815-df18-4a40-ae38-e1d17c947582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:45.377110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc1e3815-df18-4a40-ae38-e1d17c947582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:45.406903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cc1e3815-df18-4a40-ae38-e1d17c947582 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044927 Aug 31 00:43:45.407484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 794/1662] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:46.277392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-89c3e7d4-e434-408c-9478-a6a678991132 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:46.279629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-89c3e7d4-e434-408c-9478-a6a678991132 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:46.285905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89c3e7d4-e434-408c-9478-a6a678991132 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:46.286370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89c3e7d4-e434-408c-9478-a6a678991132 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:46.286800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89c3e7d4-e434-408c-9478-a6a678991132 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:46.287546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89c3e7d4-e434-408c-9478-a6a678991132 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:46.287993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89c3e7d4-e434-408c-9478-a6a678991132 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:46.288417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89c3e7d4-e434-408c-9478-a6a678991132 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:46.305574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:46.319343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-89c3e7d4-e434-408c-9478-a6a678991132 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Aug 31 00:43:46.319929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 869/1663] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:46 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:46.420147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d6d1cdd-2f85-49d4-89f2-c50e668d8a73 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:46.422309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0d6d1cdd-2f85-49d4-89f2-c50e668d8a73 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:46.428670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d6d1cdd-2f85-49d4-89f2-c50e668d8a73 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:46.429148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d6d1cdd-2f85-49d4-89f2-c50e668d8a73 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:46.429575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d6d1cdd-2f85-49d4-89f2-c50e668d8a73 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:46.430260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d6d1cdd-2f85-49d4-89f2-c50e668d8a73 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:46.430703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d6d1cdd-2f85-49d4-89f2-c50e668d8a73 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:46.431162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d6d1cdd-2f85-49d4-89f2-c50e668d8a73 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:46.460445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0d6d1cdd-2f85-49d4-89f2-c50e668d8a73 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045051 Aug 31 00:43:46.460997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 795/1664] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:47.332123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-84a061fc-c1ac-4bcb-a90c-3b3d25eacfa5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:47.334178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-84a061fc-c1ac-4bcb-a90c-3b3d25eacfa5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:47.340726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84a061fc-c1ac-4bcb-a90c-3b3d25eacfa5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:47.341208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84a061fc-c1ac-4bcb-a90c-3b3d25eacfa5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:47.341652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84a061fc-c1ac-4bcb-a90c-3b3d25eacfa5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:47.342324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84a061fc-c1ac-4bcb-a90c-3b3d25eacfa5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:47.342773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84a061fc-c1ac-4bcb-a90c-3b3d25eacfa5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:47.343223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84a061fc-c1ac-4bcb-a90c-3b3d25eacfa5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:47.374827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-84a061fc-c1ac-4bcb-a90c-3b3d25eacfa5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046747 Aug 31 00:43:47.375425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 870/1665] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:47 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:47.473593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-68ec8c15-369b-4b59-b038-63d94e5c77bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:47.475904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-68ec8c15-369b-4b59-b038-63d94e5c77bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:47.483786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68ec8c15-369b-4b59-b038-63d94e5c77bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:47.484265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68ec8c15-369b-4b59-b038-63d94e5c77bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:47.484698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68ec8c15-369b-4b59-b038-63d94e5c77bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:47.485388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68ec8c15-369b-4b59-b038-63d94e5c77bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:47.485837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68ec8c15-369b-4b59-b038-63d94e5c77bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:47.486255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68ec8c15-369b-4b59-b038-63d94e5c77bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:47.518255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-68ec8c15-369b-4b59-b038-63d94e5c77bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048678 Aug 31 00:43:47.518827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 796/1666] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:48.387851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fd9d8ced-3f67-4369-a3ae-65a9d6ead58a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:48.390012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fd9d8ced-3f67-4369-a3ae-65a9d6ead58a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:48.396448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d8ced-3f67-4369-a3ae-65a9d6ead58a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:48.396857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d8ced-3f67-4369-a3ae-65a9d6ead58a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:48.397284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d8ced-3f67-4369-a3ae-65a9d6ead58a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:48.397958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d8ced-3f67-4369-a3ae-65a9d6ead58a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:48.398399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d8ced-3f67-4369-a3ae-65a9d6ead58a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:48.398810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fd9d8ced-3f67-4369-a3ae-65a9d6ead58a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:48.430363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fd9d8ced-3f67-4369-a3ae-65a9d6ead58a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047104 Aug 31 00:43:48.430932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 871/1667] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:48.532602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4dc9956c-11bc-4cb3-9aba-2e62cd866945 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:48.534751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4dc9956c-11bc-4cb3-9aba-2e62cd866945 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:48.541394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dc9956c-11bc-4cb3-9aba-2e62cd866945 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:48.541865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dc9956c-11bc-4cb3-9aba-2e62cd866945 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:48.542286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dc9956c-11bc-4cb3-9aba-2e62cd866945 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:48.542970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dc9956c-11bc-4cb3-9aba-2e62cd866945 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:48.543438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dc9956c-11bc-4cb3-9aba-2e62cd866945 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:48.543852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dc9956c-11bc-4cb3-9aba-2e62cd866945 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:48.575108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4dc9956c-11bc-4cb3-9aba-2e62cd866945 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046454 Aug 31 00:43:48.575666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 797/1668] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:49.442749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-937e5ed9-5d9c-4de7-9d6a-f29721719012 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:49.444922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-937e5ed9-5d9c-4de7-9d6a-f29721719012 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:49.451958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-937e5ed9-5d9c-4de7-9d6a-f29721719012 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:49.452377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-937e5ed9-5d9c-4de7-9d6a-f29721719012 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:49.452803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-937e5ed9-5d9c-4de7-9d6a-f29721719012 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:49.453477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-937e5ed9-5d9c-4de7-9d6a-f29721719012 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:49.453923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-937e5ed9-5d9c-4de7-9d6a-f29721719012 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:49.454337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-937e5ed9-5d9c-4de7-9d6a-f29721719012 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:49.487807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-937e5ed9-5d9c-4de7-9d6a-f29721719012 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048952 Aug 31 00:43:49.488362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 872/1669] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:49.587413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3c2777b-308d-4689-bf29-a44796232006 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:49.589829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3c2777b-308d-4689-bf29-a44796232006 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:49.596216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3c2777b-308d-4689-bf29-a44796232006 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:49.596694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3c2777b-308d-4689-bf29-a44796232006 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:49.597132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3c2777b-308d-4689-bf29-a44796232006 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:49.597817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3c2777b-308d-4689-bf29-a44796232006 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:49.598267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3c2777b-308d-4689-bf29-a44796232006 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:49.598692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3c2777b-308d-4689-bf29-a44796232006 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:49.625456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:49.630985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3c2777b-308d-4689-bf29-a44796232006 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047596 Aug 31 00:43:49.631564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 798/1670] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:50.500723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-33fc6559-17be-4619-80d7-d74b64c0ceb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:50.502751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-33fc6559-17be-4619-80d7-d74b64c0ceb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:50.508649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33fc6559-17be-4619-80d7-d74b64c0ceb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:50.509121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33fc6559-17be-4619-80d7-d74b64c0ceb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:50.510125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33fc6559-17be-4619-80d7-d74b64c0ceb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:50.510960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33fc6559-17be-4619-80d7-d74b64c0ceb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:50.511426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33fc6559-17be-4619-80d7-d74b64c0ceb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:50.511841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33fc6559-17be-4619-80d7-d74b64c0ceb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:50.540979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-33fc6559-17be-4619-80d7-d74b64c0ceb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Aug 31 00:43:50.541522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 873/1671] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:50.644152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1882acd5-34cf-42fa-b370-e9a25209ff2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:50.646281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1882acd5-34cf-42fa-b370-e9a25209ff2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:50.654256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1882acd5-34cf-42fa-b370-e9a25209ff2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:50.654742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1882acd5-34cf-42fa-b370-e9a25209ff2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:50.655215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1882acd5-34cf-42fa-b370-e9a25209ff2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:50.655909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1882acd5-34cf-42fa-b370-e9a25209ff2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:50.656390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1882acd5-34cf-42fa-b370-e9a25209ff2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:50.656817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1882acd5-34cf-42fa-b370-e9a25209ff2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:50.687131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1882acd5-34cf-42fa-b370-e9a25209ff2d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047227 Aug 31 00:43:50.687683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 799/1672] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:51.553314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-65abfd9b-3431-483e-ada2-c6cf0a1e1913 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:51.555359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-65abfd9b-3431-483e-ada2-c6cf0a1e1913 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:51.562307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65abfd9b-3431-483e-ada2-c6cf0a1e1913 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:51.562776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65abfd9b-3431-483e-ada2-c6cf0a1e1913 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:51.563241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65abfd9b-3431-483e-ada2-c6cf0a1e1913 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:51.563961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65abfd9b-3431-483e-ada2-c6cf0a1e1913 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:51.564406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65abfd9b-3431-483e-ada2-c6cf0a1e1913 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:51.564819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65abfd9b-3431-483e-ada2-c6cf0a1e1913 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:51.594242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-65abfd9b-3431-483e-ada2-c6cf0a1e1913 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Aug 31 00:43:51.594787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 874/1673] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:51.700395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b24847fb-ee33-4922-ba53-5c2da86692c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:51.702591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b24847fb-ee33-4922-ba53-5c2da86692c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:51.708954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b24847fb-ee33-4922-ba53-5c2da86692c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:51.709427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b24847fb-ee33-4922-ba53-5c2da86692c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:51.709857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b24847fb-ee33-4922-ba53-5c2da86692c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:51.710539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b24847fb-ee33-4922-ba53-5c2da86692c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:51.710986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b24847fb-ee33-4922-ba53-5c2da86692c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:51.711431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b24847fb-ee33-4922-ba53-5c2da86692c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:51.740613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b24847fb-ee33-4922-ba53-5c2da86692c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045177 Aug 31 00:43:51.741162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 800/1674] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:52.606596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-24257419-864a-4f44-98c7-ab7ecc59b748 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:52.608980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-24257419-864a-4f44-98c7-ab7ecc59b748 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:52.615488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24257419-864a-4f44-98c7-ab7ecc59b748 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:52.615966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24257419-864a-4f44-98c7-ab7ecc59b748 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:52.616398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24257419-864a-4f44-98c7-ab7ecc59b748 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:52.617079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24257419-864a-4f44-98c7-ab7ecc59b748 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:52.617528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24257419-864a-4f44-98c7-ab7ecc59b748 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:52.617947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24257419-864a-4f44-98c7-ab7ecc59b748 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:52.647424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-24257419-864a-4f44-98c7-ab7ecc59b748 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Aug 31 00:43:52.647978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 875/1675] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:52.753744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a763fd68-56eb-4c9e-95e5-710a62b8c816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:52.755948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a763fd68-56eb-4c9e-95e5-710a62b8c816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:52.762995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a763fd68-56eb-4c9e-95e5-710a62b8c816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:52.763509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a763fd68-56eb-4c9e-95e5-710a62b8c816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:52.763939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a763fd68-56eb-4c9e-95e5-710a62b8c816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:52.764621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a763fd68-56eb-4c9e-95e5-710a62b8c816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:52.765065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a763fd68-56eb-4c9e-95e5-710a62b8c816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:52.765481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a763fd68-56eb-4c9e-95e5-710a62b8c816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:52.795854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a763fd68-56eb-4c9e-95e5-710a62b8c816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046180 Aug 31 00:43:52.796419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 801/1676] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:53.660857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c374945d-a192-4556-8fd7-1a3eda97098e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:53.663013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c374945d-a192-4556-8fd7-1a3eda97098e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:53.670023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c374945d-a192-4556-8fd7-1a3eda97098e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:53.670505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c374945d-a192-4556-8fd7-1a3eda97098e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:53.670941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c374945d-a192-4556-8fd7-1a3eda97098e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:53.671675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c374945d-a192-4556-8fd7-1a3eda97098e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:53.672129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c374945d-a192-4556-8fd7-1a3eda97098e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:53.672553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c374945d-a192-4556-8fd7-1a3eda97098e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:53.702735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c374945d-a192-4556-8fd7-1a3eda97098e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045983 Aug 31 00:43:53.703314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 876/1677] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:53 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:53.808965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e4912a0-dd4a-47e6-8699-ddcc111ac156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:53.811147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7e4912a0-dd4a-47e6-8699-ddcc111ac156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:53.817658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4912a0-dd4a-47e6-8699-ddcc111ac156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:53.818134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4912a0-dd4a-47e6-8699-ddcc111ac156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:53.818561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4912a0-dd4a-47e6-8699-ddcc111ac156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:53.819272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4912a0-dd4a-47e6-8699-ddcc111ac156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:53.819716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4912a0-dd4a-47e6-8699-ddcc111ac156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:53.820126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e4912a0-dd4a-47e6-8699-ddcc111ac156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:53.850860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7e4912a0-dd4a-47e6-8699-ddcc111ac156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046210 Aug 31 00:43:53.851644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 802/1678] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:53 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:54.715122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-22d16321-b6a7-4b2b-af2f-d79d3987447b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:54.717359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-22d16321-b6a7-4b2b-af2f-d79d3987447b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:54.723734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22d16321-b6a7-4b2b-af2f-d79d3987447b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:54.724238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22d16321-b6a7-4b2b-af2f-d79d3987447b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:54.724664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22d16321-b6a7-4b2b-af2f-d79d3987447b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:54.725338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22d16321-b6a7-4b2b-af2f-d79d3987447b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:54.725854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22d16321-b6a7-4b2b-af2f-d79d3987447b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:54.726274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22d16321-b6a7-4b2b-af2f-d79d3987447b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:54.756532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-22d16321-b6a7-4b2b-af2f-d79d3987447b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046044 Aug 31 00:43:54.757080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 877/1679] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:54 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:54.863613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-18302453-0d1a-4c4d-a2d3-2301954d152a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:54.865772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-18302453-0d1a-4c4d-a2d3-2301954d152a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:54.872171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18302453-0d1a-4c4d-a2d3-2301954d152a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:54.872653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18302453-0d1a-4c4d-a2d3-2301954d152a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:54.873073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18302453-0d1a-4c4d-a2d3-2301954d152a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:54.873748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18302453-0d1a-4c4d-a2d3-2301954d152a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:54.874199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18302453-0d1a-4c4d-a2d3-2301954d152a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:54.874614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18302453-0d1a-4c4d-a2d3-2301954d152a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:54.905032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-18302453-0d1a-4c4d-a2d3-2301954d152a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045425 Aug 31 00:43:54.905579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 803/1680] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:55.769233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-23da6d0b-7bb3-4440-8ce1-3a695e1f5575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:55.771547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-23da6d0b-7bb3-4440-8ce1-3a695e1f5575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:55.778287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23da6d0b-7bb3-4440-8ce1-3a695e1f5575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:55.778772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23da6d0b-7bb3-4440-8ce1-3a695e1f5575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:55.779321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23da6d0b-7bb3-4440-8ce1-3a695e1f5575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:55.780010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23da6d0b-7bb3-4440-8ce1-3a695e1f5575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:55.780520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23da6d0b-7bb3-4440-8ce1-3a695e1f5575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:55.780955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-23da6d0b-7bb3-4440-8ce1-3a695e1f5575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:55.812275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-23da6d0b-7bb3-4440-8ce1-3a695e1f5575 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047065 Aug 31 00:43:55.812839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 878/1681] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:55 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:55.918338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2d8948e3-3cf6-464e-adaf-7cc9e6698fd7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:55.920476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2d8948e3-3cf6-464e-adaf-7cc9e6698fd7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:55.927000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d8948e3-3cf6-464e-adaf-7cc9e6698fd7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:55.927504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d8948e3-3cf6-464e-adaf-7cc9e6698fd7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:55.927930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d8948e3-3cf6-464e-adaf-7cc9e6698fd7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:55.928600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d8948e3-3cf6-464e-adaf-7cc9e6698fd7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:55.929040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d8948e3-3cf6-464e-adaf-7cc9e6698fd7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:55.929451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d8948e3-3cf6-464e-adaf-7cc9e6698fd7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:55.958478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2d8948e3-3cf6-464e-adaf-7cc9e6698fd7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044986 Aug 31 00:43:55.959011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 804/1682] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:56.825660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e7895974-30e2-41d0-8e07-73bb6eb2614d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:56.827742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e7895974-30e2-41d0-8e07-73bb6eb2614d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:56.834086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7895974-30e2-41d0-8e07-73bb6eb2614d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:56.834565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7895974-30e2-41d0-8e07-73bb6eb2614d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:56.834999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7895974-30e2-41d0-8e07-73bb6eb2614d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:56.835713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7895974-30e2-41d0-8e07-73bb6eb2614d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:56.836167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7895974-30e2-41d0-8e07-73bb6eb2614d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:56.836591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7895974-30e2-41d0-8e07-73bb6eb2614d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:56.867320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e7895974-30e2-41d0-8e07-73bb6eb2614d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046767 Aug 31 00:43:56.867870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 879/1683] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:56.977328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-959d8449-2f43-42b6-991c-d05717b03a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:56.979586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-959d8449-2f43-42b6-991c-d05717b03a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:56.986344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-959d8449-2f43-42b6-991c-d05717b03a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:56.986823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-959d8449-2f43-42b6-991c-d05717b03a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:56.987281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-959d8449-2f43-42b6-991c-d05717b03a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:56.987969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-959d8449-2f43-42b6-991c-d05717b03a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:56.988413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-959d8449-2f43-42b6-991c-d05717b03a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:56.988861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-959d8449-2f43-42b6-991c-d05717b03a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:57.019610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-959d8449-2f43-42b6-991c-d05717b03a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052441 Aug 31 00:43:57.020175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 805/1684] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:57.879485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aa00e452-d7be-4ee6-8a9c-94713ebad12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:57.881601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aa00e452-d7be-4ee6-8a9c-94713ebad12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:57.888635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa00e452-d7be-4ee6-8a9c-94713ebad12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:57.889110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa00e452-d7be-4ee6-8a9c-94713ebad12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:57.889544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa00e452-d7be-4ee6-8a9c-94713ebad12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:57.890222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa00e452-d7be-4ee6-8a9c-94713ebad12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:57.890701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa00e452-d7be-4ee6-8a9c-94713ebad12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:57.891153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa00e452-d7be-4ee6-8a9c-94713ebad12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:57.921062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aa00e452-d7be-4ee6-8a9c-94713ebad12b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045554 Aug 31 00:43:57.921609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 880/1685] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:58.032733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9797c0af-37af-404a-b506-bc9808585a2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:58.034859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9797c0af-37af-404a-b506-bc9808585a2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:58.041443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9797c0af-37af-404a-b506-bc9808585a2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:58.042166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9797c0af-37af-404a-b506-bc9808585a2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:58.042610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9797c0af-37af-404a-b506-bc9808585a2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:58.043344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9797c0af-37af-404a-b506-bc9808585a2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:58.043801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9797c0af-37af-404a-b506-bc9808585a2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:58.044227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9797c0af-37af-404a-b506-bc9808585a2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:58.074099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9797c0af-37af-404a-b506-bc9808585a2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045328 Aug 31 00:43:58.074660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 806/1686] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:58.933168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7bdd5c0b-ec9c-4b03-80d1-3a3a41415b16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:58.935245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7bdd5c0b-ec9c-4b03-80d1-3a3a41415b16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:58.941565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdd5c0b-ec9c-4b03-80d1-3a3a41415b16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:58.942043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdd5c0b-ec9c-4b03-80d1-3a3a41415b16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:58.942477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdd5c0b-ec9c-4b03-80d1-3a3a41415b16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:58.943189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdd5c0b-ec9c-4b03-80d1-3a3a41415b16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:58.943642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdd5c0b-ec9c-4b03-80d1-3a3a41415b16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:58.944061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bdd5c0b-ec9c-4b03-80d1-3a3a41415b16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:58.973865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7bdd5c0b-ec9c-4b03-80d1-3a3a41415b16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045333 Aug 31 00:43:58.974438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 881/1687] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:59.086400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-15e72ba9-2e34-4ba9-8f2c-665791a01f7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:59.089240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-15e72ba9-2e34-4ba9-8f2c-665791a01f7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:59.091533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=58 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:59.096662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e72ba9-2e34-4ba9-8f2c-665791a01f7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:59.097131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e72ba9-2e34-4ba9-8f2c-665791a01f7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:59.097558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e72ba9-2e34-4ba9-8f2c-665791a01f7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:59.098242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e72ba9-2e34-4ba9-8f2c-665791a01f7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:59.098683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e72ba9-2e34-4ba9-8f2c-665791a01f7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:59.099119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15e72ba9-2e34-4ba9-8f2c-665791a01f7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:59.136105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-15e72ba9-2e34-4ba9-8f2c-665791a01f7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053401 Aug 31 00:43:59.136688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 807/1688] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 00:43:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:43:59.985556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-48e13d74-edb8-4c21-8d48-a2b54cc26551 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:59.987763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-48e13d74-edb8-4c21-8d48-a2b54cc26551 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:59.994591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48e13d74-edb8-4c21-8d48-a2b54cc26551 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:59.995217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48e13d74-edb8-4c21-8d48-a2b54cc26551 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:59.995657 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48e13d74-edb8-4c21-8d48-a2b54cc26551 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:59.996343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48e13d74-edb8-4c21-8d48-a2b54cc26551 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:59.996788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48e13d74-edb8-4c21-8d48-a2b54cc26551 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:59.997205 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48e13d74-edb8-4c21-8d48-a2b54cc26551 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:00.027412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-48e13d74-edb8-4c21-8d48-a2b54cc26551 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Aug 31 00:44:00.027968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 882/1689] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:43:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:44:00.148960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-115c5498-fbe4-467c-8bef-0d4cc06c8c9f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:44:00.151328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-115c5498-fbe4-467c-8bef-0d4cc06c8c9f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:00.157713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-115c5498-fbe4-467c-8bef-0d4cc06c8c9f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:00.158211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-115c5498-fbe4-467c-8bef-0d4cc06c8c9f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:00.158649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-115c5498-fbe4-467c-8bef-0d4cc06c8c9f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:00.159372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-115c5498-fbe4-467c-8bef-0d4cc06c8c9f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:00.159925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-115c5498-fbe4-467c-8bef-0d4cc06c8c9f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:00.160348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-115c5498-fbe4-467c-8bef-0d4cc06c8c9f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:00.267363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-115c5498-fbe4-467c-8bef-0d4cc06c8c9f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/action" status: 200 len: 37453 microversion: 2.20 time: 0.122121 Aug 31 00:44:00.267934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 808/1690] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 31 00:44:00 2022] POST /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38/action => generated 37453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:44:01.038943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6460ae3f-9513-4d66-bac3-9fe48a3a4e88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:44:01.041182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6460ae3f-9513-4d66-bac3-9fe48a3a4e88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:01.047807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6460ae3f-9513-4d66-bac3-9fe48a3a4e88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:01.048336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6460ae3f-9513-4d66-bac3-9fe48a3a4e88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:01.048759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6460ae3f-9513-4d66-bac3-9fe48a3a4e88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:01.049435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6460ae3f-9513-4d66-bac3-9fe48a3a4e88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:01.049878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6460ae3f-9513-4d66-bac3-9fe48a3a4e88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:01.050292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6460ae3f-9513-4d66-bac3-9fe48a3a4e88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:01.149894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6460ae3f-9513-4d66-bac3-9fe48a3a4e88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "POST /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/action" status: 200 len: 115354 microversion: 2.1 time: 0.114542 Aug 31 00:44:01.150675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 883/1691] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 00:44:01 2022] POST /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43/action => generated 115354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:44:01.945074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a9d2e5b3-a2fa-4462-ab41-5b15f92eb527 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:01.945692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a9d2e5b3-a2fa-4462-ab41-5b15f92eb527 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:01.953609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9d2e5b3-a2fa-4462-ab41-5b15f92eb527 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:01.954087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9d2e5b3-a2fa-4462-ab41-5b15f92eb527 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:01.954508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9d2e5b3-a2fa-4462-ab41-5b15f92eb527 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:01.955241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9d2e5b3-a2fa-4462-ab41-5b15f92eb527 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:01.955683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9d2e5b3-a2fa-4462-ab41-5b15f92eb527 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:01.956102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9d2e5b3-a2fa-4462-ab41-5b15f92eb527 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:01.991412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a9d2e5b3-a2fa-4462-ab41-5b15f92eb527 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:44:02.072042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a9d2e5b3-a2fa-4462-ab41-5b15f92eb527 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 204 len: 0 microversion: 2.1 time: 0.130938 Aug 31 00:44:02.077059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 809/1692] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:44:01 2022] DELETE /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:44:02.083410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6a1ea008-8d36-4de2-be64-131490da8f75 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:02.084105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6a1ea008-8d36-4de2-be64-131490da8f75 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:02.086723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=58 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:02.093008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a1ea008-8d36-4de2-be64-131490da8f75 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:02.093515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a1ea008-8d36-4de2-be64-131490da8f75 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:02.093949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a1ea008-8d36-4de2-be64-131490da8f75 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:02.094635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a1ea008-8d36-4de2-be64-131490da8f75 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:02.095109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a1ea008-8d36-4de2-be64-131490da8f75 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:02.095527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6a1ea008-8d36-4de2-be64-131490da8f75 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:02.409222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6a1ea008-8d36-4de2-be64-131490da8f75 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:02.424635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6a1ea008-8d36-4de2-be64-131490da8f75 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.345435 Aug 31 00:44:02.425284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 884/1693] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:02 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:03.107569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4eba593f-fea4-46e3-bb51-826131a0a917 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] Calling method '.version_select at 0x7fa7f7531790>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:03.134307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4eba593f-fea4-46e3-bb51-826131a0a917 tempest-TestVolumeBootPattern-1800903404 tempest-TestVolumeBootPattern-1800903404-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1651012719" status: 202 len: 0 microversion: 2.1 time: 0.032377 Aug 31 00:44:03.135578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 810/1694] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 31 00:44:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1651012719 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:44:03.448271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8b47e7a1-49eb-4580-b5e3-d65a9a8dc521 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:03.448918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8b47e7a1-49eb-4580-b5e3-d65a9a8dc521 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:03.456055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b47e7a1-49eb-4580-b5e3-d65a9a8dc521 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:03.456690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b47e7a1-49eb-4580-b5e3-d65a9a8dc521 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:03.457130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b47e7a1-49eb-4580-b5e3-d65a9a8dc521 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:03.457833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b47e7a1-49eb-4580-b5e3-d65a9a8dc521 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:03.458289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b47e7a1-49eb-4580-b5e3-d65a9a8dc521 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:03.458712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b47e7a1-49eb-4580-b5e3-d65a9a8dc521 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:03.592856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b47e7a1-49eb-4580-b5e3-d65a9a8dc521 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:03.601196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8b47e7a1-49eb-4580-b5e3-d65a9a8dc521 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157337 Aug 31 00:44:03.601768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 885/1695] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:03 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:04.624077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-548f3406-1d7d-4501-8572-387c9218be5c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:04.624732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-548f3406-1d7d-4501-8572-387c9218be5c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:04.630786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-548f3406-1d7d-4501-8572-387c9218be5c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:04.631256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-548f3406-1d7d-4501-8572-387c9218be5c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:04.631682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-548f3406-1d7d-4501-8572-387c9218be5c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:04.632365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-548f3406-1d7d-4501-8572-387c9218be5c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:04.632836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-548f3406-1d7d-4501-8572-387c9218be5c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:04.633249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-548f3406-1d7d-4501-8572-387c9218be5c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:04.815081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-548f3406-1d7d-4501-8572-387c9218be5c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:04.824656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-548f3406-1d7d-4501-8572-387c9218be5c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.206153 Aug 31 00:44:04.825606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 811/1696] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:04 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:05.847580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cb7aa7e2-fbd9-4dc7-8240-2f45261400fc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:05.848182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cb7aa7e2-fbd9-4dc7-8240-2f45261400fc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:05.854859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb7aa7e2-fbd9-4dc7-8240-2f45261400fc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:05.855368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb7aa7e2-fbd9-4dc7-8240-2f45261400fc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:05.855798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb7aa7e2-fbd9-4dc7-8240-2f45261400fc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:05.856502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb7aa7e2-fbd9-4dc7-8240-2f45261400fc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:05.856946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb7aa7e2-fbd9-4dc7-8240-2f45261400fc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:05.857618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb7aa7e2-fbd9-4dc7-8240-2f45261400fc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:05.876285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:05.997903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cb7aa7e2-fbd9-4dc7-8240-2f45261400fc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:06.006167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cb7aa7e2-fbd9-4dc7-8240-2f45261400fc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.162526 Aug 31 00:44:06.006728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 886/1697] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:05 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:07.028763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-69a4d094-92fe-44fe-bc70-ee2c62de771a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:07.029328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-69a4d094-92fe-44fe-bc70-ee2c62de771a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:07.036340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69a4d094-92fe-44fe-bc70-ee2c62de771a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:07.036823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69a4d094-92fe-44fe-bc70-ee2c62de771a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:07.037253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69a4d094-92fe-44fe-bc70-ee2c62de771a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:07.037948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69a4d094-92fe-44fe-bc70-ee2c62de771a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:07.038392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69a4d094-92fe-44fe-bc70-ee2c62de771a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:07.039203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69a4d094-92fe-44fe-bc70-ee2c62de771a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:07.251906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-69a4d094-92fe-44fe-bc70-ee2c62de771a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:07.260553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-69a4d094-92fe-44fe-bc70-ee2c62de771a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.236365 Aug 31 00:44:07.261125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 812/1698] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:07 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:08.282341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8851ff84-7dc0-4b6b-8ee9-69e647dadfe0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:08.282973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8851ff84-7dc0-4b6b-8ee9-69e647dadfe0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:08.290193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8851ff84-7dc0-4b6b-8ee9-69e647dadfe0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:08.292218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8851ff84-7dc0-4b6b-8ee9-69e647dadfe0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:08.292807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8851ff84-7dc0-4b6b-8ee9-69e647dadfe0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:08.293649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8851ff84-7dc0-4b6b-8ee9-69e647dadfe0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:08.294121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8851ff84-7dc0-4b6b-8ee9-69e647dadfe0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:08.294713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8851ff84-7dc0-4b6b-8ee9-69e647dadfe0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:08.503663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8851ff84-7dc0-4b6b-8ee9-69e647dadfe0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:08.512944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8851ff84-7dc0-4b6b-8ee9-69e647dadfe0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.234729 Aug 31 00:44:08.513536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 887/1699] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:08 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:09.534664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2bbbe292-0f98-4cab-8923-40850229ab57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:09.535302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2bbbe292-0f98-4cab-8923-40850229ab57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:09.542984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bbbe292-0f98-4cab-8923-40850229ab57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:09.543492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bbbe292-0f98-4cab-8923-40850229ab57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:09.544842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bbbe292-0f98-4cab-8923-40850229ab57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:09.544842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bbbe292-0f98-4cab-8923-40850229ab57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:09.545085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bbbe292-0f98-4cab-8923-40850229ab57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:09.546633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bbbe292-0f98-4cab-8923-40850229ab57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:09.781031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2bbbe292-0f98-4cab-8923-40850229ab57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:09.790938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2bbbe292-0f98-4cab-8923-40850229ab57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.260756 Aug 31 00:44:09.795220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 813/1700] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:09 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:10.813971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-24ffd60e-3342-4c40-8dfb-9421224cca46 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:10.814573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-24ffd60e-3342-4c40-8dfb-9421224cca46 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:10.820966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ffd60e-3342-4c40-8dfb-9421224cca46 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:10.821439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ffd60e-3342-4c40-8dfb-9421224cca46 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:10.821863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ffd60e-3342-4c40-8dfb-9421224cca46 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:10.823266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ffd60e-3342-4c40-8dfb-9421224cca46 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:10.823940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ffd60e-3342-4c40-8dfb-9421224cca46 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:10.824387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ffd60e-3342-4c40-8dfb-9421224cca46 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:10.966290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-24ffd60e-3342-4c40-8dfb-9421224cca46 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:10.977299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-24ffd60e-3342-4c40-8dfb-9421224cca46 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.167228 Aug 31 00:44:10.977876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 888/1701] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:10 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:11.999427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8ff03d39-6618-440f-b042-a4e29780215d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:12.000041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8ff03d39-6618-440f-b042-a4e29780215d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:12.006584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ff03d39-6618-440f-b042-a4e29780215d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:12.007097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ff03d39-6618-440f-b042-a4e29780215d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:12.007533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ff03d39-6618-440f-b042-a4e29780215d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:12.008225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ff03d39-6618-440f-b042-a4e29780215d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:12.008677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ff03d39-6618-440f-b042-a4e29780215d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:12.009104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ff03d39-6618-440f-b042-a4e29780215d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:12.142194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8ff03d39-6618-440f-b042-a4e29780215d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:12.151022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8ff03d39-6618-440f-b042-a4e29780215d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154804 Aug 31 00:44:12.151772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 814/1702] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:11 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:13.171817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2c0342a2-d975-41e8-95fd-685e1c9a43db tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:13.172384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2c0342a2-d975-41e8-95fd-685e1c9a43db tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:13.178717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c0342a2-d975-41e8-95fd-685e1c9a43db tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:13.179229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c0342a2-d975-41e8-95fd-685e1c9a43db tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:13.179663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c0342a2-d975-41e8-95fd-685e1c9a43db tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:13.180345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c0342a2-d975-41e8-95fd-685e1c9a43db tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:13.180792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c0342a2-d975-41e8-95fd-685e1c9a43db tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:13.181210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c0342a2-d975-41e8-95fd-685e1c9a43db tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:13.310767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2c0342a2-d975-41e8-95fd-685e1c9a43db tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:13.318908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2c0342a2-d975-41e8-95fd-685e1c9a43db tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151022 Aug 31 00:44:13.319487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 889/1703] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:13 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:14.341454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f075c362-c71e-40b3-8143-2dad1be6c2a6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:14.342059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f075c362-c71e-40b3-8143-2dad1be6c2a6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:14.348469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f075c362-c71e-40b3-8143-2dad1be6c2a6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:14.348946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f075c362-c71e-40b3-8143-2dad1be6c2a6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:14.349375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f075c362-c71e-40b3-8143-2dad1be6c2a6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:14.350052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f075c362-c71e-40b3-8143-2dad1be6c2a6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:14.350499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f075c362-c71e-40b3-8143-2dad1be6c2a6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:14.350913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f075c362-c71e-40b3-8143-2dad1be6c2a6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:14.355522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:14.488770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f075c362-c71e-40b3-8143-2dad1be6c2a6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:14.497705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f075c362-c71e-40b3-8143-2dad1be6c2a6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.160644 Aug 31 00:44:14.498267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 815/1704] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:14 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:15.519078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e1f9b497-2ace-486d-94dd-7c3acf7af8b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:15.519679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e1f9b497-2ace-486d-94dd-7c3acf7af8b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:15.526703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1f9b497-2ace-486d-94dd-7c3acf7af8b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:15.527211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1f9b497-2ace-486d-94dd-7c3acf7af8b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:15.527641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1f9b497-2ace-486d-94dd-7c3acf7af8b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:15.528318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1f9b497-2ace-486d-94dd-7c3acf7af8b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:15.528765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1f9b497-2ace-486d-94dd-7c3acf7af8b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:15.529184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1f9b497-2ace-486d-94dd-7c3acf7af8b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:15.665208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e1f9b497-2ace-486d-94dd-7c3acf7af8b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:15.674193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e1f9b497-2ace-486d-94dd-7c3acf7af8b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159017 Aug 31 00:44:15.674765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 890/1705] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:15 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:16.695376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-94129ee3-c1ef-4e81-ac75-68e38a9f0df6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:16.695982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-94129ee3-c1ef-4e81-ac75-68e38a9f0df6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:16.702862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94129ee3-c1ef-4e81-ac75-68e38a9f0df6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:16.703368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94129ee3-c1ef-4e81-ac75-68e38a9f0df6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:16.703800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94129ee3-c1ef-4e81-ac75-68e38a9f0df6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:16.704585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94129ee3-c1ef-4e81-ac75-68e38a9f0df6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:16.705035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94129ee3-c1ef-4e81-ac75-68e38a9f0df6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:16.705454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94129ee3-c1ef-4e81-ac75-68e38a9f0df6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:16.835755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-94129ee3-c1ef-4e81-ac75-68e38a9f0df6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:16.844051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-94129ee3-c1ef-4e81-ac75-68e38a9f0df6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152501 Aug 31 00:44:16.844611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 816/1706] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:16 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:17.866079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ca2e9824-784b-4586-87cb-a0263ac0f3fb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:17.867276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ca2e9824-784b-4586-87cb-a0263ac0f3fb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:17.874076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca2e9824-784b-4586-87cb-a0263ac0f3fb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:17.874552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca2e9824-784b-4586-87cb-a0263ac0f3fb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:17.874977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca2e9824-784b-4586-87cb-a0263ac0f3fb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:17.875698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca2e9824-784b-4586-87cb-a0263ac0f3fb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:17.876144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca2e9824-784b-4586-87cb-a0263ac0f3fb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:17.876680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca2e9824-784b-4586-87cb-a0263ac0f3fb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:18.012899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ca2e9824-784b-4586-87cb-a0263ac0f3fb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:18.022414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ca2e9824-784b-4586-87cb-a0263ac0f3fb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159948 Aug 31 00:44:18.023276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 891/1707] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:17 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:19.048273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c0350df1-ac4f-4039-9884-9af8ad34cd2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:19.049414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c0350df1-ac4f-4039-9884-9af8ad34cd2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:19.057339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0350df1-ac4f-4039-9884-9af8ad34cd2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:19.057828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0350df1-ac4f-4039-9884-9af8ad34cd2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:19.058265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0350df1-ac4f-4039-9884-9af8ad34cd2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:19.058968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0350df1-ac4f-4039-9884-9af8ad34cd2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:19.059440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0350df1-ac4f-4039-9884-9af8ad34cd2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:19.059862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c0350df1-ac4f-4039-9884-9af8ad34cd2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:19.189252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c0350df1-ac4f-4039-9884-9af8ad34cd2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:19.197397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c0350df1-ac4f-4039-9884-9af8ad34cd2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152998 Aug 31 00:44:19.198191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 817/1708] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:19 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:20.218658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5ddbda7b-2b05-45f2-9766-92ed25716d68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:20.219278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5ddbda7b-2b05-45f2-9766-92ed25716d68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:20.221246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:44:20.221379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:44:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 (ip 10.222.0.67) !!! Aug 31 00:44:20.231235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ddbda7b-2b05-45f2-9766-92ed25716d68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:20.231713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ddbda7b-2b05-45f2-9766-92ed25716d68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:20.232134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ddbda7b-2b05-45f2-9766-92ed25716d68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:20.233089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ddbda7b-2b05-45f2-9766-92ed25716d68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:20.233533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ddbda7b-2b05-45f2-9766-92ed25716d68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:20.233940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ddbda7b-2b05-45f2-9766-92ed25716d68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:20.368874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5ddbda7b-2b05-45f2-9766-92ed25716d68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:20.377657 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5ddbda7b-2b05-45f2-9766-92ed25716d68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.162892 Aug 31 00:44:20.378245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 892/1709] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:20 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:21.398891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-881adb85-b22c-410e-bae8-3094abf7f9e0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:21.399513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-881adb85-b22c-410e-bae8-3094abf7f9e0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:21.406502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-881adb85-b22c-410e-bae8-3094abf7f9e0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:21.406973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-881adb85-b22c-410e-bae8-3094abf7f9e0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:21.407430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-881adb85-b22c-410e-bae8-3094abf7f9e0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:21.408103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-881adb85-b22c-410e-bae8-3094abf7f9e0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:21.408543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-881adb85-b22c-410e-bae8-3094abf7f9e0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:21.408955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-881adb85-b22c-410e-bae8-3094abf7f9e0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:21.539116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-881adb85-b22c-410e-bae8-3094abf7f9e0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:21.547241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-881adb85-b22c-410e-bae8-3094abf7f9e0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152171 Aug 31 00:44:21.547733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 818/1710] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:21 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:22.568856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b9f6ca93-3aeb-4ab6-a6bb-eeb85a5680b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:22.569464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b9f6ca93-3aeb-4ab6-a6bb-eeb85a5680b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:22.575963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f6ca93-3aeb-4ab6-a6bb-eeb85a5680b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:22.576440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f6ca93-3aeb-4ab6-a6bb-eeb85a5680b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:22.576869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f6ca93-3aeb-4ab6-a6bb-eeb85a5680b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:22.577556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f6ca93-3aeb-4ab6-a6bb-eeb85a5680b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:22.578004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f6ca93-3aeb-4ab6-a6bb-eeb85a5680b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:22.578419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9f6ca93-3aeb-4ab6-a6bb-eeb85a5680b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:22.709821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b9f6ca93-3aeb-4ab6-a6bb-eeb85a5680b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:22.719087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b9f6ca93-3aeb-4ab6-a6bb-eeb85a5680b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154266 Aug 31 00:44:22.719660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 893/1711] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:22 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:23.740337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e13cb63c-492b-4831-837a-9b434942e34a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:23.740975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e13cb63c-492b-4831-837a-9b434942e34a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:23.748220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e13cb63c-492b-4831-837a-9b434942e34a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:23.748706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e13cb63c-492b-4831-837a-9b434942e34a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:23.749140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e13cb63c-492b-4831-837a-9b434942e34a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:23.749834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e13cb63c-492b-4831-837a-9b434942e34a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:23.750286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e13cb63c-492b-4831-837a-9b434942e34a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:23.751014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e13cb63c-492b-4831-837a-9b434942e34a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:23.882440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e13cb63c-492b-4831-837a-9b434942e34a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:23.890620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e13cb63c-492b-4831-837a-9b434942e34a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154163 Aug 31 00:44:23.891207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 819/1712] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:23 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:24.911876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e9730623-b304-436c-8eb0-6726064b5917 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:24.912473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e9730623-b304-436c-8eb0-6726064b5917 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:24.919399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9730623-b304-436c-8eb0-6726064b5917 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:24.919879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9730623-b304-436c-8eb0-6726064b5917 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:24.920303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9730623-b304-436c-8eb0-6726064b5917 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:24.920982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9730623-b304-436c-8eb0-6726064b5917 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:24.921424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9730623-b304-436c-8eb0-6726064b5917 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:24.921837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9730623-b304-436c-8eb0-6726064b5917 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:25.058448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e9730623-b304-436c-8eb0-6726064b5917 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:25.066950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e9730623-b304-436c-8eb0-6726064b5917 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.158875 Aug 31 00:44:25.067550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 894/1713] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:24 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:26.088383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9f7a3328-beef-49e2-8ab9-6768c1190597 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:26.088993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9f7a3328-beef-49e2-8ab9-6768c1190597 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:26.095587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f7a3328-beef-49e2-8ab9-6768c1190597 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:26.096070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f7a3328-beef-49e2-8ab9-6768c1190597 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:26.096503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f7a3328-beef-49e2-8ab9-6768c1190597 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:26.097192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f7a3328-beef-49e2-8ab9-6768c1190597 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:26.097647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f7a3328-beef-49e2-8ab9-6768c1190597 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:26.098063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f7a3328-beef-49e2-8ab9-6768c1190597 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:26.235717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9f7a3328-beef-49e2-8ab9-6768c1190597 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:26.243898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9f7a3328-beef-49e2-8ab9-6768c1190597 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159372 Aug 31 00:44:26.245407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 820/1714] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:26 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:27.266384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a0a6493d-0991-4ee0-b66d-a409199e142e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:27.266924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a0a6493d-0991-4ee0-b66d-a409199e142e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:27.273434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0a6493d-0991-4ee0-b66d-a409199e142e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:27.273919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0a6493d-0991-4ee0-b66d-a409199e142e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:27.274352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0a6493d-0991-4ee0-b66d-a409199e142e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:27.275065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0a6493d-0991-4ee0-b66d-a409199e142e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:27.276242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0a6493d-0991-4ee0-b66d-a409199e142e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:27.276664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0a6493d-0991-4ee0-b66d-a409199e142e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:27.408509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a0a6493d-0991-4ee0-b66d-a409199e142e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:27.416838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a0a6493d-0991-4ee0-b66d-a409199e142e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154408 Aug 31 00:44:27.417392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 895/1715] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:27 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:28.437550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-746e4a88-7cba-4cfb-9d1f-fc89196e815e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:28.438139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-746e4a88-7cba-4cfb-9d1f-fc89196e815e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:28.444464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746e4a88-7cba-4cfb-9d1f-fc89196e815e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:28.444939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746e4a88-7cba-4cfb-9d1f-fc89196e815e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:28.445368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746e4a88-7cba-4cfb-9d1f-fc89196e815e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:28.446041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746e4a88-7cba-4cfb-9d1f-fc89196e815e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:28.446487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746e4a88-7cba-4cfb-9d1f-fc89196e815e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:28.446906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746e4a88-7cba-4cfb-9d1f-fc89196e815e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:28.579779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-746e4a88-7cba-4cfb-9d1f-fc89196e815e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:28.588221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-746e4a88-7cba-4cfb-9d1f-fc89196e815e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154428 Aug 31 00:44:28.588789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 821/1716] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:28 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:29.613984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6d91ec6e-dce2-420f-805e-1b6b0e45224c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:29.614587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6d91ec6e-dce2-420f-805e-1b6b0e45224c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:29.622282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d91ec6e-dce2-420f-805e-1b6b0e45224c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:29.622767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d91ec6e-dce2-420f-805e-1b6b0e45224c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:29.623234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d91ec6e-dce2-420f-805e-1b6b0e45224c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:29.623941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d91ec6e-dce2-420f-805e-1b6b0e45224c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:29.624396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d91ec6e-dce2-420f-805e-1b6b0e45224c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:29.624820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d91ec6e-dce2-420f-805e-1b6b0e45224c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:29.760280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6d91ec6e-dce2-420f-805e-1b6b0e45224c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:29.768929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6d91ec6e-dce2-420f-805e-1b6b0e45224c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.158822 Aug 31 00:44:29.769717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 896/1717] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:29 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:30.790368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-28877606-787b-4cf8-b93e-50dc99f4ef27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:30.791065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-28877606-787b-4cf8-b93e-50dc99f4ef27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:30.793651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:30.799885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28877606-787b-4cf8-b93e-50dc99f4ef27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:30.800398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28877606-787b-4cf8-b93e-50dc99f4ef27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:30.800835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28877606-787b-4cf8-b93e-50dc99f4ef27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:30.801530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28877606-787b-4cf8-b93e-50dc99f4ef27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:30.801983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28877606-787b-4cf8-b93e-50dc99f4ef27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:30.802403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28877606-787b-4cf8-b93e-50dc99f4ef27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:30.938092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-28877606-787b-4cf8-b93e-50dc99f4ef27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:30.946273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-28877606-787b-4cf8-b93e-50dc99f4ef27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159745 Aug 31 00:44:30.946837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 822/1718] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:30 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:31.968292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-548b8086-193e-4624-bd4a-2875217a50aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:31.969005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-548b8086-193e-4624-bd4a-2875217a50aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:31.975662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548b8086-193e-4624-bd4a-2875217a50aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:31.976142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548b8086-193e-4624-bd4a-2875217a50aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:31.976567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548b8086-193e-4624-bd4a-2875217a50aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:31.977273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548b8086-193e-4624-bd4a-2875217a50aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:31.977713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548b8086-193e-4624-bd4a-2875217a50aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:31.978124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-548b8086-193e-4624-bd4a-2875217a50aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:32.108129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-548b8086-193e-4624-bd4a-2875217a50aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:32.116675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-548b8086-193e-4624-bd4a-2875217a50aa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152958 Aug 31 00:44:32.117234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 897/1719] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:31 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:33.138033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8139433c-85ff-4062-9a97-f10d70069a16 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:33.138638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8139433c-85ff-4062-9a97-f10d70069a16 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:33.145226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8139433c-85ff-4062-9a97-f10d70069a16 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:33.145700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8139433c-85ff-4062-9a97-f10d70069a16 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:33.146465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8139433c-85ff-4062-9a97-f10d70069a16 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:33.146996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8139433c-85ff-4062-9a97-f10d70069a16 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:33.147471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8139433c-85ff-4062-9a97-f10d70069a16 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:33.147880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8139433c-85ff-4062-9a97-f10d70069a16 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:33.276845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8139433c-85ff-4062-9a97-f10d70069a16 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:33.285149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8139433c-85ff-4062-9a97-f10d70069a16 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151317 Aug 31 00:44:33.285710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 823/1720] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:33 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:34.307750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8cad4c6b-439d-446a-9281-00a475883473 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:34.308291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8cad4c6b-439d-446a-9281-00a475883473 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:34.310532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=28 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:34.315755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cad4c6b-439d-446a-9281-00a475883473 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:34.316236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cad4c6b-439d-446a-9281-00a475883473 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:34.316668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cad4c6b-439d-446a-9281-00a475883473 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:34.317345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cad4c6b-439d-446a-9281-00a475883473 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:34.317794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cad4c6b-439d-446a-9281-00a475883473 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:34.318211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cad4c6b-439d-446a-9281-00a475883473 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:34.448509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8cad4c6b-439d-446a-9281-00a475883473 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:34.456626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8cad4c6b-439d-446a-9281-00a475883473 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153364 Aug 31 00:44:34.457188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 898/1721] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:34 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:35.477710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-011f48b9-b917-4be5-820f-51381e3ace11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:35.478354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-011f48b9-b917-4be5-820f-51381e3ace11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:35.485402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-011f48b9-b917-4be5-820f-51381e3ace11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:35.485878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-011f48b9-b917-4be5-820f-51381e3ace11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:35.486312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-011f48b9-b917-4be5-820f-51381e3ace11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:35.486990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-011f48b9-b917-4be5-820f-51381e3ace11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:35.487460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-011f48b9-b917-4be5-820f-51381e3ace11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:35.487875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-011f48b9-b917-4be5-820f-51381e3ace11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:35.618158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-011f48b9-b917-4be5-820f-51381e3ace11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:35.626841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-011f48b9-b917-4be5-820f-51381e3ace11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153134 Aug 31 00:44:35.627434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 824/1722] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:35 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:36.649113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d42f70f2-2823-4dc0-8ecc-8f23f77beebe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:36.649722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d42f70f2-2823-4dc0-8ecc-8f23f77beebe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:36.656887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d42f70f2-2823-4dc0-8ecc-8f23f77beebe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:36.657370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d42f70f2-2823-4dc0-8ecc-8f23f77beebe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:36.657805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d42f70f2-2823-4dc0-8ecc-8f23f77beebe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:36.658512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d42f70f2-2823-4dc0-8ecc-8f23f77beebe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:36.658951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d42f70f2-2823-4dc0-8ecc-8f23f77beebe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:36.659394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d42f70f2-2823-4dc0-8ecc-8f23f77beebe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:36.663354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=75 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:36.790587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d42f70f2-2823-4dc0-8ecc-8f23f77beebe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:36.800039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d42f70f2-2823-4dc0-8ecc-8f23f77beebe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154732 Aug 31 00:44:36.800610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 899/1723] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:36 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:37.821088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c36e8fb-f6fe-40c0-bcb2-8d241fba6393 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:37.821695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c36e8fb-f6fe-40c0-bcb2-8d241fba6393 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:37.828515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c36e8fb-f6fe-40c0-bcb2-8d241fba6393 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:37.828994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c36e8fb-f6fe-40c0-bcb2-8d241fba6393 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:37.829424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c36e8fb-f6fe-40c0-bcb2-8d241fba6393 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:37.830109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c36e8fb-f6fe-40c0-bcb2-8d241fba6393 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:37.830559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c36e8fb-f6fe-40c0-bcb2-8d241fba6393 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:37.830982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c36e8fb-f6fe-40c0-bcb2-8d241fba6393 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:37.958846 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0c36e8fb-f6fe-40c0-bcb2-8d241fba6393 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:37.967651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c36e8fb-f6fe-40c0-bcb2-8d241fba6393 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150432 Aug 31 00:44:37.968220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 825/1724] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:37 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:38.993863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-08bacfbf-b0dc-469f-82e2-99931dadd3ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:38.995814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-08bacfbf-b0dc-469f-82e2-99931dadd3ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:39.001688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08bacfbf-b0dc-469f-82e2-99931dadd3ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:39.002161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08bacfbf-b0dc-469f-82e2-99931dadd3ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:39.002585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08bacfbf-b0dc-469f-82e2-99931dadd3ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:39.003307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08bacfbf-b0dc-469f-82e2-99931dadd3ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:39.003746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08bacfbf-b0dc-469f-82e2-99931dadd3ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:39.004156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08bacfbf-b0dc-469f-82e2-99931dadd3ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:39.140209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-08bacfbf-b0dc-469f-82e2-99931dadd3ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:39.148513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-08bacfbf-b0dc-469f-82e2-99931dadd3ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.158601 Aug 31 00:44:39.149093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 900/1725] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:38 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:40.170038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-169ad7ac-0678-4ac9-bfea-2ff65dfbab90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:40.170650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-169ad7ac-0678-4ac9-bfea-2ff65dfbab90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:40.176823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169ad7ac-0678-4ac9-bfea-2ff65dfbab90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:40.177302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169ad7ac-0678-4ac9-bfea-2ff65dfbab90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:40.177734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169ad7ac-0678-4ac9-bfea-2ff65dfbab90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:40.178504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169ad7ac-0678-4ac9-bfea-2ff65dfbab90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:40.178951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169ad7ac-0678-4ac9-bfea-2ff65dfbab90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:40.179438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169ad7ac-0678-4ac9-bfea-2ff65dfbab90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:40.308597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-169ad7ac-0678-4ac9-bfea-2ff65dfbab90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:40.316656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-169ad7ac-0678-4ac9-bfea-2ff65dfbab90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150715 Aug 31 00:44:40.317229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 826/1726] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:40 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:41.339480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-60d3f49d-3ff2-45f0-9e03-4e6abb01963b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:41.340099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-60d3f49d-3ff2-45f0-9e03-4e6abb01963b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:41.346693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60d3f49d-3ff2-45f0-9e03-4e6abb01963b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:41.347215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60d3f49d-3ff2-45f0-9e03-4e6abb01963b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:41.347656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60d3f49d-3ff2-45f0-9e03-4e6abb01963b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:41.348348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60d3f49d-3ff2-45f0-9e03-4e6abb01963b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:41.348801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60d3f49d-3ff2-45f0-9e03-4e6abb01963b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:41.349222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60d3f49d-3ff2-45f0-9e03-4e6abb01963b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:41.484525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-60d3f49d-3ff2-45f0-9e03-4e6abb01963b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:41.492660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-60d3f49d-3ff2-45f0-9e03-4e6abb01963b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.158009 Aug 31 00:44:41.493230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 901/1727] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:41 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:42.514450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b92164ca-ca95-482f-a5d5-d11a988c6751 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:42.515077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b92164ca-ca95-482f-a5d5-d11a988c6751 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:42.521491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92164ca-ca95-482f-a5d5-d11a988c6751 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:42.521968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92164ca-ca95-482f-a5d5-d11a988c6751 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:42.522399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92164ca-ca95-482f-a5d5-d11a988c6751 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:42.523107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92164ca-ca95-482f-a5d5-d11a988c6751 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:42.523559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92164ca-ca95-482f-a5d5-d11a988c6751 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:42.523979 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b92164ca-ca95-482f-a5d5-d11a988c6751 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:42.659843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b92164ca-ca95-482f-a5d5-d11a988c6751 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:42.667857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b92164ca-ca95-482f-a5d5-d11a988c6751 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.158062 Aug 31 00:44:42.668399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 827/1728] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:42 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:43.688913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3532f4d8-2171-4485-ac95-a8949a16dd29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:43.689452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3532f4d8-2171-4485-ac95-a8949a16dd29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:43.696090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3532f4d8-2171-4485-ac95-a8949a16dd29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:43.696722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3532f4d8-2171-4485-ac95-a8949a16dd29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:43.697737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3532f4d8-2171-4485-ac95-a8949a16dd29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:43.698629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3532f4d8-2171-4485-ac95-a8949a16dd29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:43.699109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3532f4d8-2171-4485-ac95-a8949a16dd29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:43.699530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3532f4d8-2171-4485-ac95-a8949a16dd29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:43.835947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3532f4d8-2171-4485-ac95-a8949a16dd29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:43.844405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3532f4d8-2171-4485-ac95-a8949a16dd29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159462 Aug 31 00:44:43.844965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 902/1729] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:43 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:44.866307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-48f4440d-c239-4774-8790-686f94c58e35 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:44.866918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-48f4440d-c239-4774-8790-686f94c58e35 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:44.873996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48f4440d-c239-4774-8790-686f94c58e35 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:44.874471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48f4440d-c239-4774-8790-686f94c58e35 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:44.874905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48f4440d-c239-4774-8790-686f94c58e35 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:44.875611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48f4440d-c239-4774-8790-686f94c58e35 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:44.876058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48f4440d-c239-4774-8790-686f94c58e35 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:44.876476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48f4440d-c239-4774-8790-686f94c58e35 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:44.880352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=77 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:45.012410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-48f4440d-c239-4774-8790-686f94c58e35 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:45.023901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-48f4440d-c239-4774-8790-686f94c58e35 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.161433 Aug 31 00:44:45.024482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 828/1730] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:44 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:46.047026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-631ea3ea-8fef-4051-83d4-f7bdce78c50d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:46.047655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-631ea3ea-8fef-4051-83d4-f7bdce78c50d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:46.054241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631ea3ea-8fef-4051-83d4-f7bdce78c50d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:46.054726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631ea3ea-8fef-4051-83d4-f7bdce78c50d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:46.055194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631ea3ea-8fef-4051-83d4-f7bdce78c50d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:46.055883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631ea3ea-8fef-4051-83d4-f7bdce78c50d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:46.056334 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631ea3ea-8fef-4051-83d4-f7bdce78c50d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:46.056898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631ea3ea-8fef-4051-83d4-f7bdce78c50d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:46.186941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-631ea3ea-8fef-4051-83d4-f7bdce78c50d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:46.195370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-631ea3ea-8fef-4051-83d4-f7bdce78c50d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152204 Aug 31 00:44:46.195933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 903/1731] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:46 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:47.218032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c87a047f-7c90-42b5-bdb6-e7b795ebae6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:47.218636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c87a047f-7c90-42b5-bdb6-e7b795ebae6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:47.225046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c87a047f-7c90-42b5-bdb6-e7b795ebae6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:47.225520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c87a047f-7c90-42b5-bdb6-e7b795ebae6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:47.225945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c87a047f-7c90-42b5-bdb6-e7b795ebae6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:47.226626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c87a047f-7c90-42b5-bdb6-e7b795ebae6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:47.227090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c87a047f-7c90-42b5-bdb6-e7b795ebae6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:47.227505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c87a047f-7c90-42b5-bdb6-e7b795ebae6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:47.356107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c87a047f-7c90-42b5-bdb6-e7b795ebae6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:47.364730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c87a047f-7c90-42b5-bdb6-e7b795ebae6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150555 Aug 31 00:44:47.365291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 829/1732] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:47 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:48.386398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d6346fd1-84cd-4da3-abfc-60674d25ac8e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:48.387005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d6346fd1-84cd-4da3-abfc-60674d25ac8e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:48.393670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6346fd1-84cd-4da3-abfc-60674d25ac8e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:48.394153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6346fd1-84cd-4da3-abfc-60674d25ac8e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:48.394595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6346fd1-84cd-4da3-abfc-60674d25ac8e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:48.395320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6346fd1-84cd-4da3-abfc-60674d25ac8e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:48.395776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6346fd1-84cd-4da3-abfc-60674d25ac8e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:48.396201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6346fd1-84cd-4da3-abfc-60674d25ac8e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:48.534988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d6346fd1-84cd-4da3-abfc-60674d25ac8e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:48.543451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d6346fd1-84cd-4da3-abfc-60674d25ac8e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.161506 Aug 31 00:44:48.544014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 904/1733] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:48 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:49.565279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-09ebaf51-5874-4870-bbb8-9545a841567e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:49.565847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-09ebaf51-5874-4870-bbb8-9545a841567e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:49.572823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09ebaf51-5874-4870-bbb8-9545a841567e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:49.573081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09ebaf51-5874-4870-bbb8-9545a841567e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:49.573751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09ebaf51-5874-4870-bbb8-9545a841567e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:49.574575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09ebaf51-5874-4870-bbb8-9545a841567e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:49.575030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09ebaf51-5874-4870-bbb8-9545a841567e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:49.575477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09ebaf51-5874-4870-bbb8-9545a841567e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:49.707932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-09ebaf51-5874-4870-bbb8-9545a841567e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:49.716718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-09ebaf51-5874-4870-bbb8-9545a841567e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155598 Aug 31 00:44:49.717277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 830/1734] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:49 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:50.738273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d08af685-7740-43ae-93c8-57ef5a877bdb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:50.738821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d08af685-7740-43ae-93c8-57ef5a877bdb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:50.745654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d08af685-7740-43ae-93c8-57ef5a877bdb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:50.746238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d08af685-7740-43ae-93c8-57ef5a877bdb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:50.746672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d08af685-7740-43ae-93c8-57ef5a877bdb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:50.747439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d08af685-7740-43ae-93c8-57ef5a877bdb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:50.747887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d08af685-7740-43ae-93c8-57ef5a877bdb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:50.748313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d08af685-7740-43ae-93c8-57ef5a877bdb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:50.876464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d08af685-7740-43ae-93c8-57ef5a877bdb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:50.886321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d08af685-7740-43ae-93c8-57ef5a877bdb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151726 Aug 31 00:44:50.887349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 905/1735] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:50 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:51.910579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-87deda61-85bd-4e9e-b93b-d474605e04bc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:51.911211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-87deda61-85bd-4e9e-b93b-d474605e04bc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:51.919777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87deda61-85bd-4e9e-b93b-d474605e04bc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.920248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87deda61-85bd-4e9e-b93b-d474605e04bc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.920674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87deda61-85bd-4e9e-b93b-d474605e04bc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:51.921354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87deda61-85bd-4e9e-b93b-d474605e04bc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.921795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87deda61-85bd-4e9e-b93b-d474605e04bc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.922206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87deda61-85bd-4e9e-b93b-d474605e04bc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:52.054561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-87deda61-85bd-4e9e-b93b-d474605e04bc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:52.063389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-87deda61-85bd-4e9e-b93b-d474605e04bc tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156642 Aug 31 00:44:52.063948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 831/1736] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:51 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:53.084013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e3089bd5-229f-4f89-be1c-b45691d08b57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:53.084741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e3089bd5-229f-4f89-be1c-b45691d08b57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:53.091436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3089bd5-229f-4f89-be1c-b45691d08b57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:53.091914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3089bd5-229f-4f89-be1c-b45691d08b57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:53.092345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3089bd5-229f-4f89-be1c-b45691d08b57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:53.093310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3089bd5-229f-4f89-be1c-b45691d08b57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:53.093764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3089bd5-229f-4f89-be1c-b45691d08b57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:53.094185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3089bd5-229f-4f89-be1c-b45691d08b57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:53.227863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e3089bd5-229f-4f89-be1c-b45691d08b57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:53.236308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e3089bd5-229f-4f89-be1c-b45691d08b57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156052 Aug 31 00:44:53.236880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 906/1737] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:53 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:54.257990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-13b3a650-cbb6-48ee-ad07-5f073611a02d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:54.258519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-13b3a650-cbb6-48ee-ad07-5f073611a02d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:54.265528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13b3a650-cbb6-48ee-ad07-5f073611a02d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:54.266001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13b3a650-cbb6-48ee-ad07-5f073611a02d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:54.266437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13b3a650-cbb6-48ee-ad07-5f073611a02d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:54.267136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13b3a650-cbb6-48ee-ad07-5f073611a02d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:54.267582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13b3a650-cbb6-48ee-ad07-5f073611a02d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:54.267997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13b3a650-cbb6-48ee-ad07-5f073611a02d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:54.404719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-13b3a650-cbb6-48ee-ad07-5f073611a02d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:54.412908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-13b3a650-cbb6-48ee-ad07-5f073611a02d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.158833 Aug 31 00:44:54.413467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 832/1738] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:54 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:55.433718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a951f907-fbd4-4f01-a2d8-27079d415a57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:55.434322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a951f907-fbd4-4f01-a2d8-27079d415a57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:55.440833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a951f907-fbd4-4f01-a2d8-27079d415a57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:55.441309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a951f907-fbd4-4f01-a2d8-27079d415a57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:55.441740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a951f907-fbd4-4f01-a2d8-27079d415a57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:55.442417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a951f907-fbd4-4f01-a2d8-27079d415a57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:55.442867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a951f907-fbd4-4f01-a2d8-27079d415a57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:55.443312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a951f907-fbd4-4f01-a2d8-27079d415a57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:55.571582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a951f907-fbd4-4f01-a2d8-27079d415a57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:55.580408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a951f907-fbd4-4f01-a2d8-27079d415a57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150619 Aug 31 00:44:55.580969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 907/1739] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:55 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:56.601433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e20bd790-a380-4c17-ba12-e1b227e5e8a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:56.602033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e20bd790-a380-4c17-ba12-e1b227e5e8a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:56.609799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e20bd790-a380-4c17-ba12-e1b227e5e8a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:56.610313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e20bd790-a380-4c17-ba12-e1b227e5e8a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:56.610886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e20bd790-a380-4c17-ba12-e1b227e5e8a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:56.611672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e20bd790-a380-4c17-ba12-e1b227e5e8a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:56.612215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e20bd790-a380-4c17-ba12-e1b227e5e8a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:56.612674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e20bd790-a380-4c17-ba12-e1b227e5e8a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:56.994951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e20bd790-a380-4c17-ba12-e1b227e5e8a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:57.004118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e20bd790-a380-4c17-ba12-e1b227e5e8a9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.406587 Aug 31 00:44:57.011578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 833/1740] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:56 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:58.025812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e7e14e99-7934-4f56-907e-39b4c01cfa55 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:58.026330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e7e14e99-7934-4f56-907e-39b4c01cfa55 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:58.033380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7e14e99-7934-4f56-907e-39b4c01cfa55 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:58.033882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7e14e99-7934-4f56-907e-39b4c01cfa55 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:58.034308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7e14e99-7934-4f56-907e-39b4c01cfa55 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:58.034978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7e14e99-7934-4f56-907e-39b4c01cfa55 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:58.035446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7e14e99-7934-4f56-907e-39b4c01cfa55 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:58.035858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7e14e99-7934-4f56-907e-39b4c01cfa55 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:58.162865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e7e14e99-7934-4f56-907e-39b4c01cfa55 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:58.170909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e7e14e99-7934-4f56-907e-39b4c01cfa55 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.148997 Aug 31 00:44:58.171496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 908/1741] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:58 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:59.191954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7bcee972-e43c-4015-89eb-1a02fa57bae3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:59.192484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7bcee972-e43c-4015-89eb-1a02fa57bae3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:59.199992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bcee972-e43c-4015-89eb-1a02fa57bae3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:59.200483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bcee972-e43c-4015-89eb-1a02fa57bae3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:59.200920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bcee972-e43c-4015-89eb-1a02fa57bae3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:59.201608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bcee972-e43c-4015-89eb-1a02fa57bae3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:59.202063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bcee972-e43c-4015-89eb-1a02fa57bae3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:59.202487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bcee972-e43c-4015-89eb-1a02fa57bae3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:59.334501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7bcee972-e43c-4015-89eb-1a02fa57bae3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:59.343010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7bcee972-e43c-4015-89eb-1a02fa57bae3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155030 Aug 31 00:44:59.343602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 834/1742] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:59 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:00.365262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-acf32d8d-6ad0-4962-9832-3f60c49d16c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:00.365870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-acf32d8d-6ad0-4962-9832-3f60c49d16c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:00.372687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acf32d8d-6ad0-4962-9832-3f60c49d16c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:00.373162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acf32d8d-6ad0-4962-9832-3f60c49d16c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:00.373602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acf32d8d-6ad0-4962-9832-3f60c49d16c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:00.374287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acf32d8d-6ad0-4962-9832-3f60c49d16c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:00.374735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acf32d8d-6ad0-4962-9832-3f60c49d16c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:00.375180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acf32d8d-6ad0-4962-9832-3f60c49d16c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:00.507304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-acf32d8d-6ad0-4962-9832-3f60c49d16c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:00.517675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-acf32d8d-6ad0-4962-9832-3f60c49d16c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156235 Aug 31 00:45:00.518250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 909/1743] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:00 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:01.541601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-68589d21-5cf9-4054-a6ce-a43dfdf8b247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:01.542228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-68589d21-5cf9-4054-a6ce-a43dfdf8b247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:01.545287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=26 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:01.550597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68589d21-5cf9-4054-a6ce-a43dfdf8b247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:01.551092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68589d21-5cf9-4054-a6ce-a43dfdf8b247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:01.551523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68589d21-5cf9-4054-a6ce-a43dfdf8b247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:01.552206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68589d21-5cf9-4054-a6ce-a43dfdf8b247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:01.552687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68589d21-5cf9-4054-a6ce-a43dfdf8b247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:01.553098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68589d21-5cf9-4054-a6ce-a43dfdf8b247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:01.686273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-68589d21-5cf9-4054-a6ce-a43dfdf8b247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:01.694551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-68589d21-5cf9-4054-a6ce-a43dfdf8b247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156743 Aug 31 00:45:01.695141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 835/1744] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:01 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:02.716791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1725f3b7-0842-4590-b9fb-18de6c875032 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:02.717389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1725f3b7-0842-4590-b9fb-18de6c875032 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:02.723971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1725f3b7-0842-4590-b9fb-18de6c875032 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:02.724446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1725f3b7-0842-4590-b9fb-18de6c875032 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:02.724870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1725f3b7-0842-4590-b9fb-18de6c875032 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:02.725546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1725f3b7-0842-4590-b9fb-18de6c875032 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:02.725988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1725f3b7-0842-4590-b9fb-18de6c875032 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:02.726401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1725f3b7-0842-4590-b9fb-18de6c875032 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:02.861091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1725f3b7-0842-4590-b9fb-18de6c875032 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:02.869231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1725f3b7-0842-4590-b9fb-18de6c875032 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156860 Aug 31 00:45:02.869792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 910/1745] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:02 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:03.889343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-49b6d2f6-8964-45a9-bcfe-1f2ad1c342df tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:03.889949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-49b6d2f6-8964-45a9-bcfe-1f2ad1c342df tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:03.896495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49b6d2f6-8964-45a9-bcfe-1f2ad1c342df tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:03.896968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49b6d2f6-8964-45a9-bcfe-1f2ad1c342df tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:03.897395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49b6d2f6-8964-45a9-bcfe-1f2ad1c342df tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:03.898071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49b6d2f6-8964-45a9-bcfe-1f2ad1c342df tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:03.898516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49b6d2f6-8964-45a9-bcfe-1f2ad1c342df tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:03.898931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49b6d2f6-8964-45a9-bcfe-1f2ad1c342df tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:04.045364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-49b6d2f6-8964-45a9-bcfe-1f2ad1c342df tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:04.053650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-49b6d2f6-8964-45a9-bcfe-1f2ad1c342df tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.168240 Aug 31 00:45:04.054213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 836/1746] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:03 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:05.074723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ac33be1-12e3-48f0-bba2-46375b363e61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:05.075485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ac33be1-12e3-48f0-bba2-46375b363e61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:05.077753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=26 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:05.083085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ac33be1-12e3-48f0-bba2-46375b363e61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:05.083593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ac33be1-12e3-48f0-bba2-46375b363e61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:05.084014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ac33be1-12e3-48f0-bba2-46375b363e61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:05.084690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ac33be1-12e3-48f0-bba2-46375b363e61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:05.085182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ac33be1-12e3-48f0-bba2-46375b363e61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:05.085581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ac33be1-12e3-48f0-bba2-46375b363e61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:05.221284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ac33be1-12e3-48f0-bba2-46375b363e61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:05.229939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ac33be1-12e3-48f0-bba2-46375b363e61 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159083 Aug 31 00:45:05.231335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 911/1747] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:05 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:06.253114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-832f4e42-a8ad-473a-8ac3-bf7e5efe7645 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:06.253835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-832f4e42-a8ad-473a-8ac3-bf7e5efe7645 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:06.259952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-832f4e42-a8ad-473a-8ac3-bf7e5efe7645 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:06.260429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-832f4e42-a8ad-473a-8ac3-bf7e5efe7645 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:06.261187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-832f4e42-a8ad-473a-8ac3-bf7e5efe7645 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:06.262513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-832f4e42-a8ad-473a-8ac3-bf7e5efe7645 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:06.262965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-832f4e42-a8ad-473a-8ac3-bf7e5efe7645 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:06.263409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-832f4e42-a8ad-473a-8ac3-bf7e5efe7645 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:06.393697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-832f4e42-a8ad-473a-8ac3-bf7e5efe7645 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:06.401730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-832f4e42-a8ad-473a-8ac3-bf7e5efe7645 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152795 Aug 31 00:45:06.402865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 837/1748] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:06 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:07.423148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7c5a097e-c12a-4879-bece-01c9821e7123 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:07.423674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7c5a097e-c12a-4879-bece-01c9821e7123 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:07.429991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5a097e-c12a-4879-bece-01c9821e7123 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:07.430459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5a097e-c12a-4879-bece-01c9821e7123 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:07.430880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5a097e-c12a-4879-bece-01c9821e7123 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:07.431582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5a097e-c12a-4879-bece-01c9821e7123 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:07.432027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5a097e-c12a-4879-bece-01c9821e7123 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:07.432447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c5a097e-c12a-4879-bece-01c9821e7123 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:07.435500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=78 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:07.568867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7c5a097e-c12a-4879-bece-01c9821e7123 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:07.578919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7c5a097e-c12a-4879-bece-01c9821e7123 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159679 Aug 31 00:45:07.579508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 912/1749] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:07 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:45:08.600311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ee95e1bf-a13b-4a25-920f-3e67b158b9a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:08.600948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ee95e1bf-a13b-4a25-920f-3e67b158b9a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:08.608165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee95e1bf-a13b-4a25-920f-3e67b158b9a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:08.608647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee95e1bf-a13b-4a25-920f-3e67b158b9a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:08.609075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee95e1bf-a13b-4a25-920f-3e67b158b9a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:08.609751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee95e1bf-a13b-4a25-920f-3e67b158b9a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:08.610195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee95e1bf-a13b-4a25-920f-3e67b158b9a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:08.610610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ee95e1bf-a13b-4a25-920f-3e67b158b9a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:08.740110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ee95e1bf-a13b-4a25-920f-3e67b158b9a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:08.748825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ee95e1bf-a13b-4a25-920f-3e67b158b9a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152355 Aug 31 00:45:08.749380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 838/1750] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:08 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:09.769797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7314b313-904d-49ba-8d20-97a7716d997b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:09.770404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7314b313-904d-49ba-8d20-97a7716d997b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:09.776867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7314b313-904d-49ba-8d20-97a7716d997b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:09.778068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7314b313-904d-49ba-8d20-97a7716d997b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:09.778622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7314b313-904d-49ba-8d20-97a7716d997b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:09.779405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7314b313-904d-49ba-8d20-97a7716d997b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:09.779858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7314b313-904d-49ba-8d20-97a7716d997b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:09.780278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7314b313-904d-49ba-8d20-97a7716d997b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:09.914912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7314b313-904d-49ba-8d20-97a7716d997b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:09.923215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7314b313-904d-49ba-8d20-97a7716d997b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157279 Aug 31 00:45:09.923773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 913/1751] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:09 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:10.944102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0789703d-1315-4010-aae9-dda7fdab1ce8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:10.944705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0789703d-1315-4010-aae9-dda7fdab1ce8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:10.951434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0789703d-1315-4010-aae9-dda7fdab1ce8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:10.951907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0789703d-1315-4010-aae9-dda7fdab1ce8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:10.952337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0789703d-1315-4010-aae9-dda7fdab1ce8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:10.953011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0789703d-1315-4010-aae9-dda7fdab1ce8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:10.953457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0789703d-1315-4010-aae9-dda7fdab1ce8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:10.953871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0789703d-1315-4010-aae9-dda7fdab1ce8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:11.089157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0789703d-1315-4010-aae9-dda7fdab1ce8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:11.097772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0789703d-1315-4010-aae9-dda7fdab1ce8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157545 Aug 31 00:45:11.098328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 839/1752] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:10 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:12.119450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-160abe97-c8b3-45cd-a27b-293287c1d7b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:12.120061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-160abe97-c8b3-45cd-a27b-293287c1d7b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:12.127754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-160abe97-c8b3-45cd-a27b-293287c1d7b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:12.128232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-160abe97-c8b3-45cd-a27b-293287c1d7b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:12.128664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-160abe97-c8b3-45cd-a27b-293287c1d7b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:12.129352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-160abe97-c8b3-45cd-a27b-293287c1d7b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:12.129804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-160abe97-c8b3-45cd-a27b-293287c1d7b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:12.130227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-160abe97-c8b3-45cd-a27b-293287c1d7b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:12.260278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-160abe97-c8b3-45cd-a27b-293287c1d7b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:12.268917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-160abe97-c8b3-45cd-a27b-293287c1d7b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153218 Aug 31 00:45:12.269556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 914/1753] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:12 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:13.289950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a019d8cd-11cd-4f33-acb6-f9c730a4b216 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:13.290502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a019d8cd-11cd-4f33-acb6-f9c730a4b216 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:13.296984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a019d8cd-11cd-4f33-acb6-f9c730a4b216 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:13.297463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a019d8cd-11cd-4f33-acb6-f9c730a4b216 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:13.297902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a019d8cd-11cd-4f33-acb6-f9c730a4b216 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:13.298588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a019d8cd-11cd-4f33-acb6-f9c730a4b216 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:13.299060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a019d8cd-11cd-4f33-acb6-f9c730a4b216 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:13.299481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a019d8cd-11cd-4f33-acb6-f9c730a4b216 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:13.434057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a019d8cd-11cd-4f33-acb6-f9c730a4b216 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:13.442511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a019d8cd-11cd-4f33-acb6-f9c730a4b216 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156549 Aug 31 00:45:13.443096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 840/1754] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:13 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:14.464179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-05aceb29-a71f-4853-9a78-84bd70b6a531 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:14.466005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-05aceb29-a71f-4853-9a78-84bd70b6a531 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:14.473398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05aceb29-a71f-4853-9a78-84bd70b6a531 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:14.473870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05aceb29-a71f-4853-9a78-84bd70b6a531 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:14.474299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05aceb29-a71f-4853-9a78-84bd70b6a531 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:14.474984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05aceb29-a71f-4853-9a78-84bd70b6a531 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:14.475463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05aceb29-a71f-4853-9a78-84bd70b6a531 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:14.475878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05aceb29-a71f-4853-9a78-84bd70b6a531 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:14.606712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-05aceb29-a71f-4853-9a78-84bd70b6a531 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:14.615236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-05aceb29-a71f-4853-9a78-84bd70b6a531 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154797 Aug 31 00:45:14.615710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 915/1755] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:14 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:15.635458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6d94c9ce-1a4d-4802-8198-f104d50f6180 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:15.636067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6d94c9ce-1a4d-4802-8198-f104d50f6180 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:15.642806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d94c9ce-1a4d-4802-8198-f104d50f6180 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:15.643310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d94c9ce-1a4d-4802-8198-f104d50f6180 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:15.643740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d94c9ce-1a4d-4802-8198-f104d50f6180 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:15.644517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d94c9ce-1a4d-4802-8198-f104d50f6180 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:15.644969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d94c9ce-1a4d-4802-8198-f104d50f6180 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:15.645380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d94c9ce-1a4d-4802-8198-f104d50f6180 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:15.647911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=78 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:15.784327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6d94c9ce-1a4d-4802-8198-f104d50f6180 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:15.793377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6d94c9ce-1a4d-4802-8198-f104d50f6180 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.161393 Aug 31 00:45:15.794050 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 841/1756] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:15 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:16.815436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-459e2d8f-04be-4e0e-a7ae-49157b8e49c8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:16.816049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-459e2d8f-04be-4e0e-a7ae-49157b8e49c8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:16.822492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-459e2d8f-04be-4e0e-a7ae-49157b8e49c8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:16.822974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-459e2d8f-04be-4e0e-a7ae-49157b8e49c8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:16.823455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-459e2d8f-04be-4e0e-a7ae-49157b8e49c8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:16.824218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-459e2d8f-04be-4e0e-a7ae-49157b8e49c8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:16.824671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-459e2d8f-04be-4e0e-a7ae-49157b8e49c8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:16.825097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-459e2d8f-04be-4e0e-a7ae-49157b8e49c8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:16.952506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-459e2d8f-04be-4e0e-a7ae-49157b8e49c8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:16.960587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-459e2d8f-04be-4e0e-a7ae-49157b8e49c8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149207 Aug 31 00:45:16.961139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 916/1757] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:16 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:17.982600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2d0dbb30-5d1d-4250-9a73-47ba61eaa38e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:17.983542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2d0dbb30-5d1d-4250-9a73-47ba61eaa38e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:17.990077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d0dbb30-5d1d-4250-9a73-47ba61eaa38e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:17.990559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d0dbb30-5d1d-4250-9a73-47ba61eaa38e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:17.990991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d0dbb30-5d1d-4250-9a73-47ba61eaa38e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:17.991708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d0dbb30-5d1d-4250-9a73-47ba61eaa38e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:17.992156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d0dbb30-5d1d-4250-9a73-47ba61eaa38e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:17.992584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d0dbb30-5d1d-4250-9a73-47ba61eaa38e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:18.137626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d0dbb30-5d1d-4250-9a73-47ba61eaa38e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:18.146051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2d0dbb30-5d1d-4250-9a73-47ba61eaa38e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.167931 Aug 31 00:45:18.146642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 842/1758] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:17 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:19.168761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-25be2030-5fc7-4f55-b849-0728e146e882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:19.169637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-25be2030-5fc7-4f55-b849-0728e146e882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:19.176251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25be2030-5fc7-4f55-b849-0728e146e882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:19.176677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25be2030-5fc7-4f55-b849-0728e146e882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:19.177149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25be2030-5fc7-4f55-b849-0728e146e882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:19.177841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25be2030-5fc7-4f55-b849-0728e146e882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:19.178293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25be2030-5fc7-4f55-b849-0728e146e882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:19.178714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25be2030-5fc7-4f55-b849-0728e146e882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:19.310751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-25be2030-5fc7-4f55-b849-0728e146e882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:19.318945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-25be2030-5fc7-4f55-b849-0728e146e882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154642 Aug 31 00:45:19.319533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 917/1759] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:19 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:20.343541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4a4bc2d6-a391-4fef-bd3f-e9601e57670d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:20.344271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4a4bc2d6-a391-4fef-bd3f-e9601e57670d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:20.350976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a4bc2d6-a391-4fef-bd3f-e9601e57670d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:20.351493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a4bc2d6-a391-4fef-bd3f-e9601e57670d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:20.351926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a4bc2d6-a391-4fef-bd3f-e9601e57670d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:20.352618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a4bc2d6-a391-4fef-bd3f-e9601e57670d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:20.353068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a4bc2d6-a391-4fef-bd3f-e9601e57670d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:20.353488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a4bc2d6-a391-4fef-bd3f-e9601e57670d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:20.517023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4a4bc2d6-a391-4fef-bd3f-e9601e57670d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:20.525887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4a4bc2d6-a391-4fef-bd3f-e9601e57670d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.188658 Aug 31 00:45:20.526454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 843/1760] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:20 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:21.548185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e4787477-46f2-429d-9d35-49d1245cfc66 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:21.548787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e4787477-46f2-429d-9d35-49d1245cfc66 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:21.554865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4787477-46f2-429d-9d35-49d1245cfc66 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:21.555453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4787477-46f2-429d-9d35-49d1245cfc66 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:21.555895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4787477-46f2-429d-9d35-49d1245cfc66 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:21.556582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4787477-46f2-429d-9d35-49d1245cfc66 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:21.557031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4787477-46f2-429d-9d35-49d1245cfc66 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:21.557452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4787477-46f2-429d-9d35-49d1245cfc66 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:21.690856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e4787477-46f2-429d-9d35-49d1245cfc66 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:21.699097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e4787477-46f2-429d-9d35-49d1245cfc66 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155618 Aug 31 00:45:21.699784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 918/1761] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:21 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:22.720922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1b30cfed-1046-4d2d-8f4d-e39e33cf356c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:22.721563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1b30cfed-1046-4d2d-8f4d-e39e33cf356c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:22.728108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b30cfed-1046-4d2d-8f4d-e39e33cf356c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:22.728585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b30cfed-1046-4d2d-8f4d-e39e33cf356c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:22.729019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b30cfed-1046-4d2d-8f4d-e39e33cf356c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:22.729745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b30cfed-1046-4d2d-8f4d-e39e33cf356c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:22.730200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b30cfed-1046-4d2d-8f4d-e39e33cf356c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:22.731216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b30cfed-1046-4d2d-8f4d-e39e33cf356c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:22.860024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1b30cfed-1046-4d2d-8f4d-e39e33cf356c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:22.868206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1b30cfed-1046-4d2d-8f4d-e39e33cf356c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151059 Aug 31 00:45:22.868765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 844/1762] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:22 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:23.890315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-66c6c748-5a40-4fe1-833b-627e1a4b1cee tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:23.890933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-66c6c748-5a40-4fe1-833b-627e1a4b1cee tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:23.897109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66c6c748-5a40-4fe1-833b-627e1a4b1cee tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:23.897604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66c6c748-5a40-4fe1-833b-627e1a4b1cee tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:23.898039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66c6c748-5a40-4fe1-833b-627e1a4b1cee tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:23.898736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66c6c748-5a40-4fe1-833b-627e1a4b1cee tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:23.899230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66c6c748-5a40-4fe1-833b-627e1a4b1cee tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:23.899656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66c6c748-5a40-4fe1-833b-627e1a4b1cee tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:24.030151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-66c6c748-5a40-4fe1-833b-627e1a4b1cee tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:24.038340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-66c6c748-5a40-4fe1-833b-627e1a4b1cee tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152679 Aug 31 00:45:24.038911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 919/1763] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:23 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:25.060650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5ff5dee3-45ca-4697-812b-297974e9798a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:25.061192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5ff5dee3-45ca-4697-812b-297974e9798a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:25.067947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5dee3-45ca-4697-812b-297974e9798a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:25.068433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5dee3-45ca-4697-812b-297974e9798a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:25.068866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5dee3-45ca-4697-812b-297974e9798a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:25.070185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5dee3-45ca-4697-812b-297974e9798a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:25.070185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5dee3-45ca-4697-812b-297974e9798a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:25.070519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5dee3-45ca-4697-812b-297974e9798a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:25.209388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5ff5dee3-45ca-4697-812b-297974e9798a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:25.217993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5ff5dee3-45ca-4697-812b-297974e9798a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.161995 Aug 31 00:45:25.218555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 845/1764] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:25 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:26.239939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-27b44c49-9a8c-46b6-a388-3e81adfaa9e4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:26.240476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-27b44c49-9a8c-46b6-a388-3e81adfaa9e4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:26.247557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b44c49-9a8c-46b6-a388-3e81adfaa9e4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:26.248035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b44c49-9a8c-46b6-a388-3e81adfaa9e4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:26.248464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b44c49-9a8c-46b6-a388-3e81adfaa9e4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:26.249146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b44c49-9a8c-46b6-a388-3e81adfaa9e4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:26.249594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b44c49-9a8c-46b6-a388-3e81adfaa9e4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:26.250007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27b44c49-9a8c-46b6-a388-3e81adfaa9e4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:26.381337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-27b44c49-9a8c-46b6-a388-3e81adfaa9e4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:26.389876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-27b44c49-9a8c-46b6-a388-3e81adfaa9e4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153932 Aug 31 00:45:26.390424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 920/1765] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:26 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:27.410829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-940acef1-2119-43bc-9171-72f3a46eb465 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:27.411480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-940acef1-2119-43bc-9171-72f3a46eb465 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:27.417710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-940acef1-2119-43bc-9171-72f3a46eb465 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:27.418414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-940acef1-2119-43bc-9171-72f3a46eb465 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:27.418846 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-940acef1-2119-43bc-9171-72f3a46eb465 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:27.419633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-940acef1-2119-43bc-9171-72f3a46eb465 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:27.420074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-940acef1-2119-43bc-9171-72f3a46eb465 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:27.420493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-940acef1-2119-43bc-9171-72f3a46eb465 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:27.551031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-940acef1-2119-43bc-9171-72f3a46eb465 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:27.559878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-940acef1-2119-43bc-9171-72f3a46eb465 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152113 Aug 31 00:45:27.560432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 846/1766] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:27 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:28.581165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4fa4a52b-0a0f-4813-9f72-42809ec19cd9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:28.581776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4fa4a52b-0a0f-4813-9f72-42809ec19cd9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:28.588210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa4a52b-0a0f-4813-9f72-42809ec19cd9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:28.588687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa4a52b-0a0f-4813-9f72-42809ec19cd9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:28.589117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa4a52b-0a0f-4813-9f72-42809ec19cd9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:28.589799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa4a52b-0a0f-4813-9f72-42809ec19cd9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:28.590983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa4a52b-0a0f-4813-9f72-42809ec19cd9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:28.591426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa4a52b-0a0f-4813-9f72-42809ec19cd9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:28.722230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4fa4a52b-0a0f-4813-9f72-42809ec19cd9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:28.730469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4fa4a52b-0a0f-4813-9f72-42809ec19cd9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153116 Aug 31 00:45:28.731220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 921/1767] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:28 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:29.753505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1d7ae33a-065d-44e6-baee-e21f3109b0d5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:29.754110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1d7ae33a-065d-44e6-baee-e21f3109b0d5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:29.760525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1d7ae33a-065d-44e6-baee-e21f3109b0d5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:29.761000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1d7ae33a-065d-44e6-baee-e21f3109b0d5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:29.761436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1d7ae33a-065d-44e6-baee-e21f3109b0d5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:29.762116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1d7ae33a-065d-44e6-baee-e21f3109b0d5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:29.762558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1d7ae33a-065d-44e6-baee-e21f3109b0d5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:29.762975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1d7ae33a-065d-44e6-baee-e21f3109b0d5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:29.900631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1d7ae33a-065d-44e6-baee-e21f3109b0d5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:29.909586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1d7ae33a-065d-44e6-baee-e21f3109b0d5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.160074 Aug 31 00:45:29.910144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 847/1768] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:29 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:30.931123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed93b913-c54c-4b3d-8404-6376f5cdb497 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:30.931718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ed93b913-c54c-4b3d-8404-6376f5cdb497 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:30.938124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed93b913-c54c-4b3d-8404-6376f5cdb497 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:30.938603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed93b913-c54c-4b3d-8404-6376f5cdb497 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:30.939046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed93b913-c54c-4b3d-8404-6376f5cdb497 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:30.939741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed93b913-c54c-4b3d-8404-6376f5cdb497 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:30.940187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed93b913-c54c-4b3d-8404-6376f5cdb497 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:30.940604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed93b913-c54c-4b3d-8404-6376f5cdb497 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:31.073232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ed93b913-c54c-4b3d-8404-6376f5cdb497 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:31.082422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ed93b913-c54c-4b3d-8404-6376f5cdb497 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155132 Aug 31 00:45:31.082988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 922/1769] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:30 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:32.105122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3f2bd85a-06a3-4eb9-9653-5af8cac3aecf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:32.105730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3f2bd85a-06a3-4eb9-9653-5af8cac3aecf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:32.109036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=26 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:32.114397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f2bd85a-06a3-4eb9-9653-5af8cac3aecf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:32.114881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f2bd85a-06a3-4eb9-9653-5af8cac3aecf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:32.115346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f2bd85a-06a3-4eb9-9653-5af8cac3aecf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:32.116036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f2bd85a-06a3-4eb9-9653-5af8cac3aecf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:32.116487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f2bd85a-06a3-4eb9-9653-5af8cac3aecf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:32.116910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f2bd85a-06a3-4eb9-9653-5af8cac3aecf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:32.249415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3f2bd85a-06a3-4eb9-9653-5af8cac3aecf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:32.257401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3f2bd85a-06a3-4eb9-9653-5af8cac3aecf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156169 Aug 31 00:45:32.257960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 848/1770] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:32 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:33.278983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b7a7e6d2-fa1d-43ba-9b8b-ad4c62e6aa6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:33.279866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b7a7e6d2-fa1d-43ba-9b8b-ad4c62e6aa6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:33.286670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7a7e6d2-fa1d-43ba-9b8b-ad4c62e6aa6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:33.287194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7a7e6d2-fa1d-43ba-9b8b-ad4c62e6aa6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:33.287632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7a7e6d2-fa1d-43ba-9b8b-ad4c62e6aa6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:33.288328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7a7e6d2-fa1d-43ba-9b8b-ad4c62e6aa6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:33.288778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7a7e6d2-fa1d-43ba-9b8b-ad4c62e6aa6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:33.289195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b7a7e6d2-fa1d-43ba-9b8b-ad4c62e6aa6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:33.430190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b7a7e6d2-fa1d-43ba-9b8b-ad4c62e6aa6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:33.442652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b7a7e6d2-fa1d-43ba-9b8b-ad4c62e6aa6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.167232 Aug 31 00:45:33.443567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 923/1771] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:33 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:34.470456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6e0deb4e-c5ed-45d4-a4ae-1120619191ac tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:34.471234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6e0deb4e-c5ed-45d4-a4ae-1120619191ac tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:34.477561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e0deb4e-c5ed-45d4-a4ae-1120619191ac tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:34.478027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e0deb4e-c5ed-45d4-a4ae-1120619191ac tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:34.478446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e0deb4e-c5ed-45d4-a4ae-1120619191ac tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:34.479157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e0deb4e-c5ed-45d4-a4ae-1120619191ac tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:34.479603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e0deb4e-c5ed-45d4-a4ae-1120619191ac tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:34.480015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e0deb4e-c5ed-45d4-a4ae-1120619191ac tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:34.609761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6e0deb4e-c5ed-45d4-a4ae-1120619191ac tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:34.617893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6e0deb4e-c5ed-45d4-a4ae-1120619191ac tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152131 Aug 31 00:45:34.618450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 849/1772] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:34 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:35.640243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f7c5079e-1d56-4929-a07b-2f19ea1badfb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:35.640793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f7c5079e-1d56-4929-a07b-2f19ea1badfb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:35.643149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=26 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:35.648344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c5079e-1d56-4929-a07b-2f19ea1badfb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:35.648824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c5079e-1d56-4929-a07b-2f19ea1badfb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:35.649255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c5079e-1d56-4929-a07b-2f19ea1badfb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:35.649939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c5079e-1d56-4929-a07b-2f19ea1badfb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:35.650385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c5079e-1d56-4929-a07b-2f19ea1badfb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:35.650803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c5079e-1d56-4929-a07b-2f19ea1badfb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:35.787466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f7c5079e-1d56-4929-a07b-2f19ea1badfb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:35.796515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f7c5079e-1d56-4929-a07b-2f19ea1badfb tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.160713 Aug 31 00:45:35.797086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 924/1773] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:35 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:36.821529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8cda9d54-79a8-4939-8f7e-a7b962df8498 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:36.822559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8cda9d54-79a8-4939-8f7e-a7b962df8498 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:36.830050 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cda9d54-79a8-4939-8f7e-a7b962df8498 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:36.830532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cda9d54-79a8-4939-8f7e-a7b962df8498 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:36.830986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cda9d54-79a8-4939-8f7e-a7b962df8498 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:36.831717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cda9d54-79a8-4939-8f7e-a7b962df8498 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:36.832169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cda9d54-79a8-4939-8f7e-a7b962df8498 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:36.832595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cda9d54-79a8-4939-8f7e-a7b962df8498 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:36.962129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8cda9d54-79a8-4939-8f7e-a7b962df8498 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:36.975279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8cda9d54-79a8-4939-8f7e-a7b962df8498 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156062 Aug 31 00:45:36.975279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 850/1774] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:36 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:37.993255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c805f4a5-440e-4803-9014-c891d9a51e9a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:37.993898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c805f4a5-440e-4803-9014-c891d9a51e9a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:38.000817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c805f4a5-440e-4803-9014-c891d9a51e9a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:38.001293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c805f4a5-440e-4803-9014-c891d9a51e9a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:38.001711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c805f4a5-440e-4803-9014-c891d9a51e9a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:38.002395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c805f4a5-440e-4803-9014-c891d9a51e9a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:38.002837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c805f4a5-440e-4803-9014-c891d9a51e9a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:38.003273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c805f4a5-440e-4803-9014-c891d9a51e9a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:38.005960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=78 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:38.131789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c805f4a5-440e-4803-9014-c891d9a51e9a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:38.139882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c805f4a5-440e-4803-9014-c891d9a51e9a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150508 Aug 31 00:45:38.140446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 925/1775] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:37 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:39.162309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5823f96f-7158-436b-be24-544ce8b27168 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:39.162912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5823f96f-7158-436b-be24-544ce8b27168 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:39.168907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5823f96f-7158-436b-be24-544ce8b27168 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:39.169374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5823f96f-7158-436b-be24-544ce8b27168 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:39.169819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5823f96f-7158-436b-be24-544ce8b27168 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:39.170588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5823f96f-7158-436b-be24-544ce8b27168 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:39.171054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5823f96f-7158-436b-be24-544ce8b27168 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:39.171464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5823f96f-7158-436b-be24-544ce8b27168 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:39.301324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5823f96f-7158-436b-be24-544ce8b27168 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:39.309512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5823f96f-7158-436b-be24-544ce8b27168 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151872 Aug 31 00:45:39.310049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 851/1776] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:39 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:40.331561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-139cf20d-79a9-4699-9888-5fdb42625c14 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:40.332162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-139cf20d-79a9-4699-9888-5fdb42625c14 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:40.338482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-139cf20d-79a9-4699-9888-5fdb42625c14 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:40.338952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-139cf20d-79a9-4699-9888-5fdb42625c14 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:40.339416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-139cf20d-79a9-4699-9888-5fdb42625c14 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:40.340086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-139cf20d-79a9-4699-9888-5fdb42625c14 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:40.340528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-139cf20d-79a9-4699-9888-5fdb42625c14 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:40.340936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-139cf20d-79a9-4699-9888-5fdb42625c14 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:40.469877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-139cf20d-79a9-4699-9888-5fdb42625c14 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:40.478128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-139cf20d-79a9-4699-9888-5fdb42625c14 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150394 Aug 31 00:45:40.478693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 926/1777] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:40 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:41.500609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-69226409-5dc5-42bc-8243-fc2a1bcc2fa7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:41.501218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-69226409-5dc5-42bc-8243-fc2a1bcc2fa7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:41.507735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69226409-5dc5-42bc-8243-fc2a1bcc2fa7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:41.508219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69226409-5dc5-42bc-8243-fc2a1bcc2fa7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:41.508653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69226409-5dc5-42bc-8243-fc2a1bcc2fa7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:41.509348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69226409-5dc5-42bc-8243-fc2a1bcc2fa7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:41.509798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69226409-5dc5-42bc-8243-fc2a1bcc2fa7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:41.510221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69226409-5dc5-42bc-8243-fc2a1bcc2fa7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:41.642303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-69226409-5dc5-42bc-8243-fc2a1bcc2fa7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:41.650431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-69226409-5dc5-42bc-8243-fc2a1bcc2fa7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154073 Aug 31 00:45:41.650992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 852/1778] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:41 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:42.672896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5f30c780-5bbe-4f69-9d57-aa122404194b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:42.673480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5f30c780-5bbe-4f69-9d57-aa122404194b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:42.679825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f30c780-5bbe-4f69-9d57-aa122404194b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:42.680296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f30c780-5bbe-4f69-9d57-aa122404194b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:42.680720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f30c780-5bbe-4f69-9d57-aa122404194b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:42.681391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f30c780-5bbe-4f69-9d57-aa122404194b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:42.681832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f30c780-5bbe-4f69-9d57-aa122404194b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:42.682248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f30c780-5bbe-4f69-9d57-aa122404194b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:42.814456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f30c780-5bbe-4f69-9d57-aa122404194b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:42.822829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5f30c780-5bbe-4f69-9d57-aa122404194b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154373 Aug 31 00:45:42.823425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 927/1779] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:42 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:43.845613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e1feee97-d7de-4047-8f1c-464b91021e3a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:43.846213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e1feee97-d7de-4047-8f1c-464b91021e3a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:43.852680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1feee97-d7de-4047-8f1c-464b91021e3a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:43.853153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1feee97-d7de-4047-8f1c-464b91021e3a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:43.853580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1feee97-d7de-4047-8f1c-464b91021e3a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:43.854271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1feee97-d7de-4047-8f1c-464b91021e3a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:43.854713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1feee97-d7de-4047-8f1c-464b91021e3a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:43.855152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1feee97-d7de-4047-8f1c-464b91021e3a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:43.989094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1feee97-d7de-4047-8f1c-464b91021e3a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:43.997838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e1feee97-d7de-4047-8f1c-464b91021e3a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156840 Aug 31 00:45:43.998417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 853/1780] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:43 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:45.019932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-35416be8-0d73-4bc8-96ff-cad8e8cb3e6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:45.020538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-35416be8-0d73-4bc8-96ff-cad8e8cb3e6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:45.026919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35416be8-0d73-4bc8-96ff-cad8e8cb3e6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:45.027435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35416be8-0d73-4bc8-96ff-cad8e8cb3e6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:45.027869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35416be8-0d73-4bc8-96ff-cad8e8cb3e6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:45.028594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35416be8-0d73-4bc8-96ff-cad8e8cb3e6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:45.029047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35416be8-0d73-4bc8-96ff-cad8e8cb3e6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:45.029467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35416be8-0d73-4bc8-96ff-cad8e8cb3e6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:45.159265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-35416be8-0d73-4bc8-96ff-cad8e8cb3e6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:45.167476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-35416be8-0d73-4bc8-96ff-cad8e8cb3e6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151472 Aug 31 00:45:45.168043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 928/1781] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:45 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:46.189213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e08c0a4e-cbbe-49d0-b270-09121fea2329 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:46.189814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e08c0a4e-cbbe-49d0-b270-09121fea2329 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:46.196405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08c0a4e-cbbe-49d0-b270-09121fea2329 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:46.196813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08c0a4e-cbbe-49d0-b270-09121fea2329 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:46.197238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08c0a4e-cbbe-49d0-b270-09121fea2329 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:46.197930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08c0a4e-cbbe-49d0-b270-09121fea2329 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:46.198376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08c0a4e-cbbe-49d0-b270-09121fea2329 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:46.198786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08c0a4e-cbbe-49d0-b270-09121fea2329 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:46.202780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=78 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:46.329903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e08c0a4e-cbbe-49d0-b270-09121fea2329 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:46.338235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e08c0a4e-cbbe-49d0-b270-09121fea2329 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152986 Aug 31 00:45:46.338795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 854/1782] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:46 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:47.359352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6f40df06-5fb0-40c5-9f11-02b1e93d4c63 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:47.359959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6f40df06-5fb0-40c5-9f11-02b1e93d4c63 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:47.366430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f40df06-5fb0-40c5-9f11-02b1e93d4c63 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:47.366914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f40df06-5fb0-40c5-9f11-02b1e93d4c63 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:47.367380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f40df06-5fb0-40c5-9f11-02b1e93d4c63 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:47.368073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f40df06-5fb0-40c5-9f11-02b1e93d4c63 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:47.368526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f40df06-5fb0-40c5-9f11-02b1e93d4c63 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:47.368948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f40df06-5fb0-40c5-9f11-02b1e93d4c63 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:47.506223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6f40df06-5fb0-40c5-9f11-02b1e93d4c63 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:47.514936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6f40df06-5fb0-40c5-9f11-02b1e93d4c63 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159194 Aug 31 00:45:47.515537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 929/1783] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:47 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:48.536776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e5b85829-aaa6-4011-abf5-26075624636e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:48.537323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e5b85829-aaa6-4011-abf5-26075624636e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:48.543743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5b85829-aaa6-4011-abf5-26075624636e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:48.544214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5b85829-aaa6-4011-abf5-26075624636e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:48.544638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5b85829-aaa6-4011-abf5-26075624636e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:48.545329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5b85829-aaa6-4011-abf5-26075624636e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:48.545852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5b85829-aaa6-4011-abf5-26075624636e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:48.546272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5b85829-aaa6-4011-abf5-26075624636e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:48.678509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e5b85829-aaa6-4011-abf5-26075624636e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:48.687437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e5b85829-aaa6-4011-abf5-26075624636e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154758 Aug 31 00:45:48.688010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 855/1784] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:48 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:49.708084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9f26f44f-ff57-473c-9e61-1274e8f6821e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:49.708679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9f26f44f-ff57-473c-9e61-1274e8f6821e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:49.715290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f26f44f-ff57-473c-9e61-1274e8f6821e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:49.715762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f26f44f-ff57-473c-9e61-1274e8f6821e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:49.716182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f26f44f-ff57-473c-9e61-1274e8f6821e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:49.716853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f26f44f-ff57-473c-9e61-1274e8f6821e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:49.717292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f26f44f-ff57-473c-9e61-1274e8f6821e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:49.717779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f26f44f-ff57-473c-9e61-1274e8f6821e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:49.850754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9f26f44f-ff57-473c-9e61-1274e8f6821e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:49.859953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9f26f44f-ff57-473c-9e61-1274e8f6821e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155655 Aug 31 00:45:49.860745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 930/1785] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:49 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:50.881967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7316b78c-2c67-44f7-a7da-d52e36558185 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:50.882574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7316b78c-2c67-44f7-a7da-d52e36558185 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:50.889059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7316b78c-2c67-44f7-a7da-d52e36558185 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:50.889540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7316b78c-2c67-44f7-a7da-d52e36558185 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:50.890010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7316b78c-2c67-44f7-a7da-d52e36558185 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:50.891522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7316b78c-2c67-44f7-a7da-d52e36558185 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:50.891982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7316b78c-2c67-44f7-a7da-d52e36558185 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:50.892406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7316b78c-2c67-44f7-a7da-d52e36558185 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:51.019850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7316b78c-2c67-44f7-a7da-d52e36558185 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:51.028074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7316b78c-2c67-44f7-a7da-d52e36558185 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150589 Aug 31 00:45:51.028635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 856/1786] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:50 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:52.049195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67f6a8ef-0542-4f04-88a0-61559024fe33 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:52.049820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-67f6a8ef-0542-4f04-88a0-61559024fe33 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:52.055714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f6a8ef-0542-4f04-88a0-61559024fe33 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:52.056189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f6a8ef-0542-4f04-88a0-61559024fe33 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:52.056615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f6a8ef-0542-4f04-88a0-61559024fe33 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:52.057288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f6a8ef-0542-4f04-88a0-61559024fe33 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:52.057729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f6a8ef-0542-4f04-88a0-61559024fe33 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:52.058140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f6a8ef-0542-4f04-88a0-61559024fe33 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:52.189950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67f6a8ef-0542-4f04-88a0-61559024fe33 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:52.198121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67f6a8ef-0542-4f04-88a0-61559024fe33 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152959 Aug 31 00:45:52.198686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 931/1787] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:52 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:53.219394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9ce6243d-4c3b-4aba-8172-16b1c0c43677 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:53.220078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9ce6243d-4c3b-4aba-8172-16b1c0c43677 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:53.226450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ce6243d-4c3b-4aba-8172-16b1c0c43677 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:53.226932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ce6243d-4c3b-4aba-8172-16b1c0c43677 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:53.227404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ce6243d-4c3b-4aba-8172-16b1c0c43677 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:53.228092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ce6243d-4c3b-4aba-8172-16b1c0c43677 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:53.228543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ce6243d-4c3b-4aba-8172-16b1c0c43677 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:53.228968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ce6243d-4c3b-4aba-8172-16b1c0c43677 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:53.359952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9ce6243d-4c3b-4aba-8172-16b1c0c43677 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:53.368243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9ce6243d-4c3b-4aba-8172-16b1c0c43677 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152969 Aug 31 00:45:53.368999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 857/1788] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:53 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:54.389997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2e558c8a-9e06-4079-86be-a9f101765d57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:54.390724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2e558c8a-9e06-4079-86be-a9f101765d57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:54.397210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e558c8a-9e06-4079-86be-a9f101765d57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:54.397692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e558c8a-9e06-4079-86be-a9f101765d57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:54.398131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e558c8a-9e06-4079-86be-a9f101765d57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:54.398818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e558c8a-9e06-4079-86be-a9f101765d57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:54.399296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e558c8a-9e06-4079-86be-a9f101765d57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:54.399717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e558c8a-9e06-4079-86be-a9f101765d57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:54.532301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2e558c8a-9e06-4079-86be-a9f101765d57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:54.540461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2e558c8a-9e06-4079-86be-a9f101765d57 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154536 Aug 31 00:45:54.541020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 932/1789] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:54 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:45:55.561267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5a28f49d-241e-4bc2-a4c4-7891f279cb29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:55.561927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5a28f49d-241e-4bc2-a4c4-7891f279cb29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:55.568472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a28f49d-241e-4bc2-a4c4-7891f279cb29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:55.569059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a28f49d-241e-4bc2-a4c4-7891f279cb29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:55.569487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a28f49d-241e-4bc2-a4c4-7891f279cb29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:55.570161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a28f49d-241e-4bc2-a4c4-7891f279cb29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:55.570602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a28f49d-241e-4bc2-a4c4-7891f279cb29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:55.571016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a28f49d-241e-4bc2-a4c4-7891f279cb29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:55.703896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5a28f49d-241e-4bc2-a4c4-7891f279cb29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:55.712019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5a28f49d-241e-4bc2-a4c4-7891f279cb29 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154546 Aug 31 00:45:55.712577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 858/1790] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:55 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:56.733176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-122fa1ee-36d4-4061-89ef-2b2425624ad5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:56.734079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-122fa1ee-36d4-4061-89ef-2b2425624ad5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:56.740443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-122fa1ee-36d4-4061-89ef-2b2425624ad5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:56.740921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-122fa1ee-36d4-4061-89ef-2b2425624ad5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:56.741352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-122fa1ee-36d4-4061-89ef-2b2425624ad5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:56.742034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-122fa1ee-36d4-4061-89ef-2b2425624ad5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:56.742481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-122fa1ee-36d4-4061-89ef-2b2425624ad5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:56.742896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-122fa1ee-36d4-4061-89ef-2b2425624ad5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:56.872130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-122fa1ee-36d4-4061-89ef-2b2425624ad5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:56.880500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-122fa1ee-36d4-4061-89ef-2b2425624ad5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151170 Aug 31 00:45:56.881062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 933/1791] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:56 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:57.900915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c37e9a84-e522-4ddc-82ff-84f47312b260 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:57.901520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c37e9a84-e522-4ddc-82ff-84f47312b260 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:57.908206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c37e9a84-e522-4ddc-82ff-84f47312b260 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:57.908677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c37e9a84-e522-4ddc-82ff-84f47312b260 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:57.909100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c37e9a84-e522-4ddc-82ff-84f47312b260 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:57.909777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c37e9a84-e522-4ddc-82ff-84f47312b260 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:57.910220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c37e9a84-e522-4ddc-82ff-84f47312b260 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:57.910633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c37e9a84-e522-4ddc-82ff-84f47312b260 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:58.051406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c37e9a84-e522-4ddc-82ff-84f47312b260 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:58.059526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c37e9a84-e522-4ddc-82ff-84f47312b260 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.162419 Aug 31 00:45:58.060082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 859/1792] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:57 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:59.081450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7f2ba632-1a78-4602-b58f-045a4cc15638 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:59.082053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7f2ba632-1a78-4602-b58f-045a4cc15638 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:59.088472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f2ba632-1a78-4602-b58f-045a4cc15638 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:59.088951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f2ba632-1a78-4602-b58f-045a4cc15638 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:59.089380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f2ba632-1a78-4602-b58f-045a4cc15638 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:59.090069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f2ba632-1a78-4602-b58f-045a4cc15638 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:59.090516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f2ba632-1a78-4602-b58f-045a4cc15638 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:59.090932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f2ba632-1a78-4602-b58f-045a4cc15638 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:59.223259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7f2ba632-1a78-4602-b58f-045a4cc15638 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:59.231506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7f2ba632-1a78-4602-b58f-045a4cc15638 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154048 Aug 31 00:45:59.232058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 934/1793] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:59 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:00.253687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7aba82a7-7673-4ac7-94c2-9e268dfa79d0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:00.254441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7aba82a7-7673-4ac7-94c2-9e268dfa79d0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:00.257032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:46:00.257160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:46:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 (ip 10.222.0.67) !!! Aug 31 00:46:00.258411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:46:00.258805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:46:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 (ip 10.222.0.67) !!! Aug 31 00:46:00.263100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-73000b8e-c9ef-46c2-a81e-8bc147fa3a61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:00.263601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-73000b8e-c9ef-46c2-a81e-8bc147fa3a61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:00.263705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aba82a7-7673-4ac7-94c2-9e268dfa79d0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.264126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aba82a7-7673-4ac7-94c2-9e268dfa79d0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.264562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aba82a7-7673-4ac7-94c2-9e268dfa79d0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.265930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aba82a7-7673-4ac7-94c2-9e268dfa79d0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.266435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aba82a7-7673-4ac7-94c2-9e268dfa79d0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.266863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7aba82a7-7673-4ac7-94c2-9e268dfa79d0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.271979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73000b8e-c9ef-46c2-a81e-8bc147fa3a61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.272464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73000b8e-c9ef-46c2-a81e-8bc147fa3a61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.272934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73000b8e-c9ef-46c2-a81e-8bc147fa3a61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.273633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73000b8e-c9ef-46c2-a81e-8bc147fa3a61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.274085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73000b8e-c9ef-46c2-a81e-8bc147fa3a61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.274505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73000b8e-c9ef-46c2-a81e-8bc147fa3a61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.301159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-73000b8e-c9ef-46c2-a81e-8bc147fa3a61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:46:00.384925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-73000b8e-c9ef-46c2-a81e-8bc147fa3a61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 204 len: 0 microversion: 2.1 time: 0.127568 Aug 31 00:46:00.385805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 935/1794] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:46:00 2022] DELETE /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:46:00.396196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fc61965a-b590-4da7-8a7a-b08ccba9d3f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:00.396885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fc61965a-b590-4da7-8a7a-b08ccba9d3f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:00.402633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc61965a-b590-4da7-8a7a-b08ccba9d3f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.403162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc61965a-b590-4da7-8a7a-b08ccba9d3f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.403590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc61965a-b590-4da7-8a7a-b08ccba9d3f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.404302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc61965a-b590-4da7-8a7a-b08ccba9d3f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.404705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc61965a-b590-4da7-8a7a-b08ccba9d3f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.405114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc61965a-b590-4da7-8a7a-b08ccba9d3f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.408041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7aba82a7-7673-4ac7-94c2-9e268dfa79d0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:00.417022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7aba82a7-7673-4ac7-94c2-9e268dfa79d0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.167365 Aug 31 00:46:00.417845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 860/1795] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:00 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:00.541074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fc61965a-b590-4da7-8a7a-b08ccba9d3f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:00.549968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fc61965a-b590-4da7-8a7a-b08ccba9d3f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1720 microversion: 2.1 time: 0.157883 Aug 31 00:46:00.550533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 936/1796] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:01.439710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-22d8687b-3bba-45a6-8616-6ac5f63e2b24 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:01.440310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-22d8687b-3bba-45a6-8616-6ac5f63e2b24 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:01.446644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d8687b-3bba-45a6-8616-6ac5f63e2b24 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:01.447156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d8687b-3bba-45a6-8616-6ac5f63e2b24 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:01.447585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d8687b-3bba-45a6-8616-6ac5f63e2b24 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:01.448264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d8687b-3bba-45a6-8616-6ac5f63e2b24 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:01.448704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d8687b-3bba-45a6-8616-6ac5f63e2b24 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:01.449114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d8687b-3bba-45a6-8616-6ac5f63e2b24 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:01.572434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4af0187-b4b9-4305-8e6e-eb0d6fbe51f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:01.573074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4af0187-b4b9-4305-8e6e-eb0d6fbe51f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:01.580721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4af0187-b4b9-4305-8e6e-eb0d6fbe51f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:01.581523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4af0187-b4b9-4305-8e6e-eb0d6fbe51f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:01.581966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4af0187-b4b9-4305-8e6e-eb0d6fbe51f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:01.582671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4af0187-b4b9-4305-8e6e-eb0d6fbe51f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:01.583328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4af0187-b4b9-4305-8e6e-eb0d6fbe51f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:01.583756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4af0187-b4b9-4305-8e6e-eb0d6fbe51f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:01.590611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-22d8687b-3bba-45a6-8616-6ac5f63e2b24 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:01.600624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-22d8687b-3bba-45a6-8616-6ac5f63e2b24 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.164779 Aug 31 00:46:01.601296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 861/1797] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:01 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:01.824429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f4af0187-b4b9-4305-8e6e-eb0d6fbe51f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:01.834443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4af0187-b4b9-4305-8e6e-eb0d6fbe51f8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1720 microversion: 2.1 time: 0.266164 Aug 31 00:46:01.835105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 937/1798] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:01 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:02.623277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-db2ed813-90f8-4198-9c6e-a946bb908038 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:02.623940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-db2ed813-90f8-4198-9c6e-a946bb908038 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:02.630446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db2ed813-90f8-4198-9c6e-a946bb908038 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:02.630931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db2ed813-90f8-4198-9c6e-a946bb908038 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:02.631391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db2ed813-90f8-4198-9c6e-a946bb908038 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:02.632089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db2ed813-90f8-4198-9c6e-a946bb908038 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:02.632585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db2ed813-90f8-4198-9c6e-a946bb908038 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:02.632942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db2ed813-90f8-4198-9c6e-a946bb908038 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:02.743905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-3979ae2f-6a0d-47c3-998e-7224ff618a95 req-cda5302d-5901-47ec-9830-e7bf6c297a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7854a5f-0fae-40f3-a7d2-a2bdb829e851", "name": "network-vif-deleted", "tag": "49190300-5cb3-462c-ba24-576656255826"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:46:02.749030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=28 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:02.756610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3979ae2f-6a0d-47c3-998e-7224ff618a95 req-cda5302d-5901-47ec-9830-e7bf6c297a9f service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:02.757167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3979ae2f-6a0d-47c3-998e-7224ff618a95 req-cda5302d-5901-47ec-9830-e7bf6c297a9f service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:02.757708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3979ae2f-6a0d-47c3-998e-7224ff618a95 req-cda5302d-5901-47ec-9830-e7bf6c297a9f service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:02.771217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-3979ae2f-6a0d-47c3-998e-7224ff618a95 req-cda5302d-5901-47ec-9830-e7bf6c297a9f service nova] Creating event network-vif-deleted:49190300-5cb3-462c-ba24-576656255826 for instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 on hv-cinder-85506 Aug 31 00:46:02.777429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-3979ae2f-6a0d-47c3-998e-7224ff618a95 req-cda5302d-5901-47ec-9830-e7bf6c297a9f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222741 Aug 31 00:46:02.778452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 862/1799] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:46:02.821930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-db2ed813-90f8-4198-9c6e-a946bb908038 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:02.832086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-db2ed813-90f8-4198-9c6e-a946bb908038 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.213454 Aug 31 00:46:02.833065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 938/1800] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:02 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:02.866838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5577a8da-e622-4e13-b2d1-092a112d333f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:02.867558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5577a8da-e622-4e13-b2d1-092a112d333f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:02.874235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5577a8da-e622-4e13-b2d1-092a112d333f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:02.874891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5577a8da-e622-4e13-b2d1-092a112d333f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:02.875320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5577a8da-e622-4e13-b2d1-092a112d333f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:02.876018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5577a8da-e622-4e13-b2d1-092a112d333f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:02.876465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5577a8da-e622-4e13-b2d1-092a112d333f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:02.877494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5577a8da-e622-4e13-b2d1-092a112d333f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:02.939608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5577a8da-e622-4e13-b2d1-092a112d333f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:02.947758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5577a8da-e622-4e13-b2d1-092a112d333f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085176 Aug 31 00:46:02.948336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 863/1801] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:02 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:03.854613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-619c597f-772f-4e58-a026-423b5d36a010 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:03.855267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-619c597f-772f-4e58-a026-423b5d36a010 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:03.864360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-619c597f-772f-4e58-a026-423b5d36a010 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:03.865216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-619c597f-772f-4e58-a026-423b5d36a010 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:03.865993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-619c597f-772f-4e58-a026-423b5d36a010 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:03.866866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-619c597f-772f-4e58-a026-423b5d36a010 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:03.867330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-619c597f-772f-4e58-a026-423b5d36a010 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:03.869342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-619c597f-772f-4e58-a026-423b5d36a010 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:03.969716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0cce6b64-ec4a-4e95-9114-f222bffd697e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:03.970388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0cce6b64-ec4a-4e95-9114-f222bffd697e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:03.977548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cce6b64-ec4a-4e95-9114-f222bffd697e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:03.978031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cce6b64-ec4a-4e95-9114-f222bffd697e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:03.978469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cce6b64-ec4a-4e95-9114-f222bffd697e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:03.979196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cce6b64-ec4a-4e95-9114-f222bffd697e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:03.979644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cce6b64-ec4a-4e95-9114-f222bffd697e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:03.980061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cce6b64-ec4a-4e95-9114-f222bffd697e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:04.070122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0cce6b64-ec4a-4e95-9114-f222bffd697e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:04.079481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0cce6b64-ec4a-4e95-9114-f222bffd697e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.114190 Aug 31 00:46:04.080248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 864/1802] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:03 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:04.114813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-619c597f-772f-4e58-a026-423b5d36a010 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:04.122986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-619c597f-772f-4e58-a026-423b5d36a010 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.273034 Aug 31 00:46:04.123590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 939/1803] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:03 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:05.100647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7728a4d6-ddb7-45f3-8015-969badfc25e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:05.101257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7728a4d6-ddb7-45f3-8015-969badfc25e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:05.107713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7728a4d6-ddb7-45f3-8015-969badfc25e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:05.108192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7728a4d6-ddb7-45f3-8015-969badfc25e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:05.108626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7728a4d6-ddb7-45f3-8015-969badfc25e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:05.110492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7728a4d6-ddb7-45f3-8015-969badfc25e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:05.110953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7728a4d6-ddb7-45f3-8015-969badfc25e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:05.111407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7728a4d6-ddb7-45f3-8015-969badfc25e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:05.145963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04d2a144-c9cb-41ed-a4b0-be091cae2cb5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:05.146558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-04d2a144-c9cb-41ed-a4b0-be091cae2cb5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:05.153181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d2a144-c9cb-41ed-a4b0-be091cae2cb5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:05.153660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d2a144-c9cb-41ed-a4b0-be091cae2cb5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:05.154087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d2a144-c9cb-41ed-a4b0-be091cae2cb5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:05.154775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d2a144-c9cb-41ed-a4b0-be091cae2cb5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:05.155252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d2a144-c9cb-41ed-a4b0-be091cae2cb5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:05.156183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04d2a144-c9cb-41ed-a4b0-be091cae2cb5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:05.159049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:05.173573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7728a4d6-ddb7-45f3-8015-969badfc25e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:05.181621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7728a4d6-ddb7-45f3-8015-969badfc25e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085001 Aug 31 00:46:05.182185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 865/1804] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:05 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:05.526318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-04d2a144-c9cb-41ed-a4b0-be091cae2cb5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:05.535329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-04d2a144-c9cb-41ed-a4b0-be091cae2cb5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.393159 Aug 31 00:46:05.535892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 940/1805] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:05 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:06.204821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4783ab85-60da-4b20-aadc-87bb1d3b32c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:06.205423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4783ab85-60da-4b20-aadc-87bb1d3b32c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:06.212109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4783ab85-60da-4b20-aadc-87bb1d3b32c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:06.212588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4783ab85-60da-4b20-aadc-87bb1d3b32c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:06.213020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4783ab85-60da-4b20-aadc-87bb1d3b32c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:06.213705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4783ab85-60da-4b20-aadc-87bb1d3b32c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:06.214152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4783ab85-60da-4b20-aadc-87bb1d3b32c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:06.214574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4783ab85-60da-4b20-aadc-87bb1d3b32c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:06.291413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4783ab85-60da-4b20-aadc-87bb1d3b32c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:06.299930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4783ab85-60da-4b20-aadc-87bb1d3b32c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.100310 Aug 31 00:46:06.300498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 866/1806] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:06 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:06.556510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d2e429ab-1e17-4af1-a626-e718f4678fb6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:06.557059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d2e429ab-1e17-4af1-a626-e718f4678fb6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:06.559310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:06.565494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2e429ab-1e17-4af1-a626-e718f4678fb6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:06.565980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2e429ab-1e17-4af1-a626-e718f4678fb6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:06.566416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2e429ab-1e17-4af1-a626-e718f4678fb6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:06.567146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2e429ab-1e17-4af1-a626-e718f4678fb6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:06.567602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2e429ab-1e17-4af1-a626-e718f4678fb6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:06.568022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2e429ab-1e17-4af1-a626-e718f4678fb6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:06.708100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d2e429ab-1e17-4af1-a626-e718f4678fb6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:06.716204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d2e429ab-1e17-4af1-a626-e718f4678fb6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.163633 Aug 31 00:46:06.716799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 941/1807] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:06 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:07.321104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e7d7942e-3d65-4e89-b247-38b75a9dafb5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:07.321645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e7d7942e-3d65-4e89-b247-38b75a9dafb5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:07.328047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7d7942e-3d65-4e89-b247-38b75a9dafb5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:07.328608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7d7942e-3d65-4e89-b247-38b75a9dafb5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:07.329060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7d7942e-3d65-4e89-b247-38b75a9dafb5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:07.329801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7d7942e-3d65-4e89-b247-38b75a9dafb5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:07.330252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7d7942e-3d65-4e89-b247-38b75a9dafb5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:07.330676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7d7942e-3d65-4e89-b247-38b75a9dafb5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:07.393440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e7d7942e-3d65-4e89-b247-38b75a9dafb5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:07.401551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e7d7942e-3d65-4e89-b247-38b75a9dafb5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084446 Aug 31 00:46:07.402493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 867/1808] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:07 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:07.736977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0fbd7b58-de15-4212-9f80-bf3ebacc810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:07.737563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0fbd7b58-de15-4212-9f80-bf3ebacc810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:07.743937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fbd7b58-de15-4212-9f80-bf3ebacc810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:07.744408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fbd7b58-de15-4212-9f80-bf3ebacc810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:07.744833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fbd7b58-de15-4212-9f80-bf3ebacc810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:07.745503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fbd7b58-de15-4212-9f80-bf3ebacc810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:07.745945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fbd7b58-de15-4212-9f80-bf3ebacc810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:07.746356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fbd7b58-de15-4212-9f80-bf3ebacc810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:08.024600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0fbd7b58-de15-4212-9f80-bf3ebacc810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:08.032806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0fbd7b58-de15-4212-9f80-bf3ebacc810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.300136 Aug 31 00:46:08.033362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 942/1809] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:07 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:08.424500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c3ad4c39-cf2e-4112-9f50-d0b7eebbc35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:08.425099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c3ad4c39-cf2e-4112-9f50-d0b7eebbc35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:08.431562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3ad4c39-cf2e-4112-9f50-d0b7eebbc35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:08.432053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3ad4c39-cf2e-4112-9f50-d0b7eebbc35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:08.432462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3ad4c39-cf2e-4112-9f50-d0b7eebbc35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:08.433141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3ad4c39-cf2e-4112-9f50-d0b7eebbc35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:08.433587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3ad4c39-cf2e-4112-9f50-d0b7eebbc35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:08.434002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3ad4c39-cf2e-4112-9f50-d0b7eebbc35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:08.499530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c3ad4c39-cf2e-4112-9f50-d0b7eebbc35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:08.508569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c3ad4c39-cf2e-4112-9f50-d0b7eebbc35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088396 Aug 31 00:46:08.509056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 868/1810] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:08 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:09.054369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf2f3f12-8f5d-4724-9cee-34e971b06b11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:09.054967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf2f3f12-8f5d-4724-9cee-34e971b06b11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:09.061245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2f3f12-8f5d-4724-9cee-34e971b06b11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:09.061713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2f3f12-8f5d-4724-9cee-34e971b06b11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:09.062140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2f3f12-8f5d-4724-9cee-34e971b06b11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:09.062809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2f3f12-8f5d-4724-9cee-34e971b06b11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:09.063271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2f3f12-8f5d-4724-9cee-34e971b06b11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:09.063725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2f3f12-8f5d-4724-9cee-34e971b06b11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:09.191356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bf2f3f12-8f5d-4724-9cee-34e971b06b11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:09.199416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf2f3f12-8f5d-4724-9cee-34e971b06b11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.148894 Aug 31 00:46:09.199967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 943/1811] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:09 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:09.529983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fc5d0b40-c96a-4e88-acb4-266262b5d87b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:09.530583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fc5d0b40-c96a-4e88-acb4-266262b5d87b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:09.536633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5d0b40-c96a-4e88-acb4-266262b5d87b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:09.537108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5d0b40-c96a-4e88-acb4-266262b5d87b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:09.537537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5d0b40-c96a-4e88-acb4-266262b5d87b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:09.538214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5d0b40-c96a-4e88-acb4-266262b5d87b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:09.538659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5d0b40-c96a-4e88-acb4-266262b5d87b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:09.539108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5d0b40-c96a-4e88-acb4-266262b5d87b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:09.599091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fc5d0b40-c96a-4e88-acb4-266262b5d87b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:09.607128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fc5d0b40-c96a-4e88-acb4-266262b5d87b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.081183 Aug 31 00:46:09.607688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 869/1812] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:09 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:10.221905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a6d3e2af-4a8d-4e64-b904-cb1dedbf1721 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:10.222484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a6d3e2af-4a8d-4e64-b904-cb1dedbf1721 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:10.228880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d3e2af-4a8d-4e64-b904-cb1dedbf1721 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:10.229352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d3e2af-4a8d-4e64-b904-cb1dedbf1721 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:10.229775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d3e2af-4a8d-4e64-b904-cb1dedbf1721 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:10.230448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d3e2af-4a8d-4e64-b904-cb1dedbf1721 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:10.230918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d3e2af-4a8d-4e64-b904-cb1dedbf1721 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:10.231357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d3e2af-4a8d-4e64-b904-cb1dedbf1721 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:10.362387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a6d3e2af-4a8d-4e64-b904-cb1dedbf1721 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:10.370544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a6d3e2af-4a8d-4e64-b904-cb1dedbf1721 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153024 Aug 31 00:46:10.371131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 944/1813] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:10 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:10.628603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-79f6ae9b-2ed9-4477-9dbd-72e330cb2598 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:10.629212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-79f6ae9b-2ed9-4477-9dbd-72e330cb2598 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:10.635616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79f6ae9b-2ed9-4477-9dbd-72e330cb2598 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:10.636093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79f6ae9b-2ed9-4477-9dbd-72e330cb2598 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:10.636523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79f6ae9b-2ed9-4477-9dbd-72e330cb2598 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:10.637207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79f6ae9b-2ed9-4477-9dbd-72e330cb2598 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:10.637651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79f6ae9b-2ed9-4477-9dbd-72e330cb2598 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:10.638124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79f6ae9b-2ed9-4477-9dbd-72e330cb2598 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:10.699297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-79f6ae9b-2ed9-4477-9dbd-72e330cb2598 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:10.707982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-79f6ae9b-2ed9-4477-9dbd-72e330cb2598 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083243 Aug 31 00:46:10.708540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 870/1814] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:10 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:11.392040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f90d70c7-2eba-4d0f-8eac-a0a5684ae4fa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:11.392654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f90d70c7-2eba-4d0f-8eac-a0a5684ae4fa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:11.399131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f90d70c7-2eba-4d0f-8eac-a0a5684ae4fa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:11.399618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f90d70c7-2eba-4d0f-8eac-a0a5684ae4fa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:11.400052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f90d70c7-2eba-4d0f-8eac-a0a5684ae4fa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:11.400742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f90d70c7-2eba-4d0f-8eac-a0a5684ae4fa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:11.401192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f90d70c7-2eba-4d0f-8eac-a0a5684ae4fa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:11.401616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f90d70c7-2eba-4d0f-8eac-a0a5684ae4fa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:11.529266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f90d70c7-2eba-4d0f-8eac-a0a5684ae4fa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:11.537704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f90d70c7-2eba-4d0f-8eac-a0a5684ae4fa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149665 Aug 31 00:46:11.538261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 945/1815] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:11 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:11.729862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-384b81da-a3d1-4c33-88df-411f39ec0aa7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:11.730404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-384b81da-a3d1-4c33-88df-411f39ec0aa7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:11.737610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-384b81da-a3d1-4c33-88df-411f39ec0aa7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:11.738083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-384b81da-a3d1-4c33-88df-411f39ec0aa7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:11.738511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-384b81da-a3d1-4c33-88df-411f39ec0aa7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:11.739218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-384b81da-a3d1-4c33-88df-411f39ec0aa7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:11.739660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-384b81da-a3d1-4c33-88df-411f39ec0aa7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:11.740071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-384b81da-a3d1-4c33-88df-411f39ec0aa7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:11.754456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:11.804273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-384b81da-a3d1-4c33-88df-411f39ec0aa7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:11.812342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-384b81da-a3d1-4c33-88df-411f39ec0aa7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086443 Aug 31 00:46:11.812901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 871/1816] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:11 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:12.558699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf6448ef-c9c3-4a87-bf13-3f700f00d0ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:12.559374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf6448ef-c9c3-4a87-bf13-3f700f00d0ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:12.566416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6448ef-c9c3-4a87-bf13-3f700f00d0ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:12.566894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6448ef-c9c3-4a87-bf13-3f700f00d0ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:12.567377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6448ef-c9c3-4a87-bf13-3f700f00d0ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:12.568061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6448ef-c9c3-4a87-bf13-3f700f00d0ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:12.568539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6448ef-c9c3-4a87-bf13-3f700f00d0ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:12.569263 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6448ef-c9c3-4a87-bf13-3f700f00d0ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:12.696844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bf6448ef-c9c3-4a87-bf13-3f700f00d0ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:12.705539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf6448ef-c9c3-4a87-bf13-3f700f00d0ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150741 Aug 31 00:46:12.706084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 946/1817] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:12 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:12.833646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7b04163c-2876-43cd-ad78-5f04ed2308a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:12.834245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7b04163c-2876-43cd-ad78-5f04ed2308a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:12.840563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b04163c-2876-43cd-ad78-5f04ed2308a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:12.841034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b04163c-2876-43cd-ad78-5f04ed2308a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:12.841457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b04163c-2876-43cd-ad78-5f04ed2308a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:12.842129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b04163c-2876-43cd-ad78-5f04ed2308a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:12.842570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b04163c-2876-43cd-ad78-5f04ed2308a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:12.842983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b04163c-2876-43cd-ad78-5f04ed2308a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:12.912313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7b04163c-2876-43cd-ad78-5f04ed2308a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:12.920444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7b04163c-2876-43cd-ad78-5f04ed2308a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090633 Aug 31 00:46:12.920996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 872/1818] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:12 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:13.727312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b8c3665f-7f0a-45c3-a122-68c1c6a5b4f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:13.727926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b8c3665f-7f0a-45c3-a122-68c1c6a5b4f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:13.734755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c3665f-7f0a-45c3-a122-68c1c6a5b4f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:13.735270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c3665f-7f0a-45c3-a122-68c1c6a5b4f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:13.735729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c3665f-7f0a-45c3-a122-68c1c6a5b4f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:13.736417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c3665f-7f0a-45c3-a122-68c1c6a5b4f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:13.736866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c3665f-7f0a-45c3-a122-68c1c6a5b4f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:13.737284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8c3665f-7f0a-45c3-a122-68c1c6a5b4f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:13.868327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b8c3665f-7f0a-45c3-a122-68c1c6a5b4f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:13.877288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b8c3665f-7f0a-45c3-a122-68c1c6a5b4f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154083 Aug 31 00:46:13.877843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 947/1819] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:13 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:13.942721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-da1e19f1-d4d4-4535-859d-91ff9cebe8bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:13.943390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-da1e19f1-d4d4-4535-859d-91ff9cebe8bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:13.949763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da1e19f1-d4d4-4535-859d-91ff9cebe8bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:13.950245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da1e19f1-d4d4-4535-859d-91ff9cebe8bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:13.950680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da1e19f1-d4d4-4535-859d-91ff9cebe8bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:13.951405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da1e19f1-d4d4-4535-859d-91ff9cebe8bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:13.951856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da1e19f1-d4d4-4535-859d-91ff9cebe8bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:13.952276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da1e19f1-d4d4-4535-859d-91ff9cebe8bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:14.014852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-da1e19f1-d4d4-4535-859d-91ff9cebe8bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:14.023887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-da1e19f1-d4d4-4535-859d-91ff9cebe8bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085838 Aug 31 00:46:14.024449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 873/1820] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:13 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:14.898478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-646a1a6d-c304-4b1b-9c72-b5de756a0900 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:14.899079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-646a1a6d-c304-4b1b-9c72-b5de756a0900 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:14.905416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-646a1a6d-c304-4b1b-9c72-b5de756a0900 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:14.905887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-646a1a6d-c304-4b1b-9c72-b5de756a0900 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:14.906312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-646a1a6d-c304-4b1b-9c72-b5de756a0900 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:14.906981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-646a1a6d-c304-4b1b-9c72-b5de756a0900 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:14.908082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-646a1a6d-c304-4b1b-9c72-b5de756a0900 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:14.908496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-646a1a6d-c304-4b1b-9c72-b5de756a0900 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:15.037044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-646a1a6d-c304-4b1b-9c72-b5de756a0900 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:15.045465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-646a1a6d-c304-4b1b-9c72-b5de756a0900 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150949 Aug 31 00:46:15.045635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b6b7c00b-4439-4ff0-8b38-863dba22e32f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:15.046045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 948/1821] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:14 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:15.046282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b6b7c00b-4439-4ff0-8b38-863dba22e32f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:15.053700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6b7c00b-4439-4ff0-8b38-863dba22e32f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:15.054186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6b7c00b-4439-4ff0-8b38-863dba22e32f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:15.054622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6b7c00b-4439-4ff0-8b38-863dba22e32f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:15.055349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6b7c00b-4439-4ff0-8b38-863dba22e32f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:15.055801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6b7c00b-4439-4ff0-8b38-863dba22e32f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:15.056221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6b7c00b-4439-4ff0-8b38-863dba22e32f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:15.120095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b6b7c00b-4439-4ff0-8b38-863dba22e32f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:15.128363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b6b7c00b-4439-4ff0-8b38-863dba22e32f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086560 Aug 31 00:46:15.128924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 874/1822] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:15 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:16.068125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d8884509-edba-40d7-8b1d-db44266d3d91 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:16.068730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d8884509-edba-40d7-8b1d-db44266d3d91 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:16.075161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8884509-edba-40d7-8b1d-db44266d3d91 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:16.075639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8884509-edba-40d7-8b1d-db44266d3d91 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:16.076070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8884509-edba-40d7-8b1d-db44266d3d91 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:16.076758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8884509-edba-40d7-8b1d-db44266d3d91 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:16.077202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8884509-edba-40d7-8b1d-db44266d3d91 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:16.077623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8884509-edba-40d7-8b1d-db44266d3d91 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:16.150099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cdc631ca-ec54-4102-a543-f3002522ae29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:16.150808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cdc631ca-ec54-4102-a543-f3002522ae29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:16.157039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdc631ca-ec54-4102-a543-f3002522ae29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:16.157671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdc631ca-ec54-4102-a543-f3002522ae29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:16.158125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdc631ca-ec54-4102-a543-f3002522ae29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:16.158798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdc631ca-ec54-4102-a543-f3002522ae29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:16.159380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdc631ca-ec54-4102-a543-f3002522ae29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:16.159682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdc631ca-ec54-4102-a543-f3002522ae29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:16.221013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d8884509-edba-40d7-8b1d-db44266d3d91 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:16.229177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d8884509-edba-40d7-8b1d-db44266d3d91 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.165557 Aug 31 00:46:16.229749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 949/1823] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:16 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:16.236864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cdc631ca-ec54-4102-a543-f3002522ae29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:16.245121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cdc631ca-ec54-4102-a543-f3002522ae29 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.098828 Aug 31 00:46:16.245608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 875/1824] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:16 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:17.250444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3eefbcd8-aa82-430d-9737-f36a5ab8d160 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:17.251061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3eefbcd8-aa82-430d-9737-f36a5ab8d160 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:17.257483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3eefbcd8-aa82-430d-9737-f36a5ab8d160 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:17.257959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3eefbcd8-aa82-430d-9737-f36a5ab8d160 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:17.258392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3eefbcd8-aa82-430d-9737-f36a5ab8d160 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:17.259110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3eefbcd8-aa82-430d-9737-f36a5ab8d160 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:17.259562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3eefbcd8-aa82-430d-9737-f36a5ab8d160 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:17.259974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3eefbcd8-aa82-430d-9737-f36a5ab8d160 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:17.265523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6f1d0fca-35ef-4a0f-b4e9-bff2ed1e6ad5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:17.266123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6f1d0fca-35ef-4a0f-b4e9-bff2ed1e6ad5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:17.273269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d0fca-35ef-4a0f-b4e9-bff2ed1e6ad5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:17.273744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d0fca-35ef-4a0f-b4e9-bff2ed1e6ad5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:17.274164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d0fca-35ef-4a0f-b4e9-bff2ed1e6ad5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:17.274842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d0fca-35ef-4a0f-b4e9-bff2ed1e6ad5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:17.275328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d0fca-35ef-4a0f-b4e9-bff2ed1e6ad5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:17.275743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f1d0fca-35ef-4a0f-b4e9-bff2ed1e6ad5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:17.360526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6f1d0fca-35ef-4a0f-b4e9-bff2ed1e6ad5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:17.368740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6f1d0fca-35ef-4a0f-b4e9-bff2ed1e6ad5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.106958 Aug 31 00:46:17.369664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 876/1825] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:17 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:17.419715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3eefbcd8-aa82-430d-9737-f36a5ab8d160 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:17.428217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3eefbcd8-aa82-430d-9737-f36a5ab8d160 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.181705 Aug 31 00:46:17.428779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 950/1826] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:17 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:18.390545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c4f4916f-0edb-4af7-9ea1-0b946e540fc6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:18.391275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c4f4916f-0edb-4af7-9ea1-0b946e540fc6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:18.398433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4f4916f-0edb-4af7-9ea1-0b946e540fc6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:18.399291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4f4916f-0edb-4af7-9ea1-0b946e540fc6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:18.399802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4f4916f-0edb-4af7-9ea1-0b946e540fc6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:18.400705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4f4916f-0edb-4af7-9ea1-0b946e540fc6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:18.401146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4f4916f-0edb-4af7-9ea1-0b946e540fc6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:18.401673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c4f4916f-0edb-4af7-9ea1-0b946e540fc6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:18.450311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1e919e02-b3c1-420b-8dc1-e8ad8a89a11a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:18.451500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1e919e02-b3c1-420b-8dc1-e8ad8a89a11a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:18.458112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e919e02-b3c1-420b-8dc1-e8ad8a89a11a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:18.458614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e919e02-b3c1-420b-8dc1-e8ad8a89a11a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:18.459129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e919e02-b3c1-420b-8dc1-e8ad8a89a11a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:18.459848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e919e02-b3c1-420b-8dc1-e8ad8a89a11a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:18.460394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e919e02-b3c1-420b-8dc1-e8ad8a89a11a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:18.460722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e919e02-b3c1-420b-8dc1-e8ad8a89a11a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:18.467269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c4f4916f-0edb-4af7-9ea1-0b946e540fc6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:18.476829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c4f4916f-0edb-4af7-9ea1-0b946e540fc6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090057 Aug 31 00:46:18.478033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 877/1827] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:18 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:18.600552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1e919e02-b3c1-420b-8dc1-e8ad8a89a11a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:18.608734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1e919e02-b3c1-420b-8dc1-e8ad8a89a11a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.162632 Aug 31 00:46:18.609560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 951/1828] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:18 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:19.500630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-435f0c9d-033d-4a60-a9d1-244521338c69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:19.501957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-435f0c9d-033d-4a60-a9d1-244521338c69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:19.508626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-435f0c9d-033d-4a60-a9d1-244521338c69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:19.509104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-435f0c9d-033d-4a60-a9d1-244521338c69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:19.509536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-435f0c9d-033d-4a60-a9d1-244521338c69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:19.510258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-435f0c9d-033d-4a60-a9d1-244521338c69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:19.510710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-435f0c9d-033d-4a60-a9d1-244521338c69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:19.511161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-435f0c9d-033d-4a60-a9d1-244521338c69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:19.573282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-435f0c9d-033d-4a60-a9d1-244521338c69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:19.581921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-435f0c9d-033d-4a60-a9d1-244521338c69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085148 Aug 31 00:46:19.582486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 878/1829] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:19 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:19.632133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c361f7cb-d220-4ea3-9193-59e61a21768e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:19.632807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c361f7cb-d220-4ea3-9193-59e61a21768e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:19.639519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c361f7cb-d220-4ea3-9193-59e61a21768e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:19.639998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c361f7cb-d220-4ea3-9193-59e61a21768e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:19.640427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c361f7cb-d220-4ea3-9193-59e61a21768e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:19.641360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c361f7cb-d220-4ea3-9193-59e61a21768e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:19.642067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c361f7cb-d220-4ea3-9193-59e61a21768e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:19.642565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c361f7cb-d220-4ea3-9193-59e61a21768e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:19.773768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c361f7cb-d220-4ea3-9193-59e61a21768e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:19.781894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c361f7cb-d220-4ea3-9193-59e61a21768e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154789 Aug 31 00:46:19.782455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 952/1830] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:19 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:20.603662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-84ca425c-931a-4086-9772-a5e91804a768 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:20.604302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-84ca425c-931a-4086-9772-a5e91804a768 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:20.611152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ca425c-931a-4086-9772-a5e91804a768 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:20.611636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ca425c-931a-4086-9772-a5e91804a768 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:20.612073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ca425c-931a-4086-9772-a5e91804a768 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:20.612763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ca425c-931a-4086-9772-a5e91804a768 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:20.613214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ca425c-931a-4086-9772-a5e91804a768 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:20.613634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ca425c-931a-4086-9772-a5e91804a768 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:20.678294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-84ca425c-931a-4086-9772-a5e91804a768 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:20.686454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-84ca425c-931a-4086-9772-a5e91804a768 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086716 Aug 31 00:46:20.687017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 879/1831] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:20 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:20.803221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0239a315-6ee0-4b4e-b18d-eb6548992d09 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:20.803829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0239a315-6ee0-4b4e-b18d-eb6548992d09 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:20.809897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0239a315-6ee0-4b4e-b18d-eb6548992d09 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:20.810373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0239a315-6ee0-4b4e-b18d-eb6548992d09 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:20.810805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0239a315-6ee0-4b4e-b18d-eb6548992d09 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:20.811514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0239a315-6ee0-4b4e-b18d-eb6548992d09 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:20.811961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0239a315-6ee0-4b4e-b18d-eb6548992d09 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:20.812376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0239a315-6ee0-4b4e-b18d-eb6548992d09 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:20.947148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0239a315-6ee0-4b4e-b18d-eb6548992d09 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:20.956220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0239a315-6ee0-4b4e-b18d-eb6548992d09 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157003 Aug 31 00:46:20.956790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 953/1832] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:20 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:21.708508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f711c401-6ce5-4333-a6c5-8dc9cc5d8b76 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:21.709072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f711c401-6ce5-4333-a6c5-8dc9cc5d8b76 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:21.715446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f711c401-6ce5-4333-a6c5-8dc9cc5d8b76 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:21.715926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f711c401-6ce5-4333-a6c5-8dc9cc5d8b76 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:21.716356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f711c401-6ce5-4333-a6c5-8dc9cc5d8b76 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:21.717040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f711c401-6ce5-4333-a6c5-8dc9cc5d8b76 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:21.717489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f711c401-6ce5-4333-a6c5-8dc9cc5d8b76 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:21.717908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f711c401-6ce5-4333-a6c5-8dc9cc5d8b76 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:21.780038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f711c401-6ce5-4333-a6c5-8dc9cc5d8b76 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:21.788794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f711c401-6ce5-4333-a6c5-8dc9cc5d8b76 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084889 Aug 31 00:46:21.789369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 880/1833] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:21 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:21.977447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c7859f80-a093-4c5d-b9d5-e9549a754b2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:21.978004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c7859f80-a093-4c5d-b9d5-e9549a754b2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:21.984863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7859f80-a093-4c5d-b9d5-e9549a754b2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:21.985425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7859f80-a093-4c5d-b9d5-e9549a754b2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:21.985872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7859f80-a093-4c5d-b9d5-e9549a754b2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:21.986670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7859f80-a093-4c5d-b9d5-e9549a754b2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:21.987153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7859f80-a093-4c5d-b9d5-e9549a754b2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:21.987580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7859f80-a093-4c5d-b9d5-e9549a754b2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:22.124358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c7859f80-a093-4c5d-b9d5-e9549a754b2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:22.133072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c7859f80-a093-4c5d-b9d5-e9549a754b2e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159585 Aug 31 00:46:22.133642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 954/1834] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:21 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:22.810204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d923e3e-bc98-4544-9b73-7b0d6b14c000 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:22.811010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0d923e3e-bc98-4544-9b73-7b0d6b14c000 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:22.819728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d923e3e-bc98-4544-9b73-7b0d6b14c000 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:22.820220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d923e3e-bc98-4544-9b73-7b0d6b14c000 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:22.820654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d923e3e-bc98-4544-9b73-7b0d6b14c000 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:22.821564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d923e3e-bc98-4544-9b73-7b0d6b14c000 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:22.822018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d923e3e-bc98-4544-9b73-7b0d6b14c000 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:22.822448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d923e3e-bc98-4544-9b73-7b0d6b14c000 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:22.894442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0d923e3e-bc98-4544-9b73-7b0d6b14c000 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:22.904065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0d923e3e-bc98-4544-9b73-7b0d6b14c000 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.096928 Aug 31 00:46:22.904654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 881/1835] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:22 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:23.154719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed2b608e-e7ed-43e9-80b5-7d33b0abbb62 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:23.155367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ed2b608e-e7ed-43e9-80b5-7d33b0abbb62 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:23.163915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2b608e-e7ed-43e9-80b5-7d33b0abbb62 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:23.164399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2b608e-e7ed-43e9-80b5-7d33b0abbb62 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:23.164837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2b608e-e7ed-43e9-80b5-7d33b0abbb62 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:23.165535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2b608e-e7ed-43e9-80b5-7d33b0abbb62 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:23.165989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2b608e-e7ed-43e9-80b5-7d33b0abbb62 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:23.166414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed2b608e-e7ed-43e9-80b5-7d33b0abbb62 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:23.306364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ed2b608e-e7ed-43e9-80b5-7d33b0abbb62 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:23.315367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ed2b608e-e7ed-43e9-80b5-7d33b0abbb62 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.164465 Aug 31 00:46:23.315943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 955/1836] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:23 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:23.929284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e983b3c-8fd1-4c4c-bb5e-0d8a0733aebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:23.929900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7e983b3c-8fd1-4c4c-bb5e-0d8a0733aebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:23.936339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e983b3c-8fd1-4c4c-bb5e-0d8a0733aebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:23.936820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e983b3c-8fd1-4c4c-bb5e-0d8a0733aebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:23.937254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e983b3c-8fd1-4c4c-bb5e-0d8a0733aebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:23.937938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e983b3c-8fd1-4c4c-bb5e-0d8a0733aebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:23.938390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e983b3c-8fd1-4c4c-bb5e-0d8a0733aebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:23.938912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e983b3c-8fd1-4c4c-bb5e-0d8a0733aebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:24.000254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7e983b3c-8fd1-4c4c-bb5e-0d8a0733aebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:24.008537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7e983b3c-8fd1-4c4c-bb5e-0d8a0733aebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083114 Aug 31 00:46:24.009096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 882/1837] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:23 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:24.337052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6b987685-bc42-443c-b5a6-561ce834e057 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:24.337647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6b987685-bc42-443c-b5a6-561ce834e057 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:24.344022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b987685-bc42-443c-b5a6-561ce834e057 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:24.344500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b987685-bc42-443c-b5a6-561ce834e057 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:24.345077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b987685-bc42-443c-b5a6-561ce834e057 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:24.345832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b987685-bc42-443c-b5a6-561ce834e057 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:24.346285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b987685-bc42-443c-b5a6-561ce834e057 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:24.346710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b987685-bc42-443c-b5a6-561ce834e057 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:24.478253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6b987685-bc42-443c-b5a6-561ce834e057 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:24.480463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:24.488494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6b987685-bc42-443c-b5a6-561ce834e057 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155254 Aug 31 00:46:24.489070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 956/1838] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:24 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:25.029986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e8701380-a0cd-4319-9a68-1196b470bb5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:25.030650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e8701380-a0cd-4319-9a68-1196b470bb5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:25.037403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8701380-a0cd-4319-9a68-1196b470bb5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:25.037885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8701380-a0cd-4319-9a68-1196b470bb5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:25.038353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8701380-a0cd-4319-9a68-1196b470bb5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:25.039085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8701380-a0cd-4319-9a68-1196b470bb5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:25.039540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8701380-a0cd-4319-9a68-1196b470bb5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:25.039969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8701380-a0cd-4319-9a68-1196b470bb5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:25.102797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e8701380-a0cd-4319-9a68-1196b470bb5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:25.112168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e8701380-a0cd-4319-9a68-1196b470bb5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086046 Aug 31 00:46:25.112734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 883/1839] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:25 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:25.510848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4e2e5531-2d2c-46a4-ba8e-056fdde5201d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:25.511476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4e2e5531-2d2c-46a4-ba8e-056fdde5201d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:25.517984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e2e5531-2d2c-46a4-ba8e-056fdde5201d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:25.518459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e2e5531-2d2c-46a4-ba8e-056fdde5201d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:25.518887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e2e5531-2d2c-46a4-ba8e-056fdde5201d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:25.519600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e2e5531-2d2c-46a4-ba8e-056fdde5201d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:25.520050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e2e5531-2d2c-46a4-ba8e-056fdde5201d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:25.520467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e2e5531-2d2c-46a4-ba8e-056fdde5201d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:25.651910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4e2e5531-2d2c-46a4-ba8e-056fdde5201d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:25.660270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4e2e5531-2d2c-46a4-ba8e-056fdde5201d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153562 Aug 31 00:46:25.660833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 957/1840] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:25 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:26.135069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-069fa156-f773-4f94-9593-1680bb32b617 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:26.135692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-069fa156-f773-4f94-9593-1680bb32b617 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:26.142911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-069fa156-f773-4f94-9593-1680bb32b617 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:26.143522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-069fa156-f773-4f94-9593-1680bb32b617 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:26.143976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-069fa156-f773-4f94-9593-1680bb32b617 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:26.144665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-069fa156-f773-4f94-9593-1680bb32b617 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:26.145116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-069fa156-f773-4f94-9593-1680bb32b617 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:26.145536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-069fa156-f773-4f94-9593-1680bb32b617 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:26.210442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-069fa156-f773-4f94-9593-1680bb32b617 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:26.218831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-069fa156-f773-4f94-9593-1680bb32b617 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088613 Aug 31 00:46:26.219438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 884/1841] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:26 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:26.682169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-51205db8-13bd-43e5-82ba-65765e27580c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:26.682752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-51205db8-13bd-43e5-82ba-65765e27580c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:26.689884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51205db8-13bd-43e5-82ba-65765e27580c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:26.690338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51205db8-13bd-43e5-82ba-65765e27580c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:26.690760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51205db8-13bd-43e5-82ba-65765e27580c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:26.691581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51205db8-13bd-43e5-82ba-65765e27580c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:26.691911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51205db8-13bd-43e5-82ba-65765e27580c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:26.692327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51205db8-13bd-43e5-82ba-65765e27580c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:26.824737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-51205db8-13bd-43e5-82ba-65765e27580c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:26.833713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-51205db8-13bd-43e5-82ba-65765e27580c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155478 Aug 31 00:46:26.834276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 958/1842] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:26 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:27.241842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e85ffee9-70eb-45be-a1f3-969fd521aafc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:27.242448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e85ffee9-70eb-45be-a1f3-969fd521aafc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:27.249259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e85ffee9-70eb-45be-a1f3-969fd521aafc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:27.249688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e85ffee9-70eb-45be-a1f3-969fd521aafc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:27.250116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e85ffee9-70eb-45be-a1f3-969fd521aafc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:27.250823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e85ffee9-70eb-45be-a1f3-969fd521aafc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:27.251996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e85ffee9-70eb-45be-a1f3-969fd521aafc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:27.252432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e85ffee9-70eb-45be-a1f3-969fd521aafc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:27.314157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e85ffee9-70eb-45be-a1f3-969fd521aafc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:27.322840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e85ffee9-70eb-45be-a1f3-969fd521aafc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084959 Aug 31 00:46:27.323433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 885/1843] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:27 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:27.855204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1e84d209-d938-4909-9d72-bbf21b712374 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:27.855789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1e84d209-d938-4909-9d72-bbf21b712374 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:27.862705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84d209-d938-4909-9d72-bbf21b712374 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:27.863212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84d209-d938-4909-9d72-bbf21b712374 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:27.863646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84d209-d938-4909-9d72-bbf21b712374 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:27.864329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84d209-d938-4909-9d72-bbf21b712374 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:27.864776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84d209-d938-4909-9d72-bbf21b712374 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:27.865193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e84d209-d938-4909-9d72-bbf21b712374 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:27.997094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1e84d209-d938-4909-9d72-bbf21b712374 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:28.005923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1e84d209-d938-4909-9d72-bbf21b712374 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154599 Aug 31 00:46:28.006487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 959/1844] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:27 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:28.344200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-003b79f2-68c0-46ce-871d-1f8ef1fcc4e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:28.344957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-003b79f2-68c0-46ce-871d-1f8ef1fcc4e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:28.351818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-003b79f2-68c0-46ce-871d-1f8ef1fcc4e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:28.352290 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-003b79f2-68c0-46ce-871d-1f8ef1fcc4e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:28.352715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-003b79f2-68c0-46ce-871d-1f8ef1fcc4e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:28.353393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-003b79f2-68c0-46ce-871d-1f8ef1fcc4e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:28.353834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-003b79f2-68c0-46ce-871d-1f8ef1fcc4e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:28.354247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-003b79f2-68c0-46ce-871d-1f8ef1fcc4e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:28.417564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-003b79f2-68c0-46ce-871d-1f8ef1fcc4e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:28.426167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-003b79f2-68c0-46ce-871d-1f8ef1fcc4e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085870 Aug 31 00:46:28.426708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 886/1845] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:28 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:29.028214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6d9a6a08-4c0d-4f05-96df-4198f8a4db3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:29.028812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6d9a6a08-4c0d-4f05-96df-4198f8a4db3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:29.035943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d9a6a08-4c0d-4f05-96df-4198f8a4db3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:29.036424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d9a6a08-4c0d-4f05-96df-4198f8a4db3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:29.036854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d9a6a08-4c0d-4f05-96df-4198f8a4db3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:29.037537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d9a6a08-4c0d-4f05-96df-4198f8a4db3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:29.037995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d9a6a08-4c0d-4f05-96df-4198f8a4db3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:29.038389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d9a6a08-4c0d-4f05-96df-4198f8a4db3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:29.171569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6d9a6a08-4c0d-4f05-96df-4198f8a4db3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:29.180573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6d9a6a08-4c0d-4f05-96df-4198f8a4db3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156203 Aug 31 00:46:29.181142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 960/1846] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:29 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:29.448073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c61274cc-75e7-4f41-83ad-1d09454cc3bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:29.448719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c61274cc-75e7-4f41-83ad-1d09454cc3bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:29.456140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c61274cc-75e7-4f41-83ad-1d09454cc3bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:29.456628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c61274cc-75e7-4f41-83ad-1d09454cc3bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:29.457067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c61274cc-75e7-4f41-83ad-1d09454cc3bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:29.457762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c61274cc-75e7-4f41-83ad-1d09454cc3bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:29.458217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c61274cc-75e7-4f41-83ad-1d09454cc3bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:29.458643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c61274cc-75e7-4f41-83ad-1d09454cc3bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:29.520588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c61274cc-75e7-4f41-83ad-1d09454cc3bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:29.528734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c61274cc-75e7-4f41-83ad-1d09454cc3bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084528 Aug 31 00:46:29.529294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 887/1847] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:29 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:30.201847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-15840505-f06d-44be-be28-c9fc94056382 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:30.202538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-15840505-f06d-44be-be28-c9fc94056382 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:30.209658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15840505-f06d-44be-be28-c9fc94056382 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:30.210145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15840505-f06d-44be-be28-c9fc94056382 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:30.210582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15840505-f06d-44be-be28-c9fc94056382 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:30.211312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15840505-f06d-44be-be28-c9fc94056382 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:30.211769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15840505-f06d-44be-be28-c9fc94056382 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:30.212194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15840505-f06d-44be-be28-c9fc94056382 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:30.345215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-15840505-f06d-44be-be28-c9fc94056382 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:30.353791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-15840505-f06d-44be-be28-c9fc94056382 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155873 Aug 31 00:46:30.354362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 961/1848] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:30 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:30.549898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b8321b53-ae77-4030-90de-36ade6404a5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:30.550432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b8321b53-ae77-4030-90de-36ade6404a5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:30.556755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8321b53-ae77-4030-90de-36ade6404a5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:30.557227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8321b53-ae77-4030-90de-36ade6404a5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:30.557657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8321b53-ae77-4030-90de-36ade6404a5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:30.558334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8321b53-ae77-4030-90de-36ade6404a5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:30.558777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8321b53-ae77-4030-90de-36ade6404a5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:30.559227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8321b53-ae77-4030-90de-36ade6404a5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:30.561739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:30.631699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b8321b53-ae77-4030-90de-36ade6404a5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:30.639848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b8321b53-ae77-4030-90de-36ade6404a5c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.093932 Aug 31 00:46:30.640401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 888/1849] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:30 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:31.375313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8259c742-ac81-4fce-8c7a-66d21452af6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:31.375932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8259c742-ac81-4fce-8c7a-66d21452af6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:31.382516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8259c742-ac81-4fce-8c7a-66d21452af6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:31.383004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8259c742-ac81-4fce-8c7a-66d21452af6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:31.383486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8259c742-ac81-4fce-8c7a-66d21452af6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:31.384172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8259c742-ac81-4fce-8c7a-66d21452af6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:31.384624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8259c742-ac81-4fce-8c7a-66d21452af6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:31.385043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8259c742-ac81-4fce-8c7a-66d21452af6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:31.517595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8259c742-ac81-4fce-8c7a-66d21452af6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:31.525865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8259c742-ac81-4fce-8c7a-66d21452af6e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154522 Aug 31 00:46:31.526434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 962/1850] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:31 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:31.662686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b87cb424-aa1c-4afb-95de-64052c1feb5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:31.663261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b87cb424-aa1c-4afb-95de-64052c1feb5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:31.669931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b87cb424-aa1c-4afb-95de-64052c1feb5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:31.670416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b87cb424-aa1c-4afb-95de-64052c1feb5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:31.670879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b87cb424-aa1c-4afb-95de-64052c1feb5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:31.671601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b87cb424-aa1c-4afb-95de-64052c1feb5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:31.672051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b87cb424-aa1c-4afb-95de-64052c1feb5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:31.672473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b87cb424-aa1c-4afb-95de-64052c1feb5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:31.733866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b87cb424-aa1c-4afb-95de-64052c1feb5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:31.742363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b87cb424-aa1c-4afb-95de-64052c1feb5e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083819 Aug 31 00:46:31.742925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 889/1851] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:31 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:32.547478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-29da6a6d-73cc-4afc-bce8-1917431dddfe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:32.548904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-29da6a6d-73cc-4afc-bce8-1917431dddfe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:32.555575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29da6a6d-73cc-4afc-bce8-1917431dddfe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:32.556060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29da6a6d-73cc-4afc-bce8-1917431dddfe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:32.556495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29da6a6d-73cc-4afc-bce8-1917431dddfe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:32.557189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29da6a6d-73cc-4afc-bce8-1917431dddfe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:32.557638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29da6a6d-73cc-4afc-bce8-1917431dddfe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:32.558056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29da6a6d-73cc-4afc-bce8-1917431dddfe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:32.702028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-29da6a6d-73cc-4afc-bce8-1917431dddfe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:32.711448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-29da6a6d-73cc-4afc-bce8-1917431dddfe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.167901 Aug 31 00:46:32.712040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 963/1852] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:32 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:32.762962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4a6892d9-7284-41e2-941c-d69c554250fc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:32.763589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4a6892d9-7284-41e2-941c-d69c554250fc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:32.765864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=56 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:32.771937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6892d9-7284-41e2-941c-d69c554250fc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:32.772589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6892d9-7284-41e2-941c-d69c554250fc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:32.773231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6892d9-7284-41e2-941c-d69c554250fc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:32.774278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6892d9-7284-41e2-941c-d69c554250fc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:32.775139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6892d9-7284-41e2-941c-d69c554250fc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:32.775808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a6892d9-7284-41e2-941c-d69c554250fc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:32.839998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4a6892d9-7284-41e2-941c-d69c554250fc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:32.848979 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4a6892d9-7284-41e2-941c-d69c554250fc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089830 Aug 31 00:46:32.849544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 890/1853] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:32 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:33.733345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b5f4697d-bf24-4927-8382-3d3b9ee22f1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:33.733926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b5f4697d-bf24-4927-8382-3d3b9ee22f1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:33.741597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5f4697d-bf24-4927-8382-3d3b9ee22f1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:33.742080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5f4697d-bf24-4927-8382-3d3b9ee22f1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:33.742513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5f4697d-bf24-4927-8382-3d3b9ee22f1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:33.743233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5f4697d-bf24-4927-8382-3d3b9ee22f1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:33.743688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5f4697d-bf24-4927-8382-3d3b9ee22f1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:33.744110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5f4697d-bf24-4927-8382-3d3b9ee22f1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:33.871282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d17b9495-72ec-433b-975c-931302225cf0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:33.871885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d17b9495-72ec-433b-975c-931302225cf0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:33.872454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b5f4697d-bf24-4927-8382-3d3b9ee22f1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:33.879437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d17b9495-72ec-433b-975c-931302225cf0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:33.879917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d17b9495-72ec-433b-975c-931302225cf0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:33.880342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d17b9495-72ec-433b-975c-931302225cf0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:33.881026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d17b9495-72ec-433b-975c-931302225cf0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:33.881468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d17b9495-72ec-433b-975c-931302225cf0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:33.881880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d17b9495-72ec-433b-975c-931302225cf0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:33.882125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b5f4697d-bf24-4927-8382-3d3b9ee22f1c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152741 Aug 31 00:46:33.882708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 964/1854] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:33 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:33.943221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d17b9495-72ec-433b-975c-931302225cf0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:33.951294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d17b9495-72ec-433b-975c-931302225cf0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083858 Aug 31 00:46:33.951858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 891/1855] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:33 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:34.903742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7bc9c715-c80a-46ad-901d-a3dc2fcfc0a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:34.904343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7bc9c715-c80a-46ad-901d-a3dc2fcfc0a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:34.911479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc9c715-c80a-46ad-901d-a3dc2fcfc0a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:34.911956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc9c715-c80a-46ad-901d-a3dc2fcfc0a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:34.912381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc9c715-c80a-46ad-901d-a3dc2fcfc0a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:34.913089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc9c715-c80a-46ad-901d-a3dc2fcfc0a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:34.913543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc9c715-c80a-46ad-901d-a3dc2fcfc0a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:34.913948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc9c715-c80a-46ad-901d-a3dc2fcfc0a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:34.973614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-244d047e-7f6d-4c7e-b35b-9278499939b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:34.974326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-244d047e-7f6d-4c7e-b35b-9278499939b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:34.981295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-244d047e-7f6d-4c7e-b35b-9278499939b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:34.981784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-244d047e-7f6d-4c7e-b35b-9278499939b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:34.982218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-244d047e-7f6d-4c7e-b35b-9278499939b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:34.982923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-244d047e-7f6d-4c7e-b35b-9278499939b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:34.983399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-244d047e-7f6d-4c7e-b35b-9278499939b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:34.983821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-244d047e-7f6d-4c7e-b35b-9278499939b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:35.055756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-244d047e-7f6d-4c7e-b35b-9278499939b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:35.064106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-244d047e-7f6d-4c7e-b35b-9278499939b5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.095065 Aug 31 00:46:35.064665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 892/1856] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:35.082075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7bc9c715-c80a-46ad-901d-a3dc2fcfc0a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:35.090197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7bc9c715-c80a-46ad-901d-a3dc2fcfc0a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.190452 Aug 31 00:46:35.090748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 965/1857] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:34 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:36.085739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5f36e180-4ddf-4b59-a33e-17ddaad7aab5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:36.086400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5f36e180-4ddf-4b59-a33e-17ddaad7aab5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:36.092737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f36e180-4ddf-4b59-a33e-17ddaad7aab5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:36.093209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f36e180-4ddf-4b59-a33e-17ddaad7aab5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:36.093633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f36e180-4ddf-4b59-a33e-17ddaad7aab5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:36.094307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f36e180-4ddf-4b59-a33e-17ddaad7aab5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:36.094786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f36e180-4ddf-4b59-a33e-17ddaad7aab5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:36.095223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f36e180-4ddf-4b59-a33e-17ddaad7aab5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:36.112883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-44c8791d-8f22-48ac-bfdf-dd09b4aec16b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:36.114072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-44c8791d-8f22-48ac-bfdf-dd09b4aec16b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:36.119817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44c8791d-8f22-48ac-bfdf-dd09b4aec16b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:36.120296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44c8791d-8f22-48ac-bfdf-dd09b4aec16b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:36.120727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44c8791d-8f22-48ac-bfdf-dd09b4aec16b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:36.121413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44c8791d-8f22-48ac-bfdf-dd09b4aec16b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:36.121860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44c8791d-8f22-48ac-bfdf-dd09b4aec16b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:36.122277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44c8791d-8f22-48ac-bfdf-dd09b4aec16b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:36.160051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5f36e180-4ddf-4b59-a33e-17ddaad7aab5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:36.168326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5f36e180-4ddf-4b59-a33e-17ddaad7aab5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086488 Aug 31 00:46:36.168900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 893/1858] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:36 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:36.259597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-44c8791d-8f22-48ac-bfdf-dd09b4aec16b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:36.268329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-44c8791d-8f22-48ac-bfdf-dd09b4aec16b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.160253 Aug 31 00:46:36.268893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 966/1859] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:36 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:37.190366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-85202a1a-9a5c-4eb6-9980-9969400c041f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:37.190974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-85202a1a-9a5c-4eb6-9980-9969400c041f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:37.197312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85202a1a-9a5c-4eb6-9980-9969400c041f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:37.197784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85202a1a-9a5c-4eb6-9980-9969400c041f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:37.198209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85202a1a-9a5c-4eb6-9980-9969400c041f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:37.198883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85202a1a-9a5c-4eb6-9980-9969400c041f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:37.199362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85202a1a-9a5c-4eb6-9980-9969400c041f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:37.199779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85202a1a-9a5c-4eb6-9980-9969400c041f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:37.263281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-85202a1a-9a5c-4eb6-9980-9969400c041f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:37.271586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-85202a1a-9a5c-4eb6-9980-9969400c041f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085234 Aug 31 00:46:37.272153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 894/1860] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:37 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:37.289452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-731adb92-1cdb-472d-add9-84692ebe9314 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:37.290053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-731adb92-1cdb-472d-add9-84692ebe9314 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:37.292374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:37.297531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731adb92-1cdb-472d-add9-84692ebe9314 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:37.298710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731adb92-1cdb-472d-add9-84692ebe9314 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:37.299326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731adb92-1cdb-472d-add9-84692ebe9314 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:37.300023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731adb92-1cdb-472d-add9-84692ebe9314 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:37.300472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731adb92-1cdb-472d-add9-84692ebe9314 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:37.300892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-731adb92-1cdb-472d-add9-84692ebe9314 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:37.431313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-731adb92-1cdb-472d-add9-84692ebe9314 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:37.439651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-731adb92-1cdb-472d-add9-84692ebe9314 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153995 Aug 31 00:46:37.440219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 967/1861] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:37 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:38.293467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9009c64e-f102-4c9e-a534-e2640514e30c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:38.294023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9009c64e-f102-4c9e-a534-e2640514e30c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:38.301124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9009c64e-f102-4c9e-a534-e2640514e30c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:38.301607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9009c64e-f102-4c9e-a534-e2640514e30c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:38.302040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9009c64e-f102-4c9e-a534-e2640514e30c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:38.302735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9009c64e-f102-4c9e-a534-e2640514e30c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:38.303216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9009c64e-f102-4c9e-a534-e2640514e30c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:38.303645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9009c64e-f102-4c9e-a534-e2640514e30c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:38.370536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9009c64e-f102-4c9e-a534-e2640514e30c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:38.379866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9009c64e-f102-4c9e-a534-e2640514e30c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090335 Aug 31 00:46:38.380437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 895/1862] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:38 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:38.460810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-727825c4-dfea-4a26-a235-0bfaf9f5c466 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:38.461419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-727825c4-dfea-4a26-a235-0bfaf9f5c466 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:38.467895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-727825c4-dfea-4a26-a235-0bfaf9f5c466 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:38.468375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-727825c4-dfea-4a26-a235-0bfaf9f5c466 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:38.468806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-727825c4-dfea-4a26-a235-0bfaf9f5c466 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:38.469487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-727825c4-dfea-4a26-a235-0bfaf9f5c466 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:38.469978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-727825c4-dfea-4a26-a235-0bfaf9f5c466 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:38.470398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-727825c4-dfea-4a26-a235-0bfaf9f5c466 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:38.600616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-727825c4-dfea-4a26-a235-0bfaf9f5c466 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:38.608758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-727825c4-dfea-4a26-a235-0bfaf9f5c466 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151860 Aug 31 00:46:38.609315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 968/1863] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:38 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:39.404797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c9690564-bc5e-4dd5-a43b-c198d7650fbb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:39.405405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c9690564-bc5e-4dd5-a43b-c198d7650fbb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:39.412245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9690564-bc5e-4dd5-a43b-c198d7650fbb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:39.412730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9690564-bc5e-4dd5-a43b-c198d7650fbb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:39.413164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9690564-bc5e-4dd5-a43b-c198d7650fbb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:39.413845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9690564-bc5e-4dd5-a43b-c198d7650fbb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:39.414296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9690564-bc5e-4dd5-a43b-c198d7650fbb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:39.414716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9690564-bc5e-4dd5-a43b-c198d7650fbb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:39.475610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c9690564-bc5e-4dd5-a43b-c198d7650fbb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:39.483789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c9690564-bc5e-4dd5-a43b-c198d7650fbb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082998 Aug 31 00:46:39.484610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 896/1864] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:39 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:39.631517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-de84a893-8cfe-44d4-a839-c43ffc25db40 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:39.632173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-de84a893-8cfe-44d4-a839-c43ffc25db40 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:39.638675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de84a893-8cfe-44d4-a839-c43ffc25db40 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:39.639184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de84a893-8cfe-44d4-a839-c43ffc25db40 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:39.639621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de84a893-8cfe-44d4-a839-c43ffc25db40 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:39.640308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de84a893-8cfe-44d4-a839-c43ffc25db40 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:39.640756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de84a893-8cfe-44d4-a839-c43ffc25db40 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:39.641174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-de84a893-8cfe-44d4-a839-c43ffc25db40 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:39.772525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-de84a893-8cfe-44d4-a839-c43ffc25db40 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:39.780746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-de84a893-8cfe-44d4-a839-c43ffc25db40 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153879 Aug 31 00:46:39.781305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 969/1865] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:39 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:40.505895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0f0aa8c4-0b84-41f5-838e-3680ce6e538e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:40.506521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0f0aa8c4-0b84-41f5-838e-3680ce6e538e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:40.512841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f0aa8c4-0b84-41f5-838e-3680ce6e538e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:40.513314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f0aa8c4-0b84-41f5-838e-3680ce6e538e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:40.513737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f0aa8c4-0b84-41f5-838e-3680ce6e538e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:40.514407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f0aa8c4-0b84-41f5-838e-3680ce6e538e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:40.514845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f0aa8c4-0b84-41f5-838e-3680ce6e538e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:40.515280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f0aa8c4-0b84-41f5-838e-3680ce6e538e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:40.576003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0f0aa8c4-0b84-41f5-838e-3680ce6e538e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:40.584709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0f0aa8c4-0b84-41f5-838e-3680ce6e538e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082670 Aug 31 00:46:40.585265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 897/1866] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:40 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:40.801865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-21cf919c-5847-4795-8446-a3ff6eeed9b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:40.802428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-21cf919c-5847-4795-8446-a3ff6eeed9b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:40.808890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21cf919c-5847-4795-8446-a3ff6eeed9b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:40.809368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21cf919c-5847-4795-8446-a3ff6eeed9b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:40.809799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21cf919c-5847-4795-8446-a3ff6eeed9b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:40.810480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21cf919c-5847-4795-8446-a3ff6eeed9b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:40.810930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21cf919c-5847-4795-8446-a3ff6eeed9b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:40.811376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21cf919c-5847-4795-8446-a3ff6eeed9b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:40.941786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-21cf919c-5847-4795-8446-a3ff6eeed9b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:40.949860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-21cf919c-5847-4795-8446-a3ff6eeed9b7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151951 Aug 31 00:46:40.950425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 970/1867] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:40 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:41.607151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7509e3aa-881e-4276-969c-9dd34482c5ea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:41.607792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7509e3aa-881e-4276-969c-9dd34482c5ea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:41.615323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7509e3aa-881e-4276-969c-9dd34482c5ea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:41.615814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7509e3aa-881e-4276-969c-9dd34482c5ea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:41.616248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7509e3aa-881e-4276-969c-9dd34482c5ea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:41.616941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7509e3aa-881e-4276-969c-9dd34482c5ea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:41.617392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7509e3aa-881e-4276-969c-9dd34482c5ea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:41.617820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7509e3aa-881e-4276-969c-9dd34482c5ea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:41.682424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7509e3aa-881e-4276-969c-9dd34482c5ea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:41.690665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7509e3aa-881e-4276-969c-9dd34482c5ea tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087288 Aug 31 00:46:41.691174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 898/1868] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:41 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:41.972609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-61b25d23-4465-4d8e-aa31-e9942be9e706 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:41.973170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-61b25d23-4465-4d8e-aa31-e9942be9e706 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:41.979821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61b25d23-4465-4d8e-aa31-e9942be9e706 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:41.980306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61b25d23-4465-4d8e-aa31-e9942be9e706 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:41.980741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61b25d23-4465-4d8e-aa31-e9942be9e706 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:41.981435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61b25d23-4465-4d8e-aa31-e9942be9e706 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:41.981891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61b25d23-4465-4d8e-aa31-e9942be9e706 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:41.982317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61b25d23-4465-4d8e-aa31-e9942be9e706 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:42.115879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-61b25d23-4465-4d8e-aa31-e9942be9e706 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:42.124128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-61b25d23-4465-4d8e-aa31-e9942be9e706 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156425 Aug 31 00:46:42.124682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 971/1869] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:41 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:42.712792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-76cb78a0-22e0-45e9-8f7d-226c6fe8e864 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:42.713381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-76cb78a0-22e0-45e9-8f7d-226c6fe8e864 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:42.719788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76cb78a0-22e0-45e9-8f7d-226c6fe8e864 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:42.720263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76cb78a0-22e0-45e9-8f7d-226c6fe8e864 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:42.720695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76cb78a0-22e0-45e9-8f7d-226c6fe8e864 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:42.721404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76cb78a0-22e0-45e9-8f7d-226c6fe8e864 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:42.721856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76cb78a0-22e0-45e9-8f7d-226c6fe8e864 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:42.722269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-76cb78a0-22e0-45e9-8f7d-226c6fe8e864 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:42.783990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-76cb78a0-22e0-45e9-8f7d-226c6fe8e864 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:42.792080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-76cb78a0-22e0-45e9-8f7d-226c6fe8e864 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083191 Aug 31 00:46:42.792642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 899/1870] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:42 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:43.144831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f06f7c2b-980f-4dbb-987a-f95786e9abb9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:43.145429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f06f7c2b-980f-4dbb-987a-f95786e9abb9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:43.151832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f06f7c2b-980f-4dbb-987a-f95786e9abb9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:43.152307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f06f7c2b-980f-4dbb-987a-f95786e9abb9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:43.152772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f06f7c2b-980f-4dbb-987a-f95786e9abb9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:43.153454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f06f7c2b-980f-4dbb-987a-f95786e9abb9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:43.153896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f06f7c2b-980f-4dbb-987a-f95786e9abb9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:43.154311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f06f7c2b-980f-4dbb-987a-f95786e9abb9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:43.286979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f06f7c2b-980f-4dbb-987a-f95786e9abb9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:43.295355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f06f7c2b-980f-4dbb-987a-f95786e9abb9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154397 Aug 31 00:46:43.295917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 972/1871] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:43 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:43.813545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3d192c09-fa7f-4d5b-8d98-e9c76ed50bcf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:43.814355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3d192c09-fa7f-4d5b-8d98-e9c76ed50bcf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:43.821415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d192c09-fa7f-4d5b-8d98-e9c76ed50bcf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:43.821898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d192c09-fa7f-4d5b-8d98-e9c76ed50bcf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:43.822334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d192c09-fa7f-4d5b-8d98-e9c76ed50bcf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:43.823089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d192c09-fa7f-4d5b-8d98-e9c76ed50bcf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:43.823539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d192c09-fa7f-4d5b-8d98-e9c76ed50bcf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:43.823963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d192c09-fa7f-4d5b-8d98-e9c76ed50bcf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:43.885389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3d192c09-fa7f-4d5b-8d98-e9c76ed50bcf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:43.894052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3d192c09-fa7f-4d5b-8d98-e9c76ed50bcf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084318 Aug 31 00:46:43.894619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 900/1872] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:43 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:44.315808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-06d3c30d-91bb-42d1-9c90-471ec72ae758 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:44.316414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-06d3c30d-91bb-42d1-9c90-471ec72ae758 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:44.322911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d3c30d-91bb-42d1-9c90-471ec72ae758 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:44.323427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d3c30d-91bb-42d1-9c90-471ec72ae758 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:44.323866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d3c30d-91bb-42d1-9c90-471ec72ae758 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:44.324553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d3c30d-91bb-42d1-9c90-471ec72ae758 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:44.325005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d3c30d-91bb-42d1-9c90-471ec72ae758 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:44.325428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06d3c30d-91bb-42d1-9c90-471ec72ae758 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:44.340353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:44.454508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-06d3c30d-91bb-42d1-9c90-471ec72ae758 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:44.462830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-06d3c30d-91bb-42d1-9c90-471ec72ae758 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151191 Aug 31 00:46:44.463414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 973/1873] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:44 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:44.915862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93983d11-9e40-48c9-9bef-a72a0a00ee0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:44.916448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-93983d11-9e40-48c9-9bef-a72a0a00ee0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:44.922770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93983d11-9e40-48c9-9bef-a72a0a00ee0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:44.923266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93983d11-9e40-48c9-9bef-a72a0a00ee0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:44.923689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93983d11-9e40-48c9-9bef-a72a0a00ee0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:44.924362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93983d11-9e40-48c9-9bef-a72a0a00ee0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:44.924804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93983d11-9e40-48c9-9bef-a72a0a00ee0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:44.925215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93983d11-9e40-48c9-9bef-a72a0a00ee0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:44.994731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-93983d11-9e40-48c9-9bef-a72a0a00ee0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:45.003576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-93983d11-9e40-48c9-9bef-a72a0a00ee0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.091521 Aug 31 00:46:45.004111 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 901/1874] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:44 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:45.484715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d7a5ea5d-153d-4651-bf31-032218d88db3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:45.485293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d7a5ea5d-153d-4651-bf31-032218d88db3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:45.492371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7a5ea5d-153d-4651-bf31-032218d88db3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:45.492855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7a5ea5d-153d-4651-bf31-032218d88db3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:45.493282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7a5ea5d-153d-4651-bf31-032218d88db3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:45.493971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7a5ea5d-153d-4651-bf31-032218d88db3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:45.494422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7a5ea5d-153d-4651-bf31-032218d88db3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:45.494842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7a5ea5d-153d-4651-bf31-032218d88db3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:45.624475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d7a5ea5d-153d-4651-bf31-032218d88db3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:45.633714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d7a5ea5d-153d-4651-bf31-032218d88db3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153115 Aug 31 00:46:45.634280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 974/1875] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:45 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:46.025366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-07fd182a-1b19-4616-8594-54ef50b902c5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:46.025966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-07fd182a-1b19-4616-8594-54ef50b902c5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:46.032319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07fd182a-1b19-4616-8594-54ef50b902c5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:46.032788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07fd182a-1b19-4616-8594-54ef50b902c5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:46.033243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07fd182a-1b19-4616-8594-54ef50b902c5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:46.034084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07fd182a-1b19-4616-8594-54ef50b902c5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:46.034524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07fd182a-1b19-4616-8594-54ef50b902c5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:46.034933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07fd182a-1b19-4616-8594-54ef50b902c5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:46.095458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-07fd182a-1b19-4616-8594-54ef50b902c5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:46.104070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-07fd182a-1b19-4616-8594-54ef50b902c5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082618 Aug 31 00:46:46.104623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 902/1876] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:46 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:46.654001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-64b71155-26d8-4093-87de-532ec86bec27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:46.654625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-64b71155-26d8-4093-87de-532ec86bec27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:46.661993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64b71155-26d8-4093-87de-532ec86bec27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:46.662467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64b71155-26d8-4093-87de-532ec86bec27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:46.662898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64b71155-26d8-4093-87de-532ec86bec27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:46.663613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64b71155-26d8-4093-87de-532ec86bec27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:46.664062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64b71155-26d8-4093-87de-532ec86bec27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:46.664478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-64b71155-26d8-4093-87de-532ec86bec27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:46.792453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-64b71155-26d8-4093-87de-532ec86bec27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:46.801522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-64b71155-26d8-4093-87de-532ec86bec27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151384 Aug 31 00:46:46.802083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 975/1877] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:46 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:47.126380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-44997d90-2135-4ad7-a661-d6bcec3da818 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:47.126984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-44997d90-2135-4ad7-a661-d6bcec3da818 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:47.133405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44997d90-2135-4ad7-a661-d6bcec3da818 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:47.133881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44997d90-2135-4ad7-a661-d6bcec3da818 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:47.134307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44997d90-2135-4ad7-a661-d6bcec3da818 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:47.134983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44997d90-2135-4ad7-a661-d6bcec3da818 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:47.135456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44997d90-2135-4ad7-a661-d6bcec3da818 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:47.135871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44997d90-2135-4ad7-a661-d6bcec3da818 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:47.197636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-44997d90-2135-4ad7-a661-d6bcec3da818 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:47.206440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-44997d90-2135-4ad7-a661-d6bcec3da818 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083870 Aug 31 00:46:47.207111 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 903/1878] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:47 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:47.822950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4e0e1800-4c4c-40e8-b35e-f6c3974f42f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:47.823549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4e0e1800-4c4c-40e8-b35e-f6c3974f42f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:47.829916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e0e1800-4c4c-40e8-b35e-f6c3974f42f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:47.830420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e0e1800-4c4c-40e8-b35e-f6c3974f42f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:47.830952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e0e1800-4c4c-40e8-b35e-f6c3974f42f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:47.831665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e0e1800-4c4c-40e8-b35e-f6c3974f42f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:47.832115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e0e1800-4c4c-40e8-b35e-f6c3974f42f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:47.832537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e0e1800-4c4c-40e8-b35e-f6c3974f42f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:47.958362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4e0e1800-4c4c-40e8-b35e-f6c3974f42f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:47.966472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4e0e1800-4c4c-40e8-b35e-f6c3974f42f4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.147556 Aug 31 00:46:47.967062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 976/1879] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:47 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:48.227652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-73ae4fcb-5553-41c7-aa3e-3d8daf62f1e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:48.228258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-73ae4fcb-5553-41c7-aa3e-3d8daf62f1e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:48.234996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73ae4fcb-5553-41c7-aa3e-3d8daf62f1e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:48.235517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73ae4fcb-5553-41c7-aa3e-3d8daf62f1e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:48.235988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73ae4fcb-5553-41c7-aa3e-3d8daf62f1e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:48.237282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73ae4fcb-5553-41c7-aa3e-3d8daf62f1e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:48.238096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73ae4fcb-5553-41c7-aa3e-3d8daf62f1e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:48.238581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73ae4fcb-5553-41c7-aa3e-3d8daf62f1e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:48.304463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-73ae4fcb-5553-41c7-aa3e-3d8daf62f1e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:48.307014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:48.318693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-73ae4fcb-5553-41c7-aa3e-3d8daf62f1e2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.094251 Aug 31 00:46:48.319787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 904/1880] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:48 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:48.989032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5e2138ff-3f1b-4d30-b93e-43922ff7282e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:48.989674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5e2138ff-3f1b-4d30-b93e-43922ff7282e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:48.996198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e2138ff-3f1b-4d30-b93e-43922ff7282e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:48.996681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e2138ff-3f1b-4d30-b93e-43922ff7282e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:48.997118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e2138ff-3f1b-4d30-b93e-43922ff7282e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:48.997817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e2138ff-3f1b-4d30-b93e-43922ff7282e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:48.998269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e2138ff-3f1b-4d30-b93e-43922ff7282e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:48.998693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e2138ff-3f1b-4d30-b93e-43922ff7282e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:49.126764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5e2138ff-3f1b-4d30-b93e-43922ff7282e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:49.135973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5e2138ff-3f1b-4d30-b93e-43922ff7282e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151509 Aug 31 00:46:49.136546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 977/1881] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:48 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:49.348010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-43b1b0be-8ba8-4ed5-bfa6-7843f1e3777b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:49.348621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-43b1b0be-8ba8-4ed5-bfa6-7843f1e3777b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:49.355093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b1b0be-8ba8-4ed5-bfa6-7843f1e3777b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:49.355581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b1b0be-8ba8-4ed5-bfa6-7843f1e3777b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:49.356010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b1b0be-8ba8-4ed5-bfa6-7843f1e3777b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:49.356692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b1b0be-8ba8-4ed5-bfa6-7843f1e3777b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:49.357136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b1b0be-8ba8-4ed5-bfa6-7843f1e3777b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:49.357552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b1b0be-8ba8-4ed5-bfa6-7843f1e3777b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:49.420134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-43b1b0be-8ba8-4ed5-bfa6-7843f1e3777b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:49.429027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-43b1b0be-8ba8-4ed5-bfa6-7843f1e3777b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085356 Aug 31 00:46:49.429591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 905/1882] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:49 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:50.161064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d5e788d-5bcd-427b-a62e-e0ed92522cd6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:50.161705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d5e788d-5bcd-427b-a62e-e0ed92522cd6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:50.168291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d5e788d-5bcd-427b-a62e-e0ed92522cd6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:50.168804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d5e788d-5bcd-427b-a62e-e0ed92522cd6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:50.169236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d5e788d-5bcd-427b-a62e-e0ed92522cd6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:50.169926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d5e788d-5bcd-427b-a62e-e0ed92522cd6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:50.170371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d5e788d-5bcd-427b-a62e-e0ed92522cd6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:50.170788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d5e788d-5bcd-427b-a62e-e0ed92522cd6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:50.301729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8d5e788d-5bcd-427b-a62e-e0ed92522cd6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:50.309893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d5e788d-5bcd-427b-a62e-e0ed92522cd6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156018 Aug 31 00:46:50.310453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 978/1883] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:50 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:50.450169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4f48fdd3-6936-454f-9240-0e46452e921b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:50.450779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4f48fdd3-6936-454f-9240-0e46452e921b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:50.458248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f48fdd3-6936-454f-9240-0e46452e921b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:50.458734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f48fdd3-6936-454f-9240-0e46452e921b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:50.459199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f48fdd3-6936-454f-9240-0e46452e921b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:50.459897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f48fdd3-6936-454f-9240-0e46452e921b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:50.460349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f48fdd3-6936-454f-9240-0e46452e921b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:50.460784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f48fdd3-6936-454f-9240-0e46452e921b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:50.530598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4f48fdd3-6936-454f-9240-0e46452e921b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:50.539074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4f48fdd3-6936-454f-9240-0e46452e921b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.092806 Aug 31 00:46:50.539636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 906/1884] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:50 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:51.333137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b562e0a0-57e0-4223-b2d7-412f8fce1651 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:51.333722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b562e0a0-57e0-4223-b2d7-412f8fce1651 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:51.339827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b562e0a0-57e0-4223-b2d7-412f8fce1651 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:51.340305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b562e0a0-57e0-4223-b2d7-412f8fce1651 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:51.340733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b562e0a0-57e0-4223-b2d7-412f8fce1651 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:51.341416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b562e0a0-57e0-4223-b2d7-412f8fce1651 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:51.341863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b562e0a0-57e0-4223-b2d7-412f8fce1651 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:51.342285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b562e0a0-57e0-4223-b2d7-412f8fce1651 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:51.471877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b562e0a0-57e0-4223-b2d7-412f8fce1651 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:51.480057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b562e0a0-57e0-4223-b2d7-412f8fce1651 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151145 Aug 31 00:46:51.480614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 979/1885] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:51 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:51.563292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fd6b3c27-7bf1-4f9d-ae4e-c9aee288961e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:51.563981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fd6b3c27-7bf1-4f9d-ae4e-c9aee288961e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:51.570996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fd6b3c27-7bf1-4f9d-ae4e-c9aee288961e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:51.571504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fd6b3c27-7bf1-4f9d-ae4e-c9aee288961e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:51.571935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fd6b3c27-7bf1-4f9d-ae4e-c9aee288961e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:51.572615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fd6b3c27-7bf1-4f9d-ae4e-c9aee288961e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:51.573059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fd6b3c27-7bf1-4f9d-ae4e-c9aee288961e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:51.573475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fd6b3c27-7bf1-4f9d-ae4e-c9aee288961e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:51.638280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fd6b3c27-7bf1-4f9d-ae4e-c9aee288961e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:51.646694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fd6b3c27-7bf1-4f9d-ae4e-c9aee288961e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087328 Aug 31 00:46:51.647294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 907/1886] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:51 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:52.503277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-86cf69bb-8c86-43ab-bde8-7b84cd50b980 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:52.504179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-86cf69bb-8c86-43ab-bde8-7b84cd50b980 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:52.511544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86cf69bb-8c86-43ab-bde8-7b84cd50b980 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:52.512023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86cf69bb-8c86-43ab-bde8-7b84cd50b980 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:52.512455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86cf69bb-8c86-43ab-bde8-7b84cd50b980 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:52.513148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86cf69bb-8c86-43ab-bde8-7b84cd50b980 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:52.513588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86cf69bb-8c86-43ab-bde8-7b84cd50b980 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:52.513994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86cf69bb-8c86-43ab-bde8-7b84cd50b980 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:52.662764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-86cf69bb-8c86-43ab-bde8-7b84cd50b980 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:52.668394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c26d6afb-bd9e-440a-bbfc-ab6b8a3f6e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:52.669109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c26d6afb-bd9e-440a-bbfc-ab6b8a3f6e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:52.671479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-86cf69bb-8c86-43ab-bde8-7b84cd50b980 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.172589 Aug 31 00:46:52.672069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 980/1887] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:52 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:52.676651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c26d6afb-bd9e-440a-bbfc-ab6b8a3f6e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:52.677210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c26d6afb-bd9e-440a-bbfc-ab6b8a3f6e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:52.677716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c26d6afb-bd9e-440a-bbfc-ab6b8a3f6e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:52.678484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c26d6afb-bd9e-440a-bbfc-ab6b8a3f6e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:52.679010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c26d6afb-bd9e-440a-bbfc-ab6b8a3f6e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:52.679493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c26d6afb-bd9e-440a-bbfc-ab6b8a3f6e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:52.743002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c26d6afb-bd9e-440a-bbfc-ab6b8a3f6e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:52.751205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c26d6afb-bd9e-440a-bbfc-ab6b8a3f6e40 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086793 Aug 31 00:46:52.751762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 908/1888] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:52 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:53.693439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-52923609-72f4-4bc2-9d41-405224a6492b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:53.693991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-52923609-72f4-4bc2-9d41-405224a6492b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:53.700393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52923609-72f4-4bc2-9d41-405224a6492b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:53.700865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52923609-72f4-4bc2-9d41-405224a6492b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:53.701285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52923609-72f4-4bc2-9d41-405224a6492b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:53.701962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52923609-72f4-4bc2-9d41-405224a6492b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:53.702403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52923609-72f4-4bc2-9d41-405224a6492b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:53.702815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52923609-72f4-4bc2-9d41-405224a6492b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:53.772593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ca4123fd-3e4b-46c5-9106-e921cfb14738 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:53.773307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ca4123fd-3e4b-46c5-9106-e921cfb14738 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:53.779753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4123fd-3e4b-46c5-9106-e921cfb14738 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:53.780553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4123fd-3e4b-46c5-9106-e921cfb14738 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:53.780704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4123fd-3e4b-46c5-9106-e921cfb14738 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:53.781359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4123fd-3e4b-46c5-9106-e921cfb14738 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:53.781800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4123fd-3e4b-46c5-9106-e921cfb14738 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:53.782783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4123fd-3e4b-46c5-9106-e921cfb14738 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:53.858033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca4123fd-3e4b-46c5-9106-e921cfb14738 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:53.866857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-52923609-72f4-4bc2-9d41-405224a6492b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:53.867610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ca4123fd-3e4b-46c5-9106-e921cfb14738 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.098866 Aug 31 00:46:53.868186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 909/1889] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:53 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:53.875139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-52923609-72f4-4bc2-9d41-405224a6492b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.186303 Aug 31 00:46:53.875700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 981/1890] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:53 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:54.889691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-426aba4b-689f-4bb6-9e35-53c9c57375b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:54.890300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-426aba4b-689f-4bb6-9e35-53c9c57375b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:54.897877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-426aba4b-689f-4bb6-9e35-53c9c57375b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:54.898356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-426aba4b-689f-4bb6-9e35-53c9c57375b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:54.898789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-426aba4b-689f-4bb6-9e35-53c9c57375b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:54.899508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-426aba4b-689f-4bb6-9e35-53c9c57375b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:54.899958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-426aba4b-689f-4bb6-9e35-53c9c57375b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:54.900374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-426aba4b-689f-4bb6-9e35-53c9c57375b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:54.901454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-be600a18-05e9-4b96-b369-0d1d3ceb1c27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:54.902371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-be600a18-05e9-4b96-b369-0d1d3ceb1c27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:54.909442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be600a18-05e9-4b96-b369-0d1d3ceb1c27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:54.909915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be600a18-05e9-4b96-b369-0d1d3ceb1c27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:54.910340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be600a18-05e9-4b96-b369-0d1d3ceb1c27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:54.911020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be600a18-05e9-4b96-b369-0d1d3ceb1c27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:54.911489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be600a18-05e9-4b96-b369-0d1d3ceb1c27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:54.911899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be600a18-05e9-4b96-b369-0d1d3ceb1c27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:54.970036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-426aba4b-689f-4bb6-9e35-53c9c57375b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:54.978649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-426aba4b-689f-4bb6-9e35-53c9c57375b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.092760 Aug 31 00:46:54.979251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 910/1891] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:54 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:55.051806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-be600a18-05e9-4b96-b369-0d1d3ceb1c27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:55.059985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-be600a18-05e9-4b96-b369-0d1d3ceb1c27 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.163390 Aug 31 00:46:55.060540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 982/1892] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:54 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:56.000715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bd38c941-b9d9-452f-93c7-a91782bcb578 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:56.001357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bd38c941-b9d9-452f-93c7-a91782bcb578 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:56.008692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd38c941-b9d9-452f-93c7-a91782bcb578 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:56.009176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd38c941-b9d9-452f-93c7-a91782bcb578 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:56.009616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd38c941-b9d9-452f-93c7-a91782bcb578 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:56.010304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd38c941-b9d9-452f-93c7-a91782bcb578 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:56.010753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd38c941-b9d9-452f-93c7-a91782bcb578 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:56.011213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd38c941-b9d9-452f-93c7-a91782bcb578 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:56.074518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bd38c941-b9d9-452f-93c7-a91782bcb578 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:56.082143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2280a145-1370-4171-9ec8-9935e6476a32 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:56.082784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2280a145-1370-4171-9ec8-9935e6476a32 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:56.082918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bd38c941-b9d9-452f-93c7-a91782bcb578 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086046 Aug 31 00:46:56.083512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 911/1893] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:55 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:56.089123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2280a145-1370-4171-9ec8-9935e6476a32 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:56.089609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2280a145-1370-4171-9ec8-9935e6476a32 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:56.090047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2280a145-1370-4171-9ec8-9935e6476a32 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:56.090742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2280a145-1370-4171-9ec8-9935e6476a32 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:56.091232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2280a145-1370-4171-9ec8-9935e6476a32 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:56.091656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2280a145-1370-4171-9ec8-9935e6476a32 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:56.219978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2280a145-1370-4171-9ec8-9935e6476a32 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:56.229154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2280a145-1370-4171-9ec8-9935e6476a32 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151325 Aug 31 00:46:56.229725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 983/1894] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:56 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:57.104142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-12cf75b1-6b00-43e6-ac36-3e6835f4cdc4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:57.104749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-12cf75b1-6b00-43e6-ac36-3e6835f4cdc4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:57.111469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12cf75b1-6b00-43e6-ac36-3e6835f4cdc4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:57.111958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12cf75b1-6b00-43e6-ac36-3e6835f4cdc4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:57.112455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12cf75b1-6b00-43e6-ac36-3e6835f4cdc4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:57.113181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12cf75b1-6b00-43e6-ac36-3e6835f4cdc4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:57.113636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12cf75b1-6b00-43e6-ac36-3e6835f4cdc4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:57.114059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12cf75b1-6b00-43e6-ac36-3e6835f4cdc4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:57.175697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-12cf75b1-6b00-43e6-ac36-3e6835f4cdc4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:57.183923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-12cf75b1-6b00-43e6-ac36-3e6835f4cdc4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083674 Aug 31 00:46:57.184479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 912/1895] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:57 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:57.250550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a0e7f85e-1215-4e83-9c85-106e7d0d1479 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:57.251273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a0e7f85e-1215-4e83-9c85-106e7d0d1479 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:57.258120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0e7f85e-1215-4e83-9c85-106e7d0d1479 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:57.258599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0e7f85e-1215-4e83-9c85-106e7d0d1479 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:57.259030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0e7f85e-1215-4e83-9c85-106e7d0d1479 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:57.259756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0e7f85e-1215-4e83-9c85-106e7d0d1479 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:57.260204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0e7f85e-1215-4e83-9c85-106e7d0d1479 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:57.260623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0e7f85e-1215-4e83-9c85-106e7d0d1479 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:57.392159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a0e7f85e-1215-4e83-9c85-106e7d0d1479 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:57.400722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a0e7f85e-1215-4e83-9c85-106e7d0d1479 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154145 Aug 31 00:46:57.401290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 984/1896] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:57 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:58.206615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3bfe0867-7ad3-4a4f-a557-b2fb85f5b07a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:58.207244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3bfe0867-7ad3-4a4f-a557-b2fb85f5b07a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:58.213559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfe0867-7ad3-4a4f-a557-b2fb85f5b07a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:58.214030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfe0867-7ad3-4a4f-a557-b2fb85f5b07a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:58.214458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfe0867-7ad3-4a4f-a557-b2fb85f5b07a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:58.215159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfe0867-7ad3-4a4f-a557-b2fb85f5b07a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:58.215605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfe0867-7ad3-4a4f-a557-b2fb85f5b07a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:58.216019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bfe0867-7ad3-4a4f-a557-b2fb85f5b07a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:58.276890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3bfe0867-7ad3-4a4f-a557-b2fb85f5b07a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:58.285903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3bfe0867-7ad3-4a4f-a557-b2fb85f5b07a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083923 Aug 31 00:46:58.286463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 913/1897] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:58 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:58.421664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4e213e9b-d306-4ee4-be07-5109c9e12fc6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:58.422249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4e213e9b-d306-4ee4-be07-5109c9e12fc6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:58.429031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e213e9b-d306-4ee4-be07-5109c9e12fc6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:58.429508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e213e9b-d306-4ee4-be07-5109c9e12fc6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:58.429939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e213e9b-d306-4ee4-be07-5109c9e12fc6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:58.430624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e213e9b-d306-4ee4-be07-5109c9e12fc6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:58.431094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e213e9b-d306-4ee4-be07-5109c9e12fc6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:58.431513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e213e9b-d306-4ee4-be07-5109c9e12fc6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:58.562580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4e213e9b-d306-4ee4-be07-5109c9e12fc6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:58.571313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4e213e9b-d306-4ee4-be07-5109c9e12fc6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153492 Aug 31 00:46:58.571876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 985/1898] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:58 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:59.306981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ae2fe06e-5f57-4a14-a834-7996515863e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:59.307617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ae2fe06e-5f57-4a14-a834-7996515863e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:59.313925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae2fe06e-5f57-4a14-a834-7996515863e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:59.314399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae2fe06e-5f57-4a14-a834-7996515863e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:59.314933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae2fe06e-5f57-4a14-a834-7996515863e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:59.315640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae2fe06e-5f57-4a14-a834-7996515863e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:59.316091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae2fe06e-5f57-4a14-a834-7996515863e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:59.316511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae2fe06e-5f57-4a14-a834-7996515863e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:59.383799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ae2fe06e-5f57-4a14-a834-7996515863e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:59.391989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ae2fe06e-5f57-4a14-a834-7996515863e0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088828 Aug 31 00:46:59.392551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 914/1899] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:59 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:59.593204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0cda1e2e-078d-42d2-8a68-d4f185344adf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:59.593810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0cda1e2e-078d-42d2-8a68-d4f185344adf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:59.601171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cda1e2e-078d-42d2-8a68-d4f185344adf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:59.601655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cda1e2e-078d-42d2-8a68-d4f185344adf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:59.602092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cda1e2e-078d-42d2-8a68-d4f185344adf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:59.602823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cda1e2e-078d-42d2-8a68-d4f185344adf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:59.603306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cda1e2e-078d-42d2-8a68-d4f185344adf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:59.603731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cda1e2e-078d-42d2-8a68-d4f185344adf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:59.733104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0cda1e2e-078d-42d2-8a68-d4f185344adf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:59.742220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0cda1e2e-078d-42d2-8a68-d4f185344adf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152874 Aug 31 00:46:59.742794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 986/1900] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:59 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:00.413811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-11a2b6f9-dfb6-45a3-bffb-c1d5ce9d353e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:00.414398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-11a2b6f9-dfb6-45a3-bffb-c1d5ce9d353e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:00.420768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-11a2b6f9-dfb6-45a3-bffb-c1d5ce9d353e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:00.421248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-11a2b6f9-dfb6-45a3-bffb-c1d5ce9d353e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:00.421682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-11a2b6f9-dfb6-45a3-bffb-c1d5ce9d353e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:00.422369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-11a2b6f9-dfb6-45a3-bffb-c1d5ce9d353e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:00.422817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-11a2b6f9-dfb6-45a3-bffb-c1d5ce9d353e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:00.423266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-11a2b6f9-dfb6-45a3-bffb-c1d5ce9d353e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:00.484432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-11a2b6f9-dfb6-45a3-bffb-c1d5ce9d353e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:00.496162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-11a2b6f9-dfb6-45a3-bffb-c1d5ce9d353e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086256 Aug 31 00:47:00.496747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 915/1901] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:00.763394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aa802c45-0aec-410f-92f3-9e4ce8997a10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:00.763952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aa802c45-0aec-410f-92f3-9e4ce8997a10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:00.770366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa802c45-0aec-410f-92f3-9e4ce8997a10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:00.770848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa802c45-0aec-410f-92f3-9e4ce8997a10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:00.771323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa802c45-0aec-410f-92f3-9e4ce8997a10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:00.772012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa802c45-0aec-410f-92f3-9e4ce8997a10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:00.772462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa802c45-0aec-410f-92f3-9e4ce8997a10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:00.772889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa802c45-0aec-410f-92f3-9e4ce8997a10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:00.901570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aa802c45-0aec-410f-92f3-9e4ce8997a10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:00.912088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aa802c45-0aec-410f-92f3-9e4ce8997a10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150281 Aug 31 00:47:00.912690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 987/1902] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:00 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:01.518150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4f07a730-e168-442e-9995-703b74ba1b98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:01.518848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4f07a730-e168-442e-9995-703b74ba1b98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:01.528837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f07a730-e168-442e-9995-703b74ba1b98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:01.529326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f07a730-e168-442e-9995-703b74ba1b98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:01.529753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f07a730-e168-442e-9995-703b74ba1b98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:01.531379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f07a730-e168-442e-9995-703b74ba1b98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:01.531379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f07a730-e168-442e-9995-703b74ba1b98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:01.531379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f07a730-e168-442e-9995-703b74ba1b98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:01.595087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4f07a730-e168-442e-9995-703b74ba1b98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:01.603827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4f07a730-e168-442e-9995-703b74ba1b98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089532 Aug 31 00:47:01.604396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 916/1903] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:01 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:01.934048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5c218b52-9dca-4b6a-b830-a9731ab32733 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:01.934596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5c218b52-9dca-4b6a-b830-a9731ab32733 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:01.941318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c218b52-9dca-4b6a-b830-a9731ab32733 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:01.941923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c218b52-9dca-4b6a-b830-a9731ab32733 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:01.942894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c218b52-9dca-4b6a-b830-a9731ab32733 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:01.943630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c218b52-9dca-4b6a-b830-a9731ab32733 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:01.944083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c218b52-9dca-4b6a-b830-a9731ab32733 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:01.944507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c218b52-9dca-4b6a-b830-a9731ab32733 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:02.073123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5c218b52-9dca-4b6a-b830-a9731ab32733 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:02.081989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5c218b52-9dca-4b6a-b830-a9731ab32733 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151780 Aug 31 00:47:02.082695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 988/1904] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:01 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:02.624521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-737f9b9e-6ce0-41f3-91eb-5810676acebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:02.625139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-737f9b9e-6ce0-41f3-91eb-5810676acebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:02.631966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-737f9b9e-6ce0-41f3-91eb-5810676acebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:02.632449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-737f9b9e-6ce0-41f3-91eb-5810676acebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:02.632883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-737f9b9e-6ce0-41f3-91eb-5810676acebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:02.633569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-737f9b9e-6ce0-41f3-91eb-5810676acebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:02.634020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-737f9b9e-6ce0-41f3-91eb-5810676acebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:02.634438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-737f9b9e-6ce0-41f3-91eb-5810676acebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:02.699767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-737f9b9e-6ce0-41f3-91eb-5810676acebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:02.709093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-737f9b9e-6ce0-41f3-91eb-5810676acebd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088433 Aug 31 00:47:02.709655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 917/1905] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:02 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:03.102552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f1b62f78-3cad-478a-b296-d8651714dea6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:03.103177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f1b62f78-3cad-478a-b296-d8651714dea6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:03.109613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1b62f78-3cad-478a-b296-d8651714dea6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:03.110367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1b62f78-3cad-478a-b296-d8651714dea6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:03.110792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1b62f78-3cad-478a-b296-d8651714dea6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:03.111503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1b62f78-3cad-478a-b296-d8651714dea6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:03.111946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1b62f78-3cad-478a-b296-d8651714dea6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:03.112361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1b62f78-3cad-478a-b296-d8651714dea6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:03.243361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f1b62f78-3cad-478a-b296-d8651714dea6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:03.251838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f1b62f78-3cad-478a-b296-d8651714dea6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152945 Aug 31 00:47:03.252233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 989/1906] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:03 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:03.731512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bf383d8c-8664-4ba6-8bc2-677504071858 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:03.732101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bf383d8c-8664-4ba6-8bc2-677504071858 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:03.734435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=56 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:03.740757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf383d8c-8664-4ba6-8bc2-677504071858 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:03.741233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf383d8c-8664-4ba6-8bc2-677504071858 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:03.741657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf383d8c-8664-4ba6-8bc2-677504071858 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:03.742341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf383d8c-8664-4ba6-8bc2-677504071858 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:03.742812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf383d8c-8664-4ba6-8bc2-677504071858 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:03.743254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf383d8c-8664-4ba6-8bc2-677504071858 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:03.805439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bf383d8c-8664-4ba6-8bc2-677504071858 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:03.813460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bf383d8c-8664-4ba6-8bc2-677504071858 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086110 Aug 31 00:47:03.814018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 918/1907] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:03 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:04.273971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-85482323-9496-4af9-a062-51066abf66dd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:04.274611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-85482323-9496-4af9-a062-51066abf66dd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:04.281044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85482323-9496-4af9-a062-51066abf66dd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:04.281527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85482323-9496-4af9-a062-51066abf66dd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:04.282062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85482323-9496-4af9-a062-51066abf66dd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:04.282758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85482323-9496-4af9-a062-51066abf66dd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:04.283244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85482323-9496-4af9-a062-51066abf66dd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:04.283675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85482323-9496-4af9-a062-51066abf66dd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:04.287140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:04.417743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-85482323-9496-4af9-a062-51066abf66dd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:04.426082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-85482323-9496-4af9-a062-51066abf66dd tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156844 Aug 31 00:47:04.426646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 990/1908] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:04 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:04.833862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c82d5900-2178-4a14-ad02-9d22446d20c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:04.834481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c82d5900-2178-4a14-ad02-9d22446d20c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:04.840927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c82d5900-2178-4a14-ad02-9d22446d20c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:04.841408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c82d5900-2178-4a14-ad02-9d22446d20c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:04.841840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c82d5900-2178-4a14-ad02-9d22446d20c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:04.842523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c82d5900-2178-4a14-ad02-9d22446d20c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:04.842975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c82d5900-2178-4a14-ad02-9d22446d20c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:04.843445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c82d5900-2178-4a14-ad02-9d22446d20c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:04.904266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c82d5900-2178-4a14-ad02-9d22446d20c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:04.912638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c82d5900-2178-4a14-ad02-9d22446d20c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082786 Aug 31 00:47:04.913195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 919/1909] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:04 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:05.447314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c117c819-0e18-48b7-b001-76114ee91018 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:05.447924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c117c819-0e18-48b7-b001-76114ee91018 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:05.454460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c117c819-0e18-48b7-b001-76114ee91018 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:05.454943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c117c819-0e18-48b7-b001-76114ee91018 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:05.455411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c117c819-0e18-48b7-b001-76114ee91018 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:05.456103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c117c819-0e18-48b7-b001-76114ee91018 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:05.456631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c117c819-0e18-48b7-b001-76114ee91018 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:05.457065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c117c819-0e18-48b7-b001-76114ee91018 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:05.596249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c117c819-0e18-48b7-b001-76114ee91018 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:05.605558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c117c819-0e18-48b7-b001-76114ee91018 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.162241 Aug 31 00:47:05.606121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 991/1910] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:05 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:05.936541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9b9480d2-3796-4f7a-8cc5-5b8ae4011820 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:05.937387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9b9480d2-3796-4f7a-8cc5-5b8ae4011820 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:05.948151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b9480d2-3796-4f7a-8cc5-5b8ae4011820 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:05.948700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b9480d2-3796-4f7a-8cc5-5b8ae4011820 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:05.949131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b9480d2-3796-4f7a-8cc5-5b8ae4011820 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:05.949830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b9480d2-3796-4f7a-8cc5-5b8ae4011820 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:05.950331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b9480d2-3796-4f7a-8cc5-5b8ae4011820 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:05.950747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b9480d2-3796-4f7a-8cc5-5b8ae4011820 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:06.034076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9b9480d2-3796-4f7a-8cc5-5b8ae4011820 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:06.042482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9b9480d2-3796-4f7a-8cc5-5b8ae4011820 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.112597 Aug 31 00:47:06.043090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 920/1911] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:05 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:06.626023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8149709a-8327-423c-92ae-cb8ced02748b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:06.626612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8149709a-8327-423c-92ae-cb8ced02748b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:06.633582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8149709a-8327-423c-92ae-cb8ced02748b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:06.634084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8149709a-8327-423c-92ae-cb8ced02748b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:06.634525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8149709a-8327-423c-92ae-cb8ced02748b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:06.635763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8149709a-8327-423c-92ae-cb8ced02748b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:06.636218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8149709a-8327-423c-92ae-cb8ced02748b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:06.636634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8149709a-8327-423c-92ae-cb8ced02748b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:06.762790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8149709a-8327-423c-92ae-cb8ced02748b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:06.771213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8149709a-8327-423c-92ae-cb8ced02748b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149069 Aug 31 00:47:06.771776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 992/1912] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:06 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:07.063060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d477debc-3be5-49ea-b937-4f7d86c51004 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:07.063698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d477debc-3be5-49ea-b937-4f7d86c51004 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:07.070520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d477debc-3be5-49ea-b937-4f7d86c51004 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:07.071144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d477debc-3be5-49ea-b937-4f7d86c51004 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:07.071579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d477debc-3be5-49ea-b937-4f7d86c51004 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:07.072344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d477debc-3be5-49ea-b937-4f7d86c51004 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:07.072793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d477debc-3be5-49ea-b937-4f7d86c51004 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:07.073262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d477debc-3be5-49ea-b937-4f7d86c51004 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:07.092232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:07.139541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d477debc-3be5-49ea-b937-4f7d86c51004 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:07.148400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d477debc-3be5-49ea-b937-4f7d86c51004 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089257 Aug 31 00:47:07.148960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 921/1913] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:07 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:07.792014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-92016d13-143d-4638-9a8f-784516e7770a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:07.792562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-92016d13-143d-4638-9a8f-784516e7770a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:07.794840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:07.800771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92016d13-143d-4638-9a8f-784516e7770a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:07.801264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92016d13-143d-4638-9a8f-784516e7770a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:07.801694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92016d13-143d-4638-9a8f-784516e7770a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:07.802414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92016d13-143d-4638-9a8f-784516e7770a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:07.802868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92016d13-143d-4638-9a8f-784516e7770a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:07.803318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92016d13-143d-4638-9a8f-784516e7770a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:07.933661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-92016d13-143d-4638-9a8f-784516e7770a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:07.942703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-92016d13-143d-4638-9a8f-784516e7770a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154650 Aug 31 00:47:07.943294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 993/1914] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:07 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:08.169707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c9cb357-1b16-4936-bac9-1298913607ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:08.170334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c9cb357-1b16-4936-bac9-1298913607ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:08.177393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9cb357-1b16-4936-bac9-1298913607ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:08.177866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9cb357-1b16-4936-bac9-1298913607ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:08.178291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9cb357-1b16-4936-bac9-1298913607ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:08.178968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9cb357-1b16-4936-bac9-1298913607ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:08.179435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9cb357-1b16-4936-bac9-1298913607ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:08.179848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9cb357-1b16-4936-bac9-1298913607ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:08.241511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0c9cb357-1b16-4936-bac9-1298913607ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:08.249790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c9cb357-1b16-4936-bac9-1298913607ce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083896 Aug 31 00:47:08.250351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 922/1915] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:08 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:08.966786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-55b8ea49-67cb-4a3b-b855-209c37796fc3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:08.967405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-55b8ea49-67cb-4a3b-b855-209c37796fc3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:08.973999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8ea49-67cb-4a3b-b855-209c37796fc3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:08.974550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8ea49-67cb-4a3b-b855-209c37796fc3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:08.974982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8ea49-67cb-4a3b-b855-209c37796fc3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:08.975706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8ea49-67cb-4a3b-b855-209c37796fc3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:08.976153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8ea49-67cb-4a3b-b855-209c37796fc3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:08.976571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b8ea49-67cb-4a3b-b855-209c37796fc3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:09.108414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-55b8ea49-67cb-4a3b-b855-209c37796fc3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:09.116909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-55b8ea49-67cb-4a3b-b855-209c37796fc3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154044 Aug 31 00:47:09.117471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 994/1916] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:08 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:09.272307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3afab461-82ea-43b9-8fea-7858147de519 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:09.272908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3afab461-82ea-43b9-8fea-7858147de519 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:09.278755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3afab461-82ea-43b9-8fea-7858147de519 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:09.279276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3afab461-82ea-43b9-8fea-7858147de519 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:09.279705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3afab461-82ea-43b9-8fea-7858147de519 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:09.280383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3afab461-82ea-43b9-8fea-7858147de519 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:09.280824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3afab461-82ea-43b9-8fea-7858147de519 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:09.281241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3afab461-82ea-43b9-8fea-7858147de519 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:09.345596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3afab461-82ea-43b9-8fea-7858147de519 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:09.353910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3afab461-82ea-43b9-8fea-7858147de519 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086218 Aug 31 00:47:09.354476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 923/1917] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:09 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:10.138288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-be33c708-7bf7-41ca-86cb-69dc7d7c6df7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:10.138945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-be33c708-7bf7-41ca-86cb-69dc7d7c6df7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:10.146019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be33c708-7bf7-41ca-86cb-69dc7d7c6df7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:10.146499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be33c708-7bf7-41ca-86cb-69dc7d7c6df7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:10.146929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be33c708-7bf7-41ca-86cb-69dc7d7c6df7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:10.147638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be33c708-7bf7-41ca-86cb-69dc7d7c6df7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:10.148080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be33c708-7bf7-41ca-86cb-69dc7d7c6df7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:10.148492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be33c708-7bf7-41ca-86cb-69dc7d7c6df7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:10.273908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-be33c708-7bf7-41ca-86cb-69dc7d7c6df7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:10.282054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-be33c708-7bf7-41ca-86cb-69dc7d7c6df7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.147639 Aug 31 00:47:10.282707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 995/1918] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:10 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:10.376880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-18fcba77-d25f-4828-8991-52403ffdc99a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:10.377502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-18fcba77-d25f-4828-8991-52403ffdc99a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:10.384425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18fcba77-d25f-4828-8991-52403ffdc99a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:10.384902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18fcba77-d25f-4828-8991-52403ffdc99a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:10.385362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18fcba77-d25f-4828-8991-52403ffdc99a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:10.386044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18fcba77-d25f-4828-8991-52403ffdc99a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:10.386489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18fcba77-d25f-4828-8991-52403ffdc99a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:10.386907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18fcba77-d25f-4828-8991-52403ffdc99a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:10.448826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18fcba77-d25f-4828-8991-52403ffdc99a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:10.457608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-18fcba77-d25f-4828-8991-52403ffdc99a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084497 Aug 31 00:47:10.458180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 924/1919] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:10 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:11.303982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9cfc7603-a840-4d60-839e-d1021333ff18 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:11.304535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9cfc7603-a840-4d60-839e-d1021333ff18 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:11.310872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cfc7603-a840-4d60-839e-d1021333ff18 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:11.311373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cfc7603-a840-4d60-839e-d1021333ff18 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:11.311800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cfc7603-a840-4d60-839e-d1021333ff18 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:11.312474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cfc7603-a840-4d60-839e-d1021333ff18 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:11.312917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cfc7603-a840-4d60-839e-d1021333ff18 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:11.313329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9cfc7603-a840-4d60-839e-d1021333ff18 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:11.443973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9cfc7603-a840-4d60-839e-d1021333ff18 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:11.452622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9cfc7603-a840-4d60-839e-d1021333ff18 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152765 Aug 31 00:47:11.452751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 996/1920] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:11 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:11.479381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5ff5c2b9-9abb-45dd-955b-f52acd5ba414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:11.479989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5ff5c2b9-9abb-45dd-955b-f52acd5ba414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:11.486710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5c2b9-9abb-45dd-955b-f52acd5ba414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:11.487222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5c2b9-9abb-45dd-955b-f52acd5ba414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:11.487675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5c2b9-9abb-45dd-955b-f52acd5ba414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:11.488959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5c2b9-9abb-45dd-955b-f52acd5ba414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:11.489409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5c2b9-9abb-45dd-955b-f52acd5ba414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:11.489827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff5c2b9-9abb-45dd-955b-f52acd5ba414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:11.551640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5ff5c2b9-9abb-45dd-955b-f52acd5ba414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:11.559927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5ff5c2b9-9abb-45dd-955b-f52acd5ba414 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084516 Aug 31 00:47:11.560429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 925/1921] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:11 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:12.474066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-603a9f1f-4700-4731-a412-a1733a43be6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:12.475342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-603a9f1f-4700-4731-a412-a1733a43be6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:12.481911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-603a9f1f-4700-4731-a412-a1733a43be6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:12.482389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-603a9f1f-4700-4731-a412-a1733a43be6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:12.482821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-603a9f1f-4700-4731-a412-a1733a43be6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:12.483539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-603a9f1f-4700-4731-a412-a1733a43be6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:12.483990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-603a9f1f-4700-4731-a412-a1733a43be6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:12.484413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-603a9f1f-4700-4731-a412-a1733a43be6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:12.581102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3eb3654b-5c27-4ea3-b8a3-96a48df1c02c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:12.582569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3eb3654b-5c27-4ea3-b8a3-96a48df1c02c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:12.589243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb3654b-5c27-4ea3-b8a3-96a48df1c02c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:12.589808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb3654b-5c27-4ea3-b8a3-96a48df1c02c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:12.590336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb3654b-5c27-4ea3-b8a3-96a48df1c02c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:12.591105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb3654b-5c27-4ea3-b8a3-96a48df1c02c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:12.591628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb3654b-5c27-4ea3-b8a3-96a48df1c02c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:12.592170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb3654b-5c27-4ea3-b8a3-96a48df1c02c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:12.625689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-603a9f1f-4700-4731-a412-a1733a43be6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:12.635635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-603a9f1f-4700-4731-a412-a1733a43be6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.166328 Aug 31 00:47:12.636421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 997/1922] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:12 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:12.662031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3eb3654b-5c27-4ea3-b8a3-96a48df1c02c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:12.670378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3eb3654b-5c27-4ea3-b8a3-96a48df1c02c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.093306 Aug 31 00:47:12.670952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 926/1923] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:12 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:13.657832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e03af0a1-214b-4c78-873e-f1ed900a69a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:13.658414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e03af0a1-214b-4c78-873e-f1ed900a69a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:13.665604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e03af0a1-214b-4c78-873e-f1ed900a69a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:13.666081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e03af0a1-214b-4c78-873e-f1ed900a69a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:13.666513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e03af0a1-214b-4c78-873e-f1ed900a69a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:13.667228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e03af0a1-214b-4c78-873e-f1ed900a69a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:13.667679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e03af0a1-214b-4c78-873e-f1ed900a69a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:13.668095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e03af0a1-214b-4c78-873e-f1ed900a69a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:13.691661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8a232722-e42b-4280-8ce6-79f8045a4797 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:13.692257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8a232722-e42b-4280-8ce6-79f8045a4797 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:13.698876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a232722-e42b-4280-8ce6-79f8045a4797 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:13.699380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a232722-e42b-4280-8ce6-79f8045a4797 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:13.699810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a232722-e42b-4280-8ce6-79f8045a4797 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:13.700488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a232722-e42b-4280-8ce6-79f8045a4797 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:13.700929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a232722-e42b-4280-8ce6-79f8045a4797 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:13.701340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a232722-e42b-4280-8ce6-79f8045a4797 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:13.776707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8a232722-e42b-4280-8ce6-79f8045a4797 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:13.785917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8a232722-e42b-4280-8ce6-79f8045a4797 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.098191 Aug 31 00:47:13.786727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 927/1924] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:13 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:13.819425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e03af0a1-214b-4c78-873e-f1ed900a69a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:13.827665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e03af0a1-214b-4c78-873e-f1ed900a69a2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.173765 Aug 31 00:47:13.828224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 998/1925] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:13 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:14.807544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-13293160-620d-4418-a94d-9f560d7dd9a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:14.808172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-13293160-620d-4418-a94d-9f560d7dd9a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:14.814561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13293160-620d-4418-a94d-9f560d7dd9a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:14.815057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13293160-620d-4418-a94d-9f560d7dd9a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:14.815504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13293160-620d-4418-a94d-9f560d7dd9a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:14.816507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13293160-620d-4418-a94d-9f560d7dd9a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:14.817031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13293160-620d-4418-a94d-9f560d7dd9a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:14.817456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13293160-620d-4418-a94d-9f560d7dd9a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:14.849697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-45d52b3e-381f-418b-8069-a4ab1d2a9aff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:14.850302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-45d52b3e-381f-418b-8069-a4ab1d2a9aff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:14.856770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45d52b3e-381f-418b-8069-a4ab1d2a9aff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:14.857252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45d52b3e-381f-418b-8069-a4ab1d2a9aff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:14.857691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45d52b3e-381f-418b-8069-a4ab1d2a9aff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:14.858394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45d52b3e-381f-418b-8069-a4ab1d2a9aff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:14.858848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45d52b3e-381f-418b-8069-a4ab1d2a9aff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:14.859293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45d52b3e-381f-418b-8069-a4ab1d2a9aff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:14.884279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-13293160-620d-4418-a94d-9f560d7dd9a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:14.893679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-13293160-620d-4418-a94d-9f560d7dd9a4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089962 Aug 31 00:47:14.895585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 928/1926] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:14 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:14.997999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-45d52b3e-381f-418b-8069-a4ab1d2a9aff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:15.007169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-45d52b3e-381f-418b-8069-a4ab1d2a9aff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.162060 Aug 31 00:47:15.007741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 999/1927] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:14 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:15.916572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5903e420-6e7c-48db-ab2f-f6b2f34ee1ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:15.917180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5903e420-6e7c-48db-ab2f-f6b2f34ee1ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:15.923608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5903e420-6e7c-48db-ab2f-f6b2f34ee1ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:15.924089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5903e420-6e7c-48db-ab2f-f6b2f34ee1ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:15.924524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5903e420-6e7c-48db-ab2f-f6b2f34ee1ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:15.925275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5903e420-6e7c-48db-ab2f-f6b2f34ee1ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:15.926619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5903e420-6e7c-48db-ab2f-f6b2f34ee1ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:15.927084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5903e420-6e7c-48db-ab2f-f6b2f34ee1ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:15.990527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5903e420-6e7c-48db-ab2f-f6b2f34ee1ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:15.998852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5903e420-6e7c-48db-ab2f-f6b2f34ee1ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086103 Aug 31 00:47:15.999443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 929/1928] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:15 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:16.028019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f428e87c-1c6e-4e81-a2f8-7701bd41aa4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:16.028616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f428e87c-1c6e-4e81-a2f8-7701bd41aa4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:16.035656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f428e87c-1c6e-4e81-a2f8-7701bd41aa4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:16.036126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f428e87c-1c6e-4e81-a2f8-7701bd41aa4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:16.036549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f428e87c-1c6e-4e81-a2f8-7701bd41aa4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:16.037222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f428e87c-1c6e-4e81-a2f8-7701bd41aa4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:16.037666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f428e87c-1c6e-4e81-a2f8-7701bd41aa4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:16.038079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f428e87c-1c6e-4e81-a2f8-7701bd41aa4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:16.403500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f428e87c-1c6e-4e81-a2f8-7701bd41aa4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:16.413168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f428e87c-1c6e-4e81-a2f8-7701bd41aa4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.389036 Aug 31 00:47:16.413743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1000/1929] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:16 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:17.020067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-04881e7a-e750-453c-af3a-c392b9f4a9c8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:17.020702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-04881e7a-e750-453c-af3a-c392b9f4a9c8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:17.027097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04881e7a-e750-453c-af3a-c392b9f4a9c8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:17.027581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04881e7a-e750-453c-af3a-c392b9f4a9c8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:17.028010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04881e7a-e750-453c-af3a-c392b9f4a9c8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:17.028691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04881e7a-e750-453c-af3a-c392b9f4a9c8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:17.029139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04881e7a-e750-453c-af3a-c392b9f4a9c8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:17.029554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-04881e7a-e750-453c-af3a-c392b9f4a9c8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:17.089145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-04881e7a-e750-453c-af3a-c392b9f4a9c8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:17.097936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-04881e7a-e750-453c-af3a-c392b9f4a9c8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.081647 Aug 31 00:47:17.098506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 930/1930] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:17 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:17.434084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-83e4a69d-1071-4e59-b688-323f9e5a1c37 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:17.434681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-83e4a69d-1071-4e59-b688-323f9e5a1c37 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:17.441058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83e4a69d-1071-4e59-b688-323f9e5a1c37 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:17.441519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83e4a69d-1071-4e59-b688-323f9e5a1c37 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:17.441943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83e4a69d-1071-4e59-b688-323f9e5a1c37 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:17.442618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83e4a69d-1071-4e59-b688-323f9e5a1c37 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:17.443082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83e4a69d-1071-4e59-b688-323f9e5a1c37 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:17.443498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83e4a69d-1071-4e59-b688-323f9e5a1c37 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:17.572448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-83e4a69d-1071-4e59-b688-323f9e5a1c37 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:17.580700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-83e4a69d-1071-4e59-b688-323f9e5a1c37 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150498 Aug 31 00:47:17.581262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1001/1931] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:17 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:18.119693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e0be4fe6-422b-4cfd-b318-43eefdbf73e6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:18.120301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e0be4fe6-422b-4cfd-b318-43eefdbf73e6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:18.126709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0be4fe6-422b-4cfd-b318-43eefdbf73e6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:18.127221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0be4fe6-422b-4cfd-b318-43eefdbf73e6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:18.127648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0be4fe6-422b-4cfd-b318-43eefdbf73e6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:18.128844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0be4fe6-422b-4cfd-b318-43eefdbf73e6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:18.129289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0be4fe6-422b-4cfd-b318-43eefdbf73e6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:18.129706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0be4fe6-422b-4cfd-b318-43eefdbf73e6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:18.192833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e0be4fe6-422b-4cfd-b318-43eefdbf73e6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:18.201011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e0be4fe6-422b-4cfd-b318-43eefdbf73e6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085173 Aug 31 00:47:18.201570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 931/1932] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:18 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:18.603123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dc2f07d9-4fe4-451a-bbd1-9b9e24335686 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:18.603720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dc2f07d9-4fe4-451a-bbd1-9b9e24335686 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:18.610667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc2f07d9-4fe4-451a-bbd1-9b9e24335686 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:18.611209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc2f07d9-4fe4-451a-bbd1-9b9e24335686 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:18.611649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc2f07d9-4fe4-451a-bbd1-9b9e24335686 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:18.612341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc2f07d9-4fe4-451a-bbd1-9b9e24335686 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:18.612797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc2f07d9-4fe4-451a-bbd1-9b9e24335686 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:18.613220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc2f07d9-4fe4-451a-bbd1-9b9e24335686 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:18.751318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dc2f07d9-4fe4-451a-bbd1-9b9e24335686 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:18.760234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dc2f07d9-4fe4-451a-bbd1-9b9e24335686 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.161110 Aug 31 00:47:18.763083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1002/1933] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:18 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:19.222800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-84122cf7-dec5-402f-a6c6-2d71b810c32d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:19.223812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-84122cf7-dec5-402f-a6c6-2d71b810c32d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:19.230718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84122cf7-dec5-402f-a6c6-2d71b810c32d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:19.231230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84122cf7-dec5-402f-a6c6-2d71b810c32d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:19.231668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84122cf7-dec5-402f-a6c6-2d71b810c32d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:19.231668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84122cf7-dec5-402f-a6c6-2d71b810c32d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:19.232807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84122cf7-dec5-402f-a6c6-2d71b810c32d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:19.233226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84122cf7-dec5-402f-a6c6-2d71b810c32d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:19.299882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-84122cf7-dec5-402f-a6c6-2d71b810c32d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:19.308412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-84122cf7-dec5-402f-a6c6-2d71b810c32d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089464 Aug 31 00:47:19.308969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 932/1934] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:19 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:19.781770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8953d2ca-e361-4146-ae78-c55a56531142 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:19.782375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8953d2ca-e361-4146-ae78-c55a56531142 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:19.789485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8953d2ca-e361-4146-ae78-c55a56531142 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:19.789957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8953d2ca-e361-4146-ae78-c55a56531142 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:19.790378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8953d2ca-e361-4146-ae78-c55a56531142 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:19.791069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8953d2ca-e361-4146-ae78-c55a56531142 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:19.791517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8953d2ca-e361-4146-ae78-c55a56531142 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:19.791932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8953d2ca-e361-4146-ae78-c55a56531142 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:19.922412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8953d2ca-e361-4146-ae78-c55a56531142 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:19.931361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8953d2ca-e361-4146-ae78-c55a56531142 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153506 Aug 31 00:47:19.931925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1003/1935] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:19 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:20.329711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4539d65e-4177-4dec-b743-bd5cec5329d8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:20.330376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4539d65e-4177-4dec-b743-bd5cec5329d8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:20.337653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4539d65e-4177-4dec-b743-bd5cec5329d8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:20.338135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4539d65e-4177-4dec-b743-bd5cec5329d8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:20.338568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4539d65e-4177-4dec-b743-bd5cec5329d8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:20.339285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4539d65e-4177-4dec-b743-bd5cec5329d8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:20.339741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4539d65e-4177-4dec-b743-bd5cec5329d8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:20.340165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4539d65e-4177-4dec-b743-bd5cec5329d8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:20.401308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4539d65e-4177-4dec-b743-bd5cec5329d8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:20.409456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4539d65e-4177-4dec-b743-bd5cec5329d8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083606 Aug 31 00:47:20.410221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 933/1936] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:20 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:20.953193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4c0c792e-6fb2-4f86-927e-e258b5974017 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:20.953829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4c0c792e-6fb2-4f86-927e-e258b5974017 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:20.960402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c0c792e-6fb2-4f86-927e-e258b5974017 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:20.960885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c0c792e-6fb2-4f86-927e-e258b5974017 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:20.961315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c0c792e-6fb2-4f86-927e-e258b5974017 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:20.962022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c0c792e-6fb2-4f86-927e-e258b5974017 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:20.962470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c0c792e-6fb2-4f86-927e-e258b5974017 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:20.964744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c0c792e-6fb2-4f86-927e-e258b5974017 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:21.095895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4c0c792e-6fb2-4f86-927e-e258b5974017 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:21.104808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4c0c792e-6fb2-4f86-927e-e258b5974017 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155758 Aug 31 00:47:21.105374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1004/1937] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:20 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:21.431359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c28b08f2-cf67-4ce3-bb6d-b78be981d520 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:21.432070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c28b08f2-cf67-4ce3-bb6d-b78be981d520 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:21.438816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c28b08f2-cf67-4ce3-bb6d-b78be981d520 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:21.439317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c28b08f2-cf67-4ce3-bb6d-b78be981d520 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:21.439753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c28b08f2-cf67-4ce3-bb6d-b78be981d520 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:21.440434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c28b08f2-cf67-4ce3-bb6d-b78be981d520 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:21.440882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c28b08f2-cf67-4ce3-bb6d-b78be981d520 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:21.441300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c28b08f2-cf67-4ce3-bb6d-b78be981d520 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:21.509036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c28b08f2-cf67-4ce3-bb6d-b78be981d520 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:21.517202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c28b08f2-cf67-4ce3-bb6d-b78be981d520 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090167 Aug 31 00:47:21.517768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 934/1938] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:21 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:22.126581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-36f48a9e-826e-4e5c-8d16-d452df64de9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:22.127199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-36f48a9e-826e-4e5c-8d16-d452df64de9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:22.134198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36f48a9e-826e-4e5c-8d16-d452df64de9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:22.134671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36f48a9e-826e-4e5c-8d16-d452df64de9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:22.135135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36f48a9e-826e-4e5c-8d16-d452df64de9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:22.135816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36f48a9e-826e-4e5c-8d16-d452df64de9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:22.136264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36f48a9e-826e-4e5c-8d16-d452df64de9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:22.136681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36f48a9e-826e-4e5c-8d16-d452df64de9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:22.264122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-36f48a9e-826e-4e5c-8d16-d452df64de9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:22.272815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-36f48a9e-826e-4e5c-8d16-d452df64de9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150085 Aug 31 00:47:22.273376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1005/1939] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:22 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:22.538635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f4830b23-c85d-4029-b4c1-ece7fab74b5b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:22.539259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f4830b23-c85d-4029-b4c1-ece7fab74b5b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:22.545558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4830b23-c85d-4029-b4c1-ece7fab74b5b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:22.546035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4830b23-c85d-4029-b4c1-ece7fab74b5b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:22.546466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4830b23-c85d-4029-b4c1-ece7fab74b5b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:22.547189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4830b23-c85d-4029-b4c1-ece7fab74b5b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:22.547638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4830b23-c85d-4029-b4c1-ece7fab74b5b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:22.548057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4830b23-c85d-4029-b4c1-ece7fab74b5b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:22.610571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f4830b23-c85d-4029-b4c1-ece7fab74b5b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:22.619437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f4830b23-c85d-4029-b4c1-ece7fab74b5b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084876 Aug 31 00:47:22.620069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 935/1940] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:22 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:23.293522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-20e40890-9116-4cbb-96d9-3855ceebae1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:23.294069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-20e40890-9116-4cbb-96d9-3855ceebae1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:23.300500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20e40890-9116-4cbb-96d9-3855ceebae1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:23.300976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20e40890-9116-4cbb-96d9-3855ceebae1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:23.301680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20e40890-9116-4cbb-96d9-3855ceebae1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:23.302538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20e40890-9116-4cbb-96d9-3855ceebae1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:23.302981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20e40890-9116-4cbb-96d9-3855ceebae1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:23.303419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20e40890-9116-4cbb-96d9-3855ceebae1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:23.442064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-20e40890-9116-4cbb-96d9-3855ceebae1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:23.444265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:23.451345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-20e40890-9116-4cbb-96d9-3855ceebae1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.161761 Aug 31 00:47:23.451934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1006/1941] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:23 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:23.641418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-de2d83ee-2816-4a04-9e95-473556fac490 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:23.642133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-de2d83ee-2816-4a04-9e95-473556fac490 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:23.649340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de2d83ee-2816-4a04-9e95-473556fac490 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:23.649814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de2d83ee-2816-4a04-9e95-473556fac490 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:23.650245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de2d83ee-2816-4a04-9e95-473556fac490 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:23.650947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de2d83ee-2816-4a04-9e95-473556fac490 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:23.651411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de2d83ee-2816-4a04-9e95-473556fac490 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:23.651829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de2d83ee-2816-4a04-9e95-473556fac490 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:23.715138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-de2d83ee-2816-4a04-9e95-473556fac490 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:23.723657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-de2d83ee-2816-4a04-9e95-473556fac490 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085965 Aug 31 00:47:23.724223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 936/1942] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:23 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:24.475836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-15ab4769-056b-4882-80c7-02732bda2a2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:24.476634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-15ab4769-056b-4882-80c7-02732bda2a2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:24.485751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15ab4769-056b-4882-80c7-02732bda2a2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:24.486230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15ab4769-056b-4882-80c7-02732bda2a2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:24.486653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15ab4769-056b-4882-80c7-02732bda2a2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:24.487362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15ab4769-056b-4882-80c7-02732bda2a2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:24.487807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15ab4769-056b-4882-80c7-02732bda2a2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:24.488227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15ab4769-056b-4882-80c7-02732bda2a2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:24.644746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-15ab4769-056b-4882-80c7-02732bda2a2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:24.654894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-15ab4769-056b-4882-80c7-02732bda2a2c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.183548 Aug 31 00:47:24.655511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1007/1943] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:24 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:24.745219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fce31557-bc29-4e7c-9c56-b5951a544e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:24.745783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fce31557-bc29-4e7c-9c56-b5951a544e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:24.752523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fce31557-bc29-4e7c-9c56-b5951a544e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:24.753005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fce31557-bc29-4e7c-9c56-b5951a544e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:24.753433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fce31557-bc29-4e7c-9c56-b5951a544e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:24.754122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fce31557-bc29-4e7c-9c56-b5951a544e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:24.754650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fce31557-bc29-4e7c-9c56-b5951a544e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:24.755183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fce31557-bc29-4e7c-9c56-b5951a544e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:24.826459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fce31557-bc29-4e7c-9c56-b5951a544e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:24.837908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fce31557-bc29-4e7c-9c56-b5951a544e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.096549 Aug 31 00:47:24.838470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 937/1944] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:24 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:25.682335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0095579b-6114-49e8-b705-77ee5ce12904 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:25.682935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0095579b-6114-49e8-b705-77ee5ce12904 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:25.689319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0095579b-6114-49e8-b705-77ee5ce12904 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:25.689791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0095579b-6114-49e8-b705-77ee5ce12904 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:25.690221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0095579b-6114-49e8-b705-77ee5ce12904 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:25.690894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0095579b-6114-49e8-b705-77ee5ce12904 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:25.691363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0095579b-6114-49e8-b705-77ee5ce12904 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:25.691776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0095579b-6114-49e8-b705-77ee5ce12904 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:25.822485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0095579b-6114-49e8-b705-77ee5ce12904 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:25.830574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0095579b-6114-49e8-b705-77ee5ce12904 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152175 Aug 31 00:47:25.831160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1008/1945] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:25 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:25.858982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-24314c0c-5c79-4971-81c7-5cb35b0c769d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:25.859605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-24314c0c-5c79-4971-81c7-5cb35b0c769d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:25.866701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24314c0c-5c79-4971-81c7-5cb35b0c769d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:25.867197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24314c0c-5c79-4971-81c7-5cb35b0c769d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:25.867629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24314c0c-5c79-4971-81c7-5cb35b0c769d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:25.868305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24314c0c-5c79-4971-81c7-5cb35b0c769d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:25.868746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24314c0c-5c79-4971-81c7-5cb35b0c769d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:25.869159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24314c0c-5c79-4971-81c7-5cb35b0c769d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:25.871703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:25.930975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-24314c0c-5c79-4971-81c7-5cb35b0c769d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:25.939863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-24314c0c-5c79-4971-81c7-5cb35b0c769d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084610 Aug 31 00:47:25.940421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 938/1946] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:25 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:26.852290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8842900c-4f27-4c2a-9936-c1eab799146d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:26.852901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8842900c-4f27-4c2a-9936-c1eab799146d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:26.859280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8842900c-4f27-4c2a-9936-c1eab799146d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:26.859749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8842900c-4f27-4c2a-9936-c1eab799146d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:26.860177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8842900c-4f27-4c2a-9936-c1eab799146d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:26.861119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8842900c-4f27-4c2a-9936-c1eab799146d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:26.861556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8842900c-4f27-4c2a-9936-c1eab799146d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:26.861966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8842900c-4f27-4c2a-9936-c1eab799146d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:26.962372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b5bd7426-283e-4b01-ac65-91cdeb7569c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:26.962966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b5bd7426-283e-4b01-ac65-91cdeb7569c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:26.969431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5bd7426-283e-4b01-ac65-91cdeb7569c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:26.969986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5bd7426-283e-4b01-ac65-91cdeb7569c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:26.970419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5bd7426-283e-4b01-ac65-91cdeb7569c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:26.971136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5bd7426-283e-4b01-ac65-91cdeb7569c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:26.971590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5bd7426-283e-4b01-ac65-91cdeb7569c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:26.972005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5bd7426-283e-4b01-ac65-91cdeb7569c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:26.993345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8842900c-4f27-4c2a-9936-c1eab799146d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:27.001958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8842900c-4f27-4c2a-9936-c1eab799146d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154891 Aug 31 00:47:27.002528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1009/1947] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:26 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:27.037352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b5bd7426-283e-4b01-ac65-91cdeb7569c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:27.045633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b5bd7426-283e-4b01-ac65-91cdeb7569c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087837 Aug 31 00:47:27.046197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 939/1948] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:26 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:28.023997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2dd7bc88-5e9a-41ec-a378-abf2c1990456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:28.024636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2dd7bc88-5e9a-41ec-a378-abf2c1990456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:28.031070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dd7bc88-5e9a-41ec-a378-abf2c1990456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:28.031553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dd7bc88-5e9a-41ec-a378-abf2c1990456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:28.031988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dd7bc88-5e9a-41ec-a378-abf2c1990456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:28.034967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dd7bc88-5e9a-41ec-a378-abf2c1990456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:28.034967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dd7bc88-5e9a-41ec-a378-abf2c1990456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:28.034967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dd7bc88-5e9a-41ec-a378-abf2c1990456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:28.065763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-89cbace3-6119-45b2-af39-d995e187bc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:28.066356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-89cbace3-6119-45b2-af39-d995e187bc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:28.073569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89cbace3-6119-45b2-af39-d995e187bc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:28.074054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89cbace3-6119-45b2-af39-d995e187bc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:28.074487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89cbace3-6119-45b2-af39-d995e187bc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:28.075209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89cbace3-6119-45b2-af39-d995e187bc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:28.075658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89cbace3-6119-45b2-af39-d995e187bc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:28.076074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89cbace3-6119-45b2-af39-d995e187bc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:28.155643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-89cbace3-6119-45b2-af39-d995e187bc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:28.164714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-89cbace3-6119-45b2-af39-d995e187bc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.102761 Aug 31 00:47:28.165286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 940/1949] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:28 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:28.194081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2dd7bc88-5e9a-41ec-a378-abf2c1990456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:28.202266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2dd7bc88-5e9a-41ec-a378-abf2c1990456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.182566 Aug 31 00:47:28.202824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1010/1950] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:28 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:29.185824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a7ad5d42-26b6-43de-8d30-60cdde279e00 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:29.186429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a7ad5d42-26b6-43de-8d30-60cdde279e00 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:29.193598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d42-26b6-43de-8d30-60cdde279e00 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:29.194047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d42-26b6-43de-8d30-60cdde279e00 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:29.194478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d42-26b6-43de-8d30-60cdde279e00 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:29.195194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d42-26b6-43de-8d30-60cdde279e00 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:29.195644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d42-26b6-43de-8d30-60cdde279e00 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:29.196062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d42-26b6-43de-8d30-60cdde279e00 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:29.224117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-36023d3a-6eb7-4de5-b2d7-328a05db0e6a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:29.224724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-36023d3a-6eb7-4de5-b2d7-328a05db0e6a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:29.230790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36023d3a-6eb7-4de5-b2d7-328a05db0e6a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:29.231299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36023d3a-6eb7-4de5-b2d7-328a05db0e6a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:29.231733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36023d3a-6eb7-4de5-b2d7-328a05db0e6a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:29.232424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36023d3a-6eb7-4de5-b2d7-328a05db0e6a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:29.232878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36023d3a-6eb7-4de5-b2d7-328a05db0e6a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:29.233300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36023d3a-6eb7-4de5-b2d7-328a05db0e6a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:29.259977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a7ad5d42-26b6-43de-8d30-60cdde279e00 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:29.268281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a7ad5d42-26b6-43de-8d30-60cdde279e00 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086389 Aug 31 00:47:29.268851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 941/1951] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:29 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:29.366394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-36023d3a-6eb7-4de5-b2d7-328a05db0e6a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:29.374557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-36023d3a-6eb7-4de5-b2d7-328a05db0e6a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154303 Aug 31 00:47:29.375127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1011/1952] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:29 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:30.290574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2bad98fe-a0d3-4291-ab1c-d8db47af7983 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:30.291154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2bad98fe-a0d3-4291-ab1c-d8db47af7983 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:30.297466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bad98fe-a0d3-4291-ab1c-d8db47af7983 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:30.297935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bad98fe-a0d3-4291-ab1c-d8db47af7983 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:30.298366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bad98fe-a0d3-4291-ab1c-d8db47af7983 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:30.299055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bad98fe-a0d3-4291-ab1c-d8db47af7983 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:30.299499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bad98fe-a0d3-4291-ab1c-d8db47af7983 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:30.299913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bad98fe-a0d3-4291-ab1c-d8db47af7983 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:30.360671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2bad98fe-a0d3-4291-ab1c-d8db47af7983 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:30.370269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2bad98fe-a0d3-4291-ab1c-d8db47af7983 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083711 Aug 31 00:47:30.370838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 942/1953] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:30 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:30.397126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eb5fa53a-7b89-449c-ad92-7640e31a82be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:30.397736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eb5fa53a-7b89-449c-ad92-7640e31a82be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:30.404394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5fa53a-7b89-449c-ad92-7640e31a82be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:30.404871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5fa53a-7b89-449c-ad92-7640e31a82be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:30.405302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5fa53a-7b89-449c-ad92-7640e31a82be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:30.405984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5fa53a-7b89-449c-ad92-7640e31a82be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:30.406544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5fa53a-7b89-449c-ad92-7640e31a82be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:30.406962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5fa53a-7b89-449c-ad92-7640e31a82be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:30.536752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eb5fa53a-7b89-449c-ad92-7640e31a82be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:30.546479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eb5fa53a-7b89-449c-ad92-7640e31a82be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154097 Aug 31 00:47:30.546986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1012/1954] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:30 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:31.391206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-505a42ca-03b6-4cb4-8730-342990562a13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:31.391817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-505a42ca-03b6-4cb4-8730-342990562a13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:31.399148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505a42ca-03b6-4cb4-8730-342990562a13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:31.399630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505a42ca-03b6-4cb4-8730-342990562a13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:31.400063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505a42ca-03b6-4cb4-8730-342990562a13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:31.400780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505a42ca-03b6-4cb4-8730-342990562a13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:31.401227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505a42ca-03b6-4cb4-8730-342990562a13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:31.401644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-505a42ca-03b6-4cb4-8730-342990562a13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:31.463900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-505a42ca-03b6-4cb4-8730-342990562a13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:31.472074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-505a42ca-03b6-4cb4-8730-342990562a13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084730 Aug 31 00:47:31.472629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 943/1955] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:31 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:31.568437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-50706b16-e1c9-43b4-bc11-110fe12323b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:31.569032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-50706b16-e1c9-43b4-bc11-110fe12323b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:31.575443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50706b16-e1c9-43b4-bc11-110fe12323b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:31.575923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50706b16-e1c9-43b4-bc11-110fe12323b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:31.576349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50706b16-e1c9-43b4-bc11-110fe12323b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:31.577022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50706b16-e1c9-43b4-bc11-110fe12323b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:31.577467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50706b16-e1c9-43b4-bc11-110fe12323b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:31.577878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50706b16-e1c9-43b4-bc11-110fe12323b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:31.707350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-50706b16-e1c9-43b4-bc11-110fe12323b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:31.715959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-50706b16-e1c9-43b4-bc11-110fe12323b1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152001 Aug 31 00:47:31.716516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1013/1956] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:31 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:32.492592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bcbd53de-a81e-41fb-a2f3-81bb208ea2d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:32.493181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bcbd53de-a81e-41fb-a2f3-81bb208ea2d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:32.499499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcbd53de-a81e-41fb-a2f3-81bb208ea2d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:32.499970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcbd53de-a81e-41fb-a2f3-81bb208ea2d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:32.500394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcbd53de-a81e-41fb-a2f3-81bb208ea2d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:32.501070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcbd53de-a81e-41fb-a2f3-81bb208ea2d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:32.501510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcbd53de-a81e-41fb-a2f3-81bb208ea2d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:32.501924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcbd53de-a81e-41fb-a2f3-81bb208ea2d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:32.566084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bcbd53de-a81e-41fb-a2f3-81bb208ea2d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:32.575735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bcbd53de-a81e-41fb-a2f3-81bb208ea2d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087068 Aug 31 00:47:32.576308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 944/1957] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:32 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:32.737362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b9042f5a-0540-487a-8c1e-e8fe5c61fd44 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:32.737975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b9042f5a-0540-487a-8c1e-e8fe5c61fd44 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:32.744776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9042f5a-0540-487a-8c1e-e8fe5c61fd44 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:32.745195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9042f5a-0540-487a-8c1e-e8fe5c61fd44 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:32.745631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9042f5a-0540-487a-8c1e-e8fe5c61fd44 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:32.746319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9042f5a-0540-487a-8c1e-e8fe5c61fd44 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:32.746769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9042f5a-0540-487a-8c1e-e8fe5c61fd44 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:32.747229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9042f5a-0540-487a-8c1e-e8fe5c61fd44 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:32.878925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b9042f5a-0540-487a-8c1e-e8fe5c61fd44 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:32.887197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b9042f5a-0540-487a-8c1e-e8fe5c61fd44 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154054 Aug 31 00:47:32.887764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1014/1958] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:32 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:33.597530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-242b9aae-e28d-48c2-8e55-2901eb035c21 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:33.598134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-242b9aae-e28d-48c2-8e55-2901eb035c21 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:33.605425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-242b9aae-e28d-48c2-8e55-2901eb035c21 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:33.605904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-242b9aae-e28d-48c2-8e55-2901eb035c21 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:33.606337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-242b9aae-e28d-48c2-8e55-2901eb035c21 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:33.607018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-242b9aae-e28d-48c2-8e55-2901eb035c21 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:33.607491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-242b9aae-e28d-48c2-8e55-2901eb035c21 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:33.607905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-242b9aae-e28d-48c2-8e55-2901eb035c21 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:33.668905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-242b9aae-e28d-48c2-8e55-2901eb035c21 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:33.676949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-242b9aae-e28d-48c2-8e55-2901eb035c21 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083265 Aug 31 00:47:33.677536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 945/1959] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:33 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:33.908908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4d9e5812-8d11-4619-88e7-62d600c398e2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:33.909520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4d9e5812-8d11-4619-88e7-62d600c398e2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:33.916501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d9e5812-8d11-4619-88e7-62d600c398e2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:33.917064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d9e5812-8d11-4619-88e7-62d600c398e2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:33.917500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d9e5812-8d11-4619-88e7-62d600c398e2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:33.918191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d9e5812-8d11-4619-88e7-62d600c398e2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:33.918652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d9e5812-8d11-4619-88e7-62d600c398e2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:33.919096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d9e5812-8d11-4619-88e7-62d600c398e2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:34.050063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4d9e5812-8d11-4619-88e7-62d600c398e2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:34.059202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4d9e5812-8d11-4619-88e7-62d600c398e2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154166 Aug 31 00:47:34.059787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1015/1960] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:33 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:34.698860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9c3dc07a-1eb3-4c8e-9266-77d4408067a1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:34.699493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9c3dc07a-1eb3-4c8e-9266-77d4408067a1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:34.701801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=56 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:34.707369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3dc07a-1eb3-4c8e-9266-77d4408067a1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:34.707857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3dc07a-1eb3-4c8e-9266-77d4408067a1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:34.708294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3dc07a-1eb3-4c8e-9266-77d4408067a1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:34.709020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3dc07a-1eb3-4c8e-9266-77d4408067a1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:34.710241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3dc07a-1eb3-4c8e-9266-77d4408067a1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:34.710771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c3dc07a-1eb3-4c8e-9266-77d4408067a1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:34.772793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9c3dc07a-1eb3-4c8e-9266-77d4408067a1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:34.780980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9c3dc07a-1eb3-4c8e-9266-77d4408067a1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086257 Aug 31 00:47:34.781548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 946/1961] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:35.080970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b74b0d16-2461-4958-a859-46f8c1c745c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:35.081592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b74b0d16-2461-4958-a859-46f8c1c745c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:35.088278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b74b0d16-2461-4958-a859-46f8c1c745c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:35.088783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b74b0d16-2461-4958-a859-46f8c1c745c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:35.089211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b74b0d16-2461-4958-a859-46f8c1c745c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:35.089886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b74b0d16-2461-4958-a859-46f8c1c745c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:35.090330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b74b0d16-2461-4958-a859-46f8c1c745c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:35.090775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b74b0d16-2461-4958-a859-46f8c1c745c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:35.225630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b74b0d16-2461-4958-a859-46f8c1c745c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:35.233974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b74b0d16-2461-4958-a859-46f8c1c745c7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156854 Aug 31 00:47:35.234559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1016/1962] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:35 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:35.801961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-01a7020a-95a3-49ca-9731-fbf6339846c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:35.802531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-01a7020a-95a3-49ca-9731-fbf6339846c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:35.809393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01a7020a-95a3-49ca-9731-fbf6339846c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:35.809864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01a7020a-95a3-49ca-9731-fbf6339846c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:35.810291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01a7020a-95a3-49ca-9731-fbf6339846c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:35.810967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01a7020a-95a3-49ca-9731-fbf6339846c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:35.811435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01a7020a-95a3-49ca-9731-fbf6339846c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:35.811849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01a7020a-95a3-49ca-9731-fbf6339846c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:35.875457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01a7020a-95a3-49ca-9731-fbf6339846c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:35.883761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-01a7020a-95a3-49ca-9731-fbf6339846c7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085731 Aug 31 00:47:35.884323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 947/1963] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:35 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:36.254933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c02a6112-7395-4d4e-b4c1-acd23e84824e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:36.255552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c02a6112-7395-4d4e-b4c1-acd23e84824e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:36.262684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c02a6112-7395-4d4e-b4c1-acd23e84824e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:36.263197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c02a6112-7395-4d4e-b4c1-acd23e84824e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:36.263623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c02a6112-7395-4d4e-b4c1-acd23e84824e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:36.264299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c02a6112-7395-4d4e-b4c1-acd23e84824e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:36.264741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c02a6112-7395-4d4e-b4c1-acd23e84824e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:36.265152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c02a6112-7395-4d4e-b4c1-acd23e84824e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:36.394409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c02a6112-7395-4d4e-b4c1-acd23e84824e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:36.402868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c02a6112-7395-4d4e-b4c1-acd23e84824e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151799 Aug 31 00:47:36.403464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1017/1964] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:36 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:36.905170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-12c868ec-1003-457a-862b-6902a3bf4de6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:36.905835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-12c868ec-1003-457a-862b-6902a3bf4de6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:36.912709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12c868ec-1003-457a-862b-6902a3bf4de6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:36.913188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12c868ec-1003-457a-862b-6902a3bf4de6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:36.913616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12c868ec-1003-457a-862b-6902a3bf4de6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:36.914296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12c868ec-1003-457a-862b-6902a3bf4de6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:36.914742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12c868ec-1003-457a-862b-6902a3bf4de6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:36.915222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12c868ec-1003-457a-862b-6902a3bf4de6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:36.976289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-12c868ec-1003-457a-862b-6902a3bf4de6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:36.984583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-12c868ec-1003-457a-862b-6902a3bf4de6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083248 Aug 31 00:47:36.985168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 948/1965] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:36 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:37.424516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cf311f20-aae9-4a13-8fef-0ec70b45001a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:37.425120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cf311f20-aae9-4a13-8fef-0ec70b45001a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:37.431993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf311f20-aae9-4a13-8fef-0ec70b45001a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:37.432480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf311f20-aae9-4a13-8fef-0ec70b45001a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:37.432911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf311f20-aae9-4a13-8fef-0ec70b45001a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:37.433609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf311f20-aae9-4a13-8fef-0ec70b45001a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:37.434060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf311f20-aae9-4a13-8fef-0ec70b45001a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:37.434478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf311f20-aae9-4a13-8fef-0ec70b45001a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:37.566228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cf311f20-aae9-4a13-8fef-0ec70b45001a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:37.574890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cf311f20-aae9-4a13-8fef-0ec70b45001a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154254 Aug 31 00:47:37.575523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1018/1966] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:37 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:38.005802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0f45aa5e-54bf-4c70-8578-da7bae010eac tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:38.007298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0f45aa5e-54bf-4c70-8578-da7bae010eac tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:38.014031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f45aa5e-54bf-4c70-8578-da7bae010eac tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:38.014503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f45aa5e-54bf-4c70-8578-da7bae010eac tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:38.014928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f45aa5e-54bf-4c70-8578-da7bae010eac tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:38.015629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f45aa5e-54bf-4c70-8578-da7bae010eac tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:38.016068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f45aa5e-54bf-4c70-8578-da7bae010eac tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:38.016479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f45aa5e-54bf-4c70-8578-da7bae010eac tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:38.077276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0f45aa5e-54bf-4c70-8578-da7bae010eac tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:38.085556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0f45aa5e-54bf-4c70-8578-da7bae010eac tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083665 Aug 31 00:47:38.086293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 949/1967] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:38 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:38.596735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4948a23f-f480-493d-aef9-dc2c11d958bf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:38.597323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4948a23f-f480-493d-aef9-dc2c11d958bf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:38.599601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:38.605304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4948a23f-f480-493d-aef9-dc2c11d958bf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:38.605786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4948a23f-f480-493d-aef9-dc2c11d958bf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:38.606225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4948a23f-f480-493d-aef9-dc2c11d958bf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:38.606910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4948a23f-f480-493d-aef9-dc2c11d958bf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:38.607421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4948a23f-f480-493d-aef9-dc2c11d958bf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:38.607846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4948a23f-f480-493d-aef9-dc2c11d958bf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:38.740179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4948a23f-f480-493d-aef9-dc2c11d958bf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:38.748583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4948a23f-f480-493d-aef9-dc2c11d958bf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155785 Aug 31 00:47:38.749154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1019/1968] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:38 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:39.106931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3f68336f-0cbe-4a90-8f34-3a50f6494ab2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:39.107559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3f68336f-0cbe-4a90-8f34-3a50f6494ab2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:39.113845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f68336f-0cbe-4a90-8f34-3a50f6494ab2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:39.114326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f68336f-0cbe-4a90-8f34-3a50f6494ab2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:39.114754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f68336f-0cbe-4a90-8f34-3a50f6494ab2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:39.115720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f68336f-0cbe-4a90-8f34-3a50f6494ab2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:39.116272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f68336f-0cbe-4a90-8f34-3a50f6494ab2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:39.116695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f68336f-0cbe-4a90-8f34-3a50f6494ab2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:39.182558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3f68336f-0cbe-4a90-8f34-3a50f6494ab2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:39.190747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3f68336f-0cbe-4a90-8f34-3a50f6494ab2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087839 Aug 31 00:47:39.191331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 950/1969] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:39 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:39.769742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c710311c-dc30-475f-b8f2-e7b59da55725 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:39.770287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c710311c-dc30-475f-b8f2-e7b59da55725 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:39.777166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c710311c-dc30-475f-b8f2-e7b59da55725 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:39.777650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c710311c-dc30-475f-b8f2-e7b59da55725 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:39.778082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c710311c-dc30-475f-b8f2-e7b59da55725 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:39.778771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c710311c-dc30-475f-b8f2-e7b59da55725 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:39.779259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c710311c-dc30-475f-b8f2-e7b59da55725 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:39.779685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c710311c-dc30-475f-b8f2-e7b59da55725 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:39.910702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c710311c-dc30-475f-b8f2-e7b59da55725 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:39.920189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c710311c-dc30-475f-b8f2-e7b59da55725 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154351 Aug 31 00:47:39.920758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1020/1970] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:39 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:40.211805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0120951f-8b58-4597-8f0f-9edd890ed71a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:40.212447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0120951f-8b58-4597-8f0f-9edd890ed71a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:40.219063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0120951f-8b58-4597-8f0f-9edd890ed71a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:40.219556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0120951f-8b58-4597-8f0f-9edd890ed71a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:40.219985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0120951f-8b58-4597-8f0f-9edd890ed71a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:40.220690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0120951f-8b58-4597-8f0f-9edd890ed71a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:40.221131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0120951f-8b58-4597-8f0f-9edd890ed71a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:40.221575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0120951f-8b58-4597-8f0f-9edd890ed71a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:40.282915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0120951f-8b58-4597-8f0f-9edd890ed71a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:40.291216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0120951f-8b58-4597-8f0f-9edd890ed71a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083409 Aug 31 00:47:40.291769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 951/1971] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:40 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:40.944333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-da0a7a98-7038-4395-9294-fb9e42abacd8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:40.944921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-da0a7a98-7038-4395-9294-fb9e42abacd8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:40.947069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:47:40.947212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:47:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 (ip 10.222.0.67) !!! Aug 31 00:47:40.956430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da0a7a98-7038-4395-9294-fb9e42abacd8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:40.956907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da0a7a98-7038-4395-9294-fb9e42abacd8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:40.957332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da0a7a98-7038-4395-9294-fb9e42abacd8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:40.958016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da0a7a98-7038-4395-9294-fb9e42abacd8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:40.958459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da0a7a98-7038-4395-9294-fb9e42abacd8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:40.958872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da0a7a98-7038-4395-9294-fb9e42abacd8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:41.093156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-da0a7a98-7038-4395-9294-fb9e42abacd8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:41.101939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-da0a7a98-7038-4395-9294-fb9e42abacd8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.161580 Aug 31 00:47:41.102499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1021/1972] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:40 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:41.312544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a64dc87a-9df9-4ffd-b8d8-6d0a03026f08 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:41.313087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a64dc87a-9df9-4ffd-b8d8-6d0a03026f08 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:41.320228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64dc87a-9df9-4ffd-b8d8-6d0a03026f08 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:41.320699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64dc87a-9df9-4ffd-b8d8-6d0a03026f08 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:41.321149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64dc87a-9df9-4ffd-b8d8-6d0a03026f08 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:41.321823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64dc87a-9df9-4ffd-b8d8-6d0a03026f08 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:41.322262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64dc87a-9df9-4ffd-b8d8-6d0a03026f08 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:41.322675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64dc87a-9df9-4ffd-b8d8-6d0a03026f08 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:41.385050 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a64dc87a-9df9-4ffd-b8d8-6d0a03026f08 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:41.393114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a64dc87a-9df9-4ffd-b8d8-6d0a03026f08 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084490 Aug 31 00:47:41.393671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 952/1973] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:41 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:42.123336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-637bdc15-fafd-4f82-8051-af1ea1fc83f9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:42.123927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-637bdc15-fafd-4f82-8051-af1ea1fc83f9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:42.130488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-637bdc15-fafd-4f82-8051-af1ea1fc83f9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:42.131109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-637bdc15-fafd-4f82-8051-af1ea1fc83f9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:42.131584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-637bdc15-fafd-4f82-8051-af1ea1fc83f9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:42.132269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-637bdc15-fafd-4f82-8051-af1ea1fc83f9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:42.132726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-637bdc15-fafd-4f82-8051-af1ea1fc83f9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:42.133148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-637bdc15-fafd-4f82-8051-af1ea1fc83f9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:42.262520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-637bdc15-fafd-4f82-8051-af1ea1fc83f9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:42.270840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-637bdc15-fafd-4f82-8051-af1ea1fc83f9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151512 Aug 31 00:47:42.271985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1022/1974] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:42 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:42.415613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-249f5e39-81f2-44f4-b807-cf44e6a6f2f2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:42.416222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-249f5e39-81f2-44f4-b807-cf44e6a6f2f2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:42.422782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-249f5e39-81f2-44f4-b807-cf44e6a6f2f2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:42.423372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-249f5e39-81f2-44f4-b807-cf44e6a6f2f2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:42.423812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-249f5e39-81f2-44f4-b807-cf44e6a6f2f2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:42.424497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-249f5e39-81f2-44f4-b807-cf44e6a6f2f2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:42.424956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-249f5e39-81f2-44f4-b807-cf44e6a6f2f2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:42.425372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-249f5e39-81f2-44f4-b807-cf44e6a6f2f2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:42.486673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-249f5e39-81f2-44f4-b807-cf44e6a6f2f2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:42.494918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-249f5e39-81f2-44f4-b807-cf44e6a6f2f2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083818 Aug 31 00:47:42.495526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 953/1975] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:42 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:43.292885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e51ff684-2779-4a65-b0db-aec7088fbf3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:43.293437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e51ff684-2779-4a65-b0db-aec7088fbf3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:43.299903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51ff684-2779-4a65-b0db-aec7088fbf3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:43.300387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51ff684-2779-4a65-b0db-aec7088fbf3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:43.300817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51ff684-2779-4a65-b0db-aec7088fbf3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:43.301498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51ff684-2779-4a65-b0db-aec7088fbf3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:43.301946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51ff684-2779-4a65-b0db-aec7088fbf3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:43.302366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51ff684-2779-4a65-b0db-aec7088fbf3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:43.317918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:43.433502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e51ff684-2779-4a65-b0db-aec7088fbf3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:43.441669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e51ff684-2779-4a65-b0db-aec7088fbf3b tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152781 Aug 31 00:47:43.442229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1023/1976] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:43 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:43.516106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6bbe7c55-e027-4c05-b440-ba646047eb52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:43.516722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6bbe7c55-e027-4c05-b440-ba646047eb52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:43.523116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bbe7c55-e027-4c05-b440-ba646047eb52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:43.523598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bbe7c55-e027-4c05-b440-ba646047eb52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:43.524028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bbe7c55-e027-4c05-b440-ba646047eb52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:43.524697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bbe7c55-e027-4c05-b440-ba646047eb52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:43.525135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bbe7c55-e027-4c05-b440-ba646047eb52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:43.525547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6bbe7c55-e027-4c05-b440-ba646047eb52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:43.589066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6bbe7c55-e027-4c05-b440-ba646047eb52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:43.591258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:43.598654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6bbe7c55-e027-4c05-b440-ba646047eb52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086346 Aug 31 00:47:43.599275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 954/1977] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:43 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:44.462821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2b573c84-61a9-4239-a29f-6a17441342e5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:44.463443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2b573c84-61a9-4239-a29f-6a17441342e5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:44.470644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b573c84-61a9-4239-a29f-6a17441342e5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:44.471155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b573c84-61a9-4239-a29f-6a17441342e5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:44.471590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b573c84-61a9-4239-a29f-6a17441342e5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:44.472273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b573c84-61a9-4239-a29f-6a17441342e5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:44.472721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b573c84-61a9-4239-a29f-6a17441342e5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:44.473137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b573c84-61a9-4239-a29f-6a17441342e5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:44.607737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2b573c84-61a9-4239-a29f-6a17441342e5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:44.616854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2b573c84-61a9-4239-a29f-6a17441342e5 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157961 Aug 31 00:47:44.617425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1024/1978] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:44 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:44.621171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2c762367-22c8-44a0-b8cf-a2ba0a2e25c0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:44.621781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2c762367-22c8-44a0-b8cf-a2ba0a2e25c0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:44.628251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c762367-22c8-44a0-b8cf-a2ba0a2e25c0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:44.628733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c762367-22c8-44a0-b8cf-a2ba0a2e25c0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:44.629166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c762367-22c8-44a0-b8cf-a2ba0a2e25c0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:44.629852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c762367-22c8-44a0-b8cf-a2ba0a2e25c0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:44.630302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c762367-22c8-44a0-b8cf-a2ba0a2e25c0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:44.630719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c762367-22c8-44a0-b8cf-a2ba0a2e25c0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:44.691413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c762367-22c8-44a0-b8cf-a2ba0a2e25c0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:44.700321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2c762367-22c8-44a0-b8cf-a2ba0a2e25c0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082957 Aug 31 00:47:44.700881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 955/1979] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:44 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:45.638293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6156031b-35ef-4774-9a89-5311c164e341 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:45.638899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6156031b-35ef-4774-9a89-5311c164e341 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:45.645478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6156031b-35ef-4774-9a89-5311c164e341 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:45.645956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6156031b-35ef-4774-9a89-5311c164e341 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:45.646393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6156031b-35ef-4774-9a89-5311c164e341 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:45.647318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6156031b-35ef-4774-9a89-5311c164e341 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:45.647780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6156031b-35ef-4774-9a89-5311c164e341 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:45.648204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6156031b-35ef-4774-9a89-5311c164e341 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:45.722020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-37f15ee2-2655-4d55-8603-e55976945669 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:45.722642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-37f15ee2-2655-4d55-8603-e55976945669 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:45.729924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f15ee2-2655-4d55-8603-e55976945669 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:45.730405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f15ee2-2655-4d55-8603-e55976945669 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:45.730838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f15ee2-2655-4d55-8603-e55976945669 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:45.731549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f15ee2-2655-4d55-8603-e55976945669 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:45.732002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f15ee2-2655-4d55-8603-e55976945669 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:45.732420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f15ee2-2655-4d55-8603-e55976945669 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:45.791246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6156031b-35ef-4774-9a89-5311c164e341 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:45.800853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6156031b-35ef-4774-9a89-5311c164e341 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.166497 Aug 31 00:47:45.801645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1025/1980] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:45 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:45.806731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-37f15ee2-2655-4d55-8603-e55976945669 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:45.814994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-37f15ee2-2655-4d55-8603-e55976945669 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.097083 Aug 31 00:47:45.815567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 956/1981] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:45 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:46.823003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4c94be42-baa7-49c3-bad0-a20408fac747 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:46.823639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4c94be42-baa7-49c3-bad0-a20408fac747 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:46.830243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c94be42-baa7-49c3-bad0-a20408fac747 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:46.830726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c94be42-baa7-49c3-bad0-a20408fac747 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:46.831201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c94be42-baa7-49c3-bad0-a20408fac747 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:46.831890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c94be42-baa7-49c3-bad0-a20408fac747 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:46.832339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c94be42-baa7-49c3-bad0-a20408fac747 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:46.832761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c94be42-baa7-49c3-bad0-a20408fac747 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:46.836665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7f993a1a-a9ea-4c20-8acd-07b0718652f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:46.837272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7f993a1a-a9ea-4c20-8acd-07b0718652f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:46.843793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f993a1a-a9ea-4c20-8acd-07b0718652f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:46.844267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f993a1a-a9ea-4c20-8acd-07b0718652f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:46.844692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f993a1a-a9ea-4c20-8acd-07b0718652f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:46.845370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f993a1a-a9ea-4c20-8acd-07b0718652f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:46.845811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f993a1a-a9ea-4c20-8acd-07b0718652f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:46.846225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f993a1a-a9ea-4c20-8acd-07b0718652f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:46.926437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7f993a1a-a9ea-4c20-8acd-07b0718652f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:46.934767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7f993a1a-a9ea-4c20-8acd-07b0718652f3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.102466 Aug 31 00:47:46.948102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 957/1982] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:46 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:46.987694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4c94be42-baa7-49c3-bad0-a20408fac747 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:46.996212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4c94be42-baa7-49c3-bad0-a20408fac747 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.177071 Aug 31 00:47:46.996784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1026/1983] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:46 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:47.956985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d9193fee-bb89-421e-ac36-b367cfa0d560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:47.957565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d9193fee-bb89-421e-ac36-b367cfa0d560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:47.963931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9193fee-bb89-421e-ac36-b367cfa0d560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:47.964403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9193fee-bb89-421e-ac36-b367cfa0d560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:47.964827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9193fee-bb89-421e-ac36-b367cfa0d560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:47.965505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9193fee-bb89-421e-ac36-b367cfa0d560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:47.965945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9193fee-bb89-421e-ac36-b367cfa0d560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:47.966357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9193fee-bb89-421e-ac36-b367cfa0d560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:48.017332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e6164c00-991a-4b97-9735-31e88ca82882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:48.018159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e6164c00-991a-4b97-9735-31e88ca82882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:48.024555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6164c00-991a-4b97-9735-31e88ca82882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:48.025042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6164c00-991a-4b97-9735-31e88ca82882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:48.025476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6164c00-991a-4b97-9735-31e88ca82882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:48.026199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6164c00-991a-4b97-9735-31e88ca82882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:48.026652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6164c00-991a-4b97-9735-31e88ca82882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:48.027096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6164c00-991a-4b97-9735-31e88ca82882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:48.031351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d9193fee-bb89-421e-ac36-b367cfa0d560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:48.040181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d9193fee-bb89-421e-ac36-b367cfa0d560 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087105 Aug 31 00:47:48.040841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 958/1984] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:47 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:48.158547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e6164c00-991a-4b97-9735-31e88ca82882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:48.168085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e6164c00-991a-4b97-9735-31e88ca82882 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154560 Aug 31 00:47:48.168695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1027/1985] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:48 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:49.063598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be743b70-65b2-4780-a6fd-4f2addb155d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:49.064430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-be743b70-65b2-4780-a6fd-4f2addb155d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:49.072715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be743b70-65b2-4780-a6fd-4f2addb155d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:49.073191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be743b70-65b2-4780-a6fd-4f2addb155d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:49.073617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be743b70-65b2-4780-a6fd-4f2addb155d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:49.074303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be743b70-65b2-4780-a6fd-4f2addb155d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:49.074861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be743b70-65b2-4780-a6fd-4f2addb155d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:49.075304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be743b70-65b2-4780-a6fd-4f2addb155d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:49.137565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be743b70-65b2-4780-a6fd-4f2addb155d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:49.145631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-be743b70-65b2-4780-a6fd-4f2addb155d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087301 Aug 31 00:47:49.146184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 959/1986] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:49 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:49.189745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3242c557-bef7-4957-b4c7-9de4e7f0ba51 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:49.190491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3242c557-bef7-4957-b4c7-9de4e7f0ba51 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:49.196974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3242c557-bef7-4957-b4c7-9de4e7f0ba51 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:49.197454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3242c557-bef7-4957-b4c7-9de4e7f0ba51 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:49.197884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3242c557-bef7-4957-b4c7-9de4e7f0ba51 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:49.198568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3242c557-bef7-4957-b4c7-9de4e7f0ba51 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:49.199016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3242c557-bef7-4957-b4c7-9de4e7f0ba51 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:49.199461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3242c557-bef7-4957-b4c7-9de4e7f0ba51 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:49.331705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3242c557-bef7-4957-b4c7-9de4e7f0ba51 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:49.340538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3242c557-bef7-4957-b4c7-9de4e7f0ba51 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154600 Aug 31 00:47:49.341102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1028/1987] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:49 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:50.167652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1ad8435c-aee0-49f9-8e3e-99a463264c20 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:50.168190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1ad8435c-aee0-49f9-8e3e-99a463264c20 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:50.174478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad8435c-aee0-49f9-8e3e-99a463264c20 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:50.174951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad8435c-aee0-49f9-8e3e-99a463264c20 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:50.175405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad8435c-aee0-49f9-8e3e-99a463264c20 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:50.176076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad8435c-aee0-49f9-8e3e-99a463264c20 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:50.176519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad8435c-aee0-49f9-8e3e-99a463264c20 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:50.176930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ad8435c-aee0-49f9-8e3e-99a463264c20 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:50.237949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1ad8435c-aee0-49f9-8e3e-99a463264c20 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:50.246848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1ad8435c-aee0-49f9-8e3e-99a463264c20 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083130 Aug 31 00:47:50.247434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 960/1988] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:50 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:50.361992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6305a9e5-3a34-4ac0-95ba-e2925aac623c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:50.362592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6305a9e5-3a34-4ac0-95ba-e2925aac623c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:50.369735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6305a9e5-3a34-4ac0-95ba-e2925aac623c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:50.370213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6305a9e5-3a34-4ac0-95ba-e2925aac623c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:50.370645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6305a9e5-3a34-4ac0-95ba-e2925aac623c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:50.371353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6305a9e5-3a34-4ac0-95ba-e2925aac623c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:50.371812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6305a9e5-3a34-4ac0-95ba-e2925aac623c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:50.372233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6305a9e5-3a34-4ac0-95ba-e2925aac623c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:50.501100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6305a9e5-3a34-4ac0-95ba-e2925aac623c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:50.510302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6305a9e5-3a34-4ac0-95ba-e2925aac623c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152435 Aug 31 00:47:50.510881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1029/1989] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:50 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:51.267884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0a53f6b7-9d04-4d40-bf98-fccbeeb3acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:51.268443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0a53f6b7-9d04-4d40-bf98-fccbeeb3acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:51.275708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a53f6b7-9d04-4d40-bf98-fccbeeb3acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:51.276188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a53f6b7-9d04-4d40-bf98-fccbeeb3acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:51.276625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a53f6b7-9d04-4d40-bf98-fccbeeb3acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:51.277313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a53f6b7-9d04-4d40-bf98-fccbeeb3acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:51.277764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a53f6b7-9d04-4d40-bf98-fccbeeb3acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:51.278189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a53f6b7-9d04-4d40-bf98-fccbeeb3acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:51.344423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0a53f6b7-9d04-4d40-bf98-fccbeeb3acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:51.352958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0a53f6b7-9d04-4d40-bf98-fccbeeb3acdd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088841 Aug 31 00:47:51.353521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 961/1990] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:51 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:51.532838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3519af5e-38c2-44f2-90fd-e5401d246a1e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:51.533373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3519af5e-38c2-44f2-90fd-e5401d246a1e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:51.540561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3519af5e-38c2-44f2-90fd-e5401d246a1e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:51.541058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3519af5e-38c2-44f2-90fd-e5401d246a1e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:51.541500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3519af5e-38c2-44f2-90fd-e5401d246a1e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:51.542193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3519af5e-38c2-44f2-90fd-e5401d246a1e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:51.542649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3519af5e-38c2-44f2-90fd-e5401d246a1e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:51.543105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3519af5e-38c2-44f2-90fd-e5401d246a1e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:51.671545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3519af5e-38c2-44f2-90fd-e5401d246a1e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:51.680746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3519af5e-38c2-44f2-90fd-e5401d246a1e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151894 Aug 31 00:47:51.681312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1030/1991] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:51 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:52.374797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-13f3bf30-41c7-4e53-a6f1-bdb4debe5653 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:52.375428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-13f3bf30-41c7-4e53-a6f1-bdb4debe5653 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:52.381807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13f3bf30-41c7-4e53-a6f1-bdb4debe5653 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:52.382917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13f3bf30-41c7-4e53-a6f1-bdb4debe5653 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:52.383480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13f3bf30-41c7-4e53-a6f1-bdb4debe5653 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:52.384171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13f3bf30-41c7-4e53-a6f1-bdb4debe5653 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:52.384623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13f3bf30-41c7-4e53-a6f1-bdb4debe5653 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:52.385041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13f3bf30-41c7-4e53-a6f1-bdb4debe5653 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:52.447694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-13f3bf30-41c7-4e53-a6f1-bdb4debe5653 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:52.455885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-13f3bf30-41c7-4e53-a6f1-bdb4debe5653 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085062 Aug 31 00:47:52.456448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 962/1992] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:52 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:52.700947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-38c20d57-fab6-4605-b3bc-c7dedf145774 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:52.701503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-38c20d57-fab6-4605-b3bc-c7dedf145774 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:52.707905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c20d57-fab6-4605-b3bc-c7dedf145774 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:52.708374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c20d57-fab6-4605-b3bc-c7dedf145774 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:52.708799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c20d57-fab6-4605-b3bc-c7dedf145774 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:52.709470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c20d57-fab6-4605-b3bc-c7dedf145774 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:52.709908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c20d57-fab6-4605-b3bc-c7dedf145774 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:52.710355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c20d57-fab6-4605-b3bc-c7dedf145774 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:52.845961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-38c20d57-fab6-4605-b3bc-c7dedf145774 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:52.854784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-38c20d57-fab6-4605-b3bc-c7dedf145774 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157759 Aug 31 00:47:52.855385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1031/1993] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:52 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:53.477362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-33e41289-d2ea-4d4e-abc8-8eb22d2ecd81 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:53.479314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-33e41289-d2ea-4d4e-abc8-8eb22d2ecd81 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:53.490619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33e41289-d2ea-4d4e-abc8-8eb22d2ecd81 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:53.491143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33e41289-d2ea-4d4e-abc8-8eb22d2ecd81 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:53.492129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33e41289-d2ea-4d4e-abc8-8eb22d2ecd81 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:53.492869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33e41289-d2ea-4d4e-abc8-8eb22d2ecd81 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:53.493362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33e41289-d2ea-4d4e-abc8-8eb22d2ecd81 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:53.493778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33e41289-d2ea-4d4e-abc8-8eb22d2ecd81 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:53.556093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-33e41289-d2ea-4d4e-abc8-8eb22d2ecd81 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:53.564376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-33e41289-d2ea-4d4e-abc8-8eb22d2ecd81 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090984 Aug 31 00:47:53.564971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 963/1994] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:53 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:53.877568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-402a927c-4c68-4d11-83b1-2d59e7c13400 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:53.878297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-402a927c-4c68-4d11-83b1-2d59e7c13400 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:53.886768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-402a927c-4c68-4d11-83b1-2d59e7c13400 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:53.887291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-402a927c-4c68-4d11-83b1-2d59e7c13400 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:53.887731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-402a927c-4c68-4d11-83b1-2d59e7c13400 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:53.888434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-402a927c-4c68-4d11-83b1-2d59e7c13400 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:53.888888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-402a927c-4c68-4d11-83b1-2d59e7c13400 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:53.889310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-402a927c-4c68-4d11-83b1-2d59e7c13400 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:54.020943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-402a927c-4c68-4d11-83b1-2d59e7c13400 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:54.029225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-402a927c-4c68-4d11-83b1-2d59e7c13400 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156092 Aug 31 00:47:54.029785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1032/1995] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:53 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:54.586734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-35bd0f29-ffd2-4510-91e5-7925c1de465a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:54.587387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-35bd0f29-ffd2-4510-91e5-7925c1de465a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:54.594121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35bd0f29-ffd2-4510-91e5-7925c1de465a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:54.594582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35bd0f29-ffd2-4510-91e5-7925c1de465a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:54.595078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35bd0f29-ffd2-4510-91e5-7925c1de465a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:54.595754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35bd0f29-ffd2-4510-91e5-7925c1de465a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:54.596239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35bd0f29-ffd2-4510-91e5-7925c1de465a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:54.596656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35bd0f29-ffd2-4510-91e5-7925c1de465a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:54.664847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-35bd0f29-ffd2-4510-91e5-7925c1de465a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:54.673144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-35bd0f29-ffd2-4510-91e5-7925c1de465a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.091019 Aug 31 00:47:54.673715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 964/1996] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:54 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:55.051150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67a0534b-5c53-425f-b7bf-bb87dfbdeaa4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:55.051793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-67a0534b-5c53-425f-b7bf-bb87dfbdeaa4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:55.058891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67a0534b-5c53-425f-b7bf-bb87dfbdeaa4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:55.059399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67a0534b-5c53-425f-b7bf-bb87dfbdeaa4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:55.059867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67a0534b-5c53-425f-b7bf-bb87dfbdeaa4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:55.060551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67a0534b-5c53-425f-b7bf-bb87dfbdeaa4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:55.060997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67a0534b-5c53-425f-b7bf-bb87dfbdeaa4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:55.061416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67a0534b-5c53-425f-b7bf-bb87dfbdeaa4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:55.189510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67a0534b-5c53-425f-b7bf-bb87dfbdeaa4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:55.198477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67a0534b-5c53-425f-b7bf-bb87dfbdeaa4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151240 Aug 31 00:47:55.199045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1033/1997] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:55 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:55.693738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ba844a57-fce2-4835-9b14-8aaf9534464e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:55.694345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ba844a57-fce2-4835-9b14-8aaf9534464e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:55.701142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba844a57-fce2-4835-9b14-8aaf9534464e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:55.701625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba844a57-fce2-4835-9b14-8aaf9534464e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:55.702055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba844a57-fce2-4835-9b14-8aaf9534464e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:55.702741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba844a57-fce2-4835-9b14-8aaf9534464e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:55.703216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba844a57-fce2-4835-9b14-8aaf9534464e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:55.703639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba844a57-fce2-4835-9b14-8aaf9534464e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:55.765957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ba844a57-fce2-4835-9b14-8aaf9534464e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:55.775187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ba844a57-fce2-4835-9b14-8aaf9534464e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085319 Aug 31 00:47:55.775754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 965/1998] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:55 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:56.222959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d179191b-ca51-42cb-9136-0db931ec7a8d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:56.223606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d179191b-ca51-42cb-9136-0db931ec7a8d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:56.230139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179191b-ca51-42cb-9136-0db931ec7a8d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:56.230609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179191b-ca51-42cb-9136-0db931ec7a8d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:56.231050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179191b-ca51-42cb-9136-0db931ec7a8d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:56.231827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179191b-ca51-42cb-9136-0db931ec7a8d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:56.232275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179191b-ca51-42cb-9136-0db931ec7a8d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:56.232689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d179191b-ca51-42cb-9136-0db931ec7a8d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:56.363595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d179191b-ca51-42cb-9136-0db931ec7a8d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:56.371819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d179191b-ca51-42cb-9136-0db931ec7a8d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152735 Aug 31 00:47:56.372592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1034/1999] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:56 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:56.797375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6a68e592-ef22-4ecc-b9b3-11a129f6f3df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:56.798030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6a68e592-ef22-4ecc-b9b3-11a129f6f3df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:56.804941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a68e592-ef22-4ecc-b9b3-11a129f6f3df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:56.805408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a68e592-ef22-4ecc-b9b3-11a129f6f3df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:56.805831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a68e592-ef22-4ecc-b9b3-11a129f6f3df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:56.806501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a68e592-ef22-4ecc-b9b3-11a129f6f3df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:56.806941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a68e592-ef22-4ecc-b9b3-11a129f6f3df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:56.807379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a68e592-ef22-4ecc-b9b3-11a129f6f3df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:56.867717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6a68e592-ef22-4ecc-b9b3-11a129f6f3df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:56.876039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6a68e592-ef22-4ecc-b9b3-11a129f6f3df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082512 Aug 31 00:47:56.876601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 966/2000] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:56 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:57.393355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ef22e53-fe23-4129-a988-8fe67d909ec6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:57.393968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ef22e53-fe23-4129-a988-8fe67d909ec6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:57.401141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ef22e53-fe23-4129-a988-8fe67d909ec6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:57.401669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ef22e53-fe23-4129-a988-8fe67d909ec6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:57.402051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ef22e53-fe23-4129-a988-8fe67d909ec6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:57.402733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ef22e53-fe23-4129-a988-8fe67d909ec6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:57.403213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ef22e53-fe23-4129-a988-8fe67d909ec6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:57.403634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ef22e53-fe23-4129-a988-8fe67d909ec6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:57.531663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ef22e53-fe23-4129-a988-8fe67d909ec6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:57.540916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ef22e53-fe23-4129-a988-8fe67d909ec6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151380 Aug 31 00:47:57.541526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1035/2001] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:57 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:57.900630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e2385d7a-b1f1-42ab-8910-706de1ad939b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:57.901241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e2385d7a-b1f1-42ab-8910-706de1ad939b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:57.907299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2385d7a-b1f1-42ab-8910-706de1ad939b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:57.907751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2385d7a-b1f1-42ab-8910-706de1ad939b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:57.908181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2385d7a-b1f1-42ab-8910-706de1ad939b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:57.908857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2385d7a-b1f1-42ab-8910-706de1ad939b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:57.909306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2385d7a-b1f1-42ab-8910-706de1ad939b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:57.909722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2385d7a-b1f1-42ab-8910-706de1ad939b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:57.976388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e2385d7a-b1f1-42ab-8910-706de1ad939b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:57.984677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e2385d7a-b1f1-42ab-8910-706de1ad939b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089269 Aug 31 00:47:57.985671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 967/2002] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:57 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:58.561968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-58f51d84-c143-49ee-9b32-f6199236b8e9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:58.562556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-58f51d84-c143-49ee-9b32-f6199236b8e9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:58.568982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f51d84-c143-49ee-9b32-f6199236b8e9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:58.569975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f51d84-c143-49ee-9b32-f6199236b8e9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:58.570423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f51d84-c143-49ee-9b32-f6199236b8e9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:58.571204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f51d84-c143-49ee-9b32-f6199236b8e9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:58.571654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f51d84-c143-49ee-9b32-f6199236b8e9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:58.572074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58f51d84-c143-49ee-9b32-f6199236b8e9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:58.702305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-58f51d84-c143-49ee-9b32-f6199236b8e9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:58.711443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-58f51d84-c143-49ee-9b32-f6199236b8e9 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153331 Aug 31 00:47:58.712001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1036/2003] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:58 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:59.007821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3b603c1f-0edb-4ec5-9fa1-cdfd1672d11d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:59.008419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3b603c1f-0edb-4ec5-9fa1-cdfd1672d11d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:59.014746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b603c1f-0edb-4ec5-9fa1-cdfd1672d11d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:59.015257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b603c1f-0edb-4ec5-9fa1-cdfd1672d11d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:59.015682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b603c1f-0edb-4ec5-9fa1-cdfd1672d11d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:59.016352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b603c1f-0edb-4ec5-9fa1-cdfd1672d11d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:59.016792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b603c1f-0edb-4ec5-9fa1-cdfd1672d11d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:59.017231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b603c1f-0edb-4ec5-9fa1-cdfd1672d11d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:59.077335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3b603c1f-0edb-4ec5-9fa1-cdfd1672d11d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:59.085881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3b603c1f-0edb-4ec5-9fa1-cdfd1672d11d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.081873 Aug 31 00:47:59.086444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 968/2004] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:59 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:59.857621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9ab01f09-7d55-445c-8c87-d71e22ee4050 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:59.858226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9ab01f09-7d55-445c-8c87-d71e22ee4050 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:59.864593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab01f09-7d55-445c-8c87-d71e22ee4050 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:59.865075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab01f09-7d55-445c-8c87-d71e22ee4050 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:59.865496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab01f09-7d55-445c-8c87-d71e22ee4050 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:59.866751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab01f09-7d55-445c-8c87-d71e22ee4050 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:59.867212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab01f09-7d55-445c-8c87-d71e22ee4050 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:59.867627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab01f09-7d55-445c-8c87-d71e22ee4050 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:59.999770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9ab01f09-7d55-445c-8c87-d71e22ee4050 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:00.007987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9ab01f09-7d55-445c-8c87-d71e22ee4050 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.279301 Aug 31 00:48:00.008541 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1037/2005] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:59 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:00.228941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5da05f03-775f-442c-bb4b-993b5aede523 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:00.229563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5da05f03-775f-442c-bb4b-993b5aede523 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:00.235857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5da05f03-775f-442c-bb4b-993b5aede523 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:00.236343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5da05f03-775f-442c-bb4b-993b5aede523 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:00.236774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5da05f03-775f-442c-bb4b-993b5aede523 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:00.237466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5da05f03-775f-442c-bb4b-993b5aede523 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:00.237918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5da05f03-775f-442c-bb4b-993b5aede523 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:00.238340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5da05f03-775f-442c-bb4b-993b5aede523 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:00.303376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5da05f03-775f-442c-bb4b-993b5aede523 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:00.313545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5da05f03-775f-442c-bb4b-993b5aede523 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.209698 Aug 31 00:48:00.314229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 969/2006] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:01.029511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf55ab82-8aa8-468c-a641-e9781a2b65a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:01.030146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf55ab82-8aa8-468c-a641-e9781a2b65a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:01.037096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf55ab82-8aa8-468c-a641-e9781a2b65a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:01.037222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf55ab82-8aa8-468c-a641-e9781a2b65a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:01.037567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf55ab82-8aa8-468c-a641-e9781a2b65a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:01.039296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf55ab82-8aa8-468c-a641-e9781a2b65a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:01.039817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf55ab82-8aa8-468c-a641-e9781a2b65a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:01.040243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf55ab82-8aa8-468c-a641-e9781a2b65a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:01.168467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bf55ab82-8aa8-468c-a641-e9781a2b65a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:01.176988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf55ab82-8aa8-468c-a641-e9781a2b65a4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151420 Aug 31 00:48:01.177558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1038/2007] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:01 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:01.333888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ce76ec8b-4887-4af3-982d-fbf77b3e33de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:01.334516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ce76ec8b-4887-4af3-982d-fbf77b3e33de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:01.341103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce76ec8b-4887-4af3-982d-fbf77b3e33de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:01.341574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce76ec8b-4887-4af3-982d-fbf77b3e33de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:01.341997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce76ec8b-4887-4af3-982d-fbf77b3e33de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:01.342672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce76ec8b-4887-4af3-982d-fbf77b3e33de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:01.343136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce76ec8b-4887-4af3-982d-fbf77b3e33de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:01.343577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce76ec8b-4887-4af3-982d-fbf77b3e33de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:01.408061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ce76ec8b-4887-4af3-982d-fbf77b3e33de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:01.416848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ce76ec8b-4887-4af3-982d-fbf77b3e33de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086796 Aug 31 00:48:01.417408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 970/2008] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:01 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:02.199939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9004f7ef-1ead-412a-9a17-ccfdd1c352be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:02.200575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9004f7ef-1ead-412a-9a17-ccfdd1c352be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:02.207438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9004f7ef-1ead-412a-9a17-ccfdd1c352be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:02.207916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9004f7ef-1ead-412a-9a17-ccfdd1c352be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:02.208347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9004f7ef-1ead-412a-9a17-ccfdd1c352be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:02.209031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9004f7ef-1ead-412a-9a17-ccfdd1c352be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:02.209482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9004f7ef-1ead-412a-9a17-ccfdd1c352be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:02.210720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9004f7ef-1ead-412a-9a17-ccfdd1c352be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:02.338281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9004f7ef-1ead-412a-9a17-ccfdd1c352be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:02.346483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9004f7ef-1ead-412a-9a17-ccfdd1c352be tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150418 Aug 31 00:48:02.347072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1039/2009] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:02 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:02.438240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a16fd857-ad49-450c-87e7-26282aba1229 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:02.438851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a16fd857-ad49-450c-87e7-26282aba1229 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:02.446158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a16fd857-ad49-450c-87e7-26282aba1229 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:02.446632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a16fd857-ad49-450c-87e7-26282aba1229 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:02.447081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a16fd857-ad49-450c-87e7-26282aba1229 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:02.447767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a16fd857-ad49-450c-87e7-26282aba1229 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:02.448216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a16fd857-ad49-450c-87e7-26282aba1229 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:02.448635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a16fd857-ad49-450c-87e7-26282aba1229 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:02.464022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:02.513161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a16fd857-ad49-450c-87e7-26282aba1229 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:02.521245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a16fd857-ad49-450c-87e7-26282aba1229 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086861 Aug 31 00:48:02.521800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 971/2010] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:02 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:03.367651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3c4c0a85-e3aa-4e60-88c2-3799f9948c11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:03.368251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3c4c0a85-e3aa-4e60-88c2-3799f9948c11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:03.374591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c4c0a85-e3aa-4e60-88c2-3799f9948c11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:03.375092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c4c0a85-e3aa-4e60-88c2-3799f9948c11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:03.375524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c4c0a85-e3aa-4e60-88c2-3799f9948c11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:03.376196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c4c0a85-e3aa-4e60-88c2-3799f9948c11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:03.376636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c4c0a85-e3aa-4e60-88c2-3799f9948c11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:03.377046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c4c0a85-e3aa-4e60-88c2-3799f9948c11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:03.379813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:03.514400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3c4c0a85-e3aa-4e60-88c2-3799f9948c11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:03.522535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3c4c0a85-e3aa-4e60-88c2-3799f9948c11 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.158709 Aug 31 00:48:03.523138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1040/2011] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:03 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:03.543159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2c1c1953-bb71-44b6-9f74-4e87152a29e1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:03.544426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2c1c1953-bb71-44b6-9f74-4e87152a29e1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:03.550818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c1c1953-bb71-44b6-9f74-4e87152a29e1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:03.551348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c1c1953-bb71-44b6-9f74-4e87152a29e1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:03.551778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c1c1953-bb71-44b6-9f74-4e87152a29e1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:03.552478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c1c1953-bb71-44b6-9f74-4e87152a29e1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:03.552926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c1c1953-bb71-44b6-9f74-4e87152a29e1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:03.553911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c1c1953-bb71-44b6-9f74-4e87152a29e1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:03.616431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c1c1953-bb71-44b6-9f74-4e87152a29e1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:03.624844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2c1c1953-bb71-44b6-9f74-4e87152a29e1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085422 Aug 31 00:48:03.625370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 972/2012] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:03 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:04.543723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e282e053-b2d5-4a88-83bb-d6ca68653df4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:04.544368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e282e053-b2d5-4a88-83bb-d6ca68653df4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:04.550847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e282e053-b2d5-4a88-83bb-d6ca68653df4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:04.551365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e282e053-b2d5-4a88-83bb-d6ca68653df4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:04.551810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e282e053-b2d5-4a88-83bb-d6ca68653df4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:04.552479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e282e053-b2d5-4a88-83bb-d6ca68653df4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:04.552928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e282e053-b2d5-4a88-83bb-d6ca68653df4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:04.553446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e282e053-b2d5-4a88-83bb-d6ca68653df4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:04.645794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0e84041f-e2bf-42b0-8db2-a9ccbfcd2c01 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:04.646390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0e84041f-e2bf-42b0-8db2-a9ccbfcd2c01 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:04.653427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e84041f-e2bf-42b0-8db2-a9ccbfcd2c01 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:04.653912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e84041f-e2bf-42b0-8db2-a9ccbfcd2c01 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:04.654349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e84041f-e2bf-42b0-8db2-a9ccbfcd2c01 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:04.655069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e84041f-e2bf-42b0-8db2-a9ccbfcd2c01 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:04.655526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e84041f-e2bf-42b0-8db2-a9ccbfcd2c01 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:04.655949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e84041f-e2bf-42b0-8db2-a9ccbfcd2c01 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:04.684967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e282e053-b2d5-4a88-83bb-d6ca68653df4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:04.693443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e282e053-b2d5-4a88-83bb-d6ca68653df4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153571 Aug 31 00:48:04.694577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1041/2013] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:04 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:04.721250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0e84041f-e2bf-42b0-8db2-a9ccbfcd2c01 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:04.730337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0e84041f-e2bf-42b0-8db2-a9ccbfcd2c01 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088352 Aug 31 00:48:04.730903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 973/2014] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:04 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:05.714943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-143a1cca-f069-4931-b5d4-4bf09ebcd3a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:05.715680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-143a1cca-f069-4931-b5d4-4bf09ebcd3a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:05.722312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143a1cca-f069-4931-b5d4-4bf09ebcd3a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:05.722785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143a1cca-f069-4931-b5d4-4bf09ebcd3a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:05.723249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143a1cca-f069-4931-b5d4-4bf09ebcd3a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:05.723934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143a1cca-f069-4931-b5d4-4bf09ebcd3a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:05.724383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143a1cca-f069-4931-b5d4-4bf09ebcd3a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:05.724801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-143a1cca-f069-4931-b5d4-4bf09ebcd3a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:05.752493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-67cc4365-41b7-41c6-8ae4-9db1ae34d3f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:05.753231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-67cc4365-41b7-41c6-8ae4-9db1ae34d3f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:05.755556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=56 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:05.762329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67cc4365-41b7-41c6-8ae4-9db1ae34d3f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:05.762812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67cc4365-41b7-41c6-8ae4-9db1ae34d3f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:05.763272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67cc4365-41b7-41c6-8ae4-9db1ae34d3f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:05.763971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67cc4365-41b7-41c6-8ae4-9db1ae34d3f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:05.764418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67cc4365-41b7-41c6-8ae4-9db1ae34d3f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:05.764836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67cc4365-41b7-41c6-8ae4-9db1ae34d3f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:05.844913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-67cc4365-41b7-41c6-8ae4-9db1ae34d3f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:05.853288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-67cc4365-41b7-41c6-8ae4-9db1ae34d3f0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.104687 Aug 31 00:48:05.853866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 974/2015] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:05 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:05.874992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-143a1cca-f069-4931-b5d4-4bf09ebcd3a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:05.884027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-143a1cca-f069-4931-b5d4-4bf09ebcd3a1 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.172964 Aug 31 00:48:05.884601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1042/2016] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:05 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:06.878565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0e502548-7bfb-4204-ac48-a868298eb40d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:06.879579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0e502548-7bfb-4204-ac48-a868298eb40d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:06.887896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e502548-7bfb-4204-ac48-a868298eb40d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:06.888380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e502548-7bfb-4204-ac48-a868298eb40d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:06.888809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e502548-7bfb-4204-ac48-a868298eb40d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:06.889506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e502548-7bfb-4204-ac48-a868298eb40d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:06.889949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e502548-7bfb-4204-ac48-a868298eb40d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:06.890362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e502548-7bfb-4204-ac48-a868298eb40d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:06.904989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c8d1d94e-c657-43db-899a-624f45cbf134 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:06.905594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c8d1d94e-c657-43db-899a-624f45cbf134 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:06.912157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d1d94e-c657-43db-899a-624f45cbf134 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:06.913440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d1d94e-c657-43db-899a-624f45cbf134 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:06.913888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d1d94e-c657-43db-899a-624f45cbf134 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:06.914592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d1d94e-c657-43db-899a-624f45cbf134 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:06.915070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d1d94e-c657-43db-899a-624f45cbf134 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:06.915497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d1d94e-c657-43db-899a-624f45cbf134 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:06.957293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0e502548-7bfb-4204-ac48-a868298eb40d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:06.966910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0e502548-7bfb-4204-ac48-a868298eb40d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.094620 Aug 31 00:48:06.967726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 975/2017] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:06 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:07.056929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c8d1d94e-c657-43db-899a-624f45cbf134 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:07.065046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c8d1d94e-c657-43db-899a-624f45cbf134 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.163941 Aug 31 00:48:07.065608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1043/2018] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:06 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:07.987890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bdc10fb0-1440-4091-889f-fef7f3cee91c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:07.988491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bdc10fb0-1440-4091-889f-fef7f3cee91c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:07.995364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bdc10fb0-1440-4091-889f-fef7f3cee91c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:07.995836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bdc10fb0-1440-4091-889f-fef7f3cee91c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:07.996261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bdc10fb0-1440-4091-889f-fef7f3cee91c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:07.996944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bdc10fb0-1440-4091-889f-fef7f3cee91c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:07.997384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bdc10fb0-1440-4091-889f-fef7f3cee91c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:07.997797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bdc10fb0-1440-4091-889f-fef7f3cee91c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:08.078662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bdc10fb0-1440-4091-889f-fef7f3cee91c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:08.087695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bdc10fb0-1440-4091-889f-fef7f3cee91c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.103879 Aug 31 00:48:08.088267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 976/2019] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:07 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:08.088614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-908e2a1b-b633-4b88-8aa8-5e8ffb559f3c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:08.089228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-908e2a1b-b633-4b88-8aa8-5e8ffb559f3c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:08.096059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-908e2a1b-b633-4b88-8aa8-5e8ffb559f3c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:08.096536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-908e2a1b-b633-4b88-8aa8-5e8ffb559f3c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:08.097195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-908e2a1b-b633-4b88-8aa8-5e8ffb559f3c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:08.098093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-908e2a1b-b633-4b88-8aa8-5e8ffb559f3c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:08.098538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-908e2a1b-b633-4b88-8aa8-5e8ffb559f3c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:08.098955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-908e2a1b-b633-4b88-8aa8-5e8ffb559f3c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:08.313521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-908e2a1b-b633-4b88-8aa8-5e8ffb559f3c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:08.324810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-908e2a1b-b633-4b88-8aa8-5e8ffb559f3c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.241231 Aug 31 00:48:08.325712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1044/2020] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:08 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:09.109049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-916c6186-71d3-41ab-95f6-783812616317 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:09.109723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-916c6186-71d3-41ab-95f6-783812616317 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:09.116882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-916c6186-71d3-41ab-95f6-783812616317 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:09.117357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-916c6186-71d3-41ab-95f6-783812616317 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:09.117786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-916c6186-71d3-41ab-95f6-783812616317 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:09.118467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-916c6186-71d3-41ab-95f6-783812616317 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:09.118914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-916c6186-71d3-41ab-95f6-783812616317 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:09.119372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-916c6186-71d3-41ab-95f6-783812616317 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:09.180133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-916c6186-71d3-41ab-95f6-783812616317 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:09.188248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-916c6186-71d3-41ab-95f6-783812616317 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083120 Aug 31 00:48:09.188816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 977/2021] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:09 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:09.347400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fdc9bfee-a89e-4c84-9990-1f714dc76f26 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:09.348042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fdc9bfee-a89e-4c84-9990-1f714dc76f26 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:09.350954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:09.356200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdc9bfee-a89e-4c84-9990-1f714dc76f26 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:09.356685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdc9bfee-a89e-4c84-9990-1f714dc76f26 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:09.357120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdc9bfee-a89e-4c84-9990-1f714dc76f26 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:09.357806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdc9bfee-a89e-4c84-9990-1f714dc76f26 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:09.358258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdc9bfee-a89e-4c84-9990-1f714dc76f26 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:09.358681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdc9bfee-a89e-4c84-9990-1f714dc76f26 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:09.484223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fdc9bfee-a89e-4c84-9990-1f714dc76f26 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:09.492670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fdc9bfee-a89e-4c84-9990-1f714dc76f26 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149315 Aug 31 00:48:09.493223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1045/2022] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:09 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:10.211067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-56f6771d-f601-499c-8b36-e0908e95aa5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:10.211682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-56f6771d-f601-499c-8b36-e0908e95aa5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:10.218672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56f6771d-f601-499c-8b36-e0908e95aa5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:10.218784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56f6771d-f601-499c-8b36-e0908e95aa5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:10.219153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56f6771d-f601-499c-8b36-e0908e95aa5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:10.219842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56f6771d-f601-499c-8b36-e0908e95aa5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:10.220284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56f6771d-f601-499c-8b36-e0908e95aa5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:10.220703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56f6771d-f601-499c-8b36-e0908e95aa5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:10.285329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-56f6771d-f601-499c-8b36-e0908e95aa5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:10.293886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-56f6771d-f601-499c-8b36-e0908e95aa5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086917 Aug 31 00:48:10.294453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 978/2023] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:10 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:10.516802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-546c1726-623c-4e34-9e03-8f1cbdd24e5a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:10.517345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-546c1726-623c-4e34-9e03-8f1cbdd24e5a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:10.523852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-546c1726-623c-4e34-9e03-8f1cbdd24e5a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:10.524331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-546c1726-623c-4e34-9e03-8f1cbdd24e5a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:10.524760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-546c1726-623c-4e34-9e03-8f1cbdd24e5a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:10.525429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-546c1726-623c-4e34-9e03-8f1cbdd24e5a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:10.525868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-546c1726-623c-4e34-9e03-8f1cbdd24e5a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:10.526279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-546c1726-623c-4e34-9e03-8f1cbdd24e5a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:10.654377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-546c1726-623c-4e34-9e03-8f1cbdd24e5a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:10.663613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-546c1726-623c-4e34-9e03-8f1cbdd24e5a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150371 Aug 31 00:48:10.664187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1046/2024] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:10 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:11.314486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-50ecf996-27b9-4302-84f8-8d0cdb7e4a02 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:11.315138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-50ecf996-27b9-4302-84f8-8d0cdb7e4a02 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:11.322054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-50ecf996-27b9-4302-84f8-8d0cdb7e4a02 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:11.322523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-50ecf996-27b9-4302-84f8-8d0cdb7e4a02 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:11.322979 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-50ecf996-27b9-4302-84f8-8d0cdb7e4a02 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:11.323689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-50ecf996-27b9-4302-84f8-8d0cdb7e4a02 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:11.324133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-50ecf996-27b9-4302-84f8-8d0cdb7e4a02 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:11.324547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-50ecf996-27b9-4302-84f8-8d0cdb7e4a02 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:11.386197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-50ecf996-27b9-4302-84f8-8d0cdb7e4a02 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:11.394317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-50ecf996-27b9-4302-84f8-8d0cdb7e4a02 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083660 Aug 31 00:48:11.394906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 979/2025] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:11 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:11.684969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c416b2bb-227c-4815-b4b7-2859ad782420 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:11.685580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c416b2bb-227c-4815-b4b7-2859ad782420 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:11.692026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c416b2bb-227c-4815-b4b7-2859ad782420 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:11.692509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c416b2bb-227c-4815-b4b7-2859ad782420 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:11.692944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c416b2bb-227c-4815-b4b7-2859ad782420 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:11.694312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c416b2bb-227c-4815-b4b7-2859ad782420 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:11.694772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c416b2bb-227c-4815-b4b7-2859ad782420 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:11.695402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c416b2bb-227c-4815-b4b7-2859ad782420 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:11.823731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c416b2bb-227c-4815-b4b7-2859ad782420 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:11.831969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c416b2bb-227c-4815-b4b7-2859ad782420 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150860 Aug 31 00:48:11.832530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1047/2026] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:11 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:12.417015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ca9ab206-c7a8-4ab0-bbea-0b894a48fd42 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:12.417600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ca9ab206-c7a8-4ab0-bbea-0b894a48fd42 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:12.424112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9ab206-c7a8-4ab0-bbea-0b894a48fd42 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:12.424594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9ab206-c7a8-4ab0-bbea-0b894a48fd42 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:12.425017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9ab206-c7a8-4ab0-bbea-0b894a48fd42 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:12.425705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9ab206-c7a8-4ab0-bbea-0b894a48fd42 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:12.426153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9ab206-c7a8-4ab0-bbea-0b894a48fd42 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:12.426580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9ab206-c7a8-4ab0-bbea-0b894a48fd42 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:12.487942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca9ab206-c7a8-4ab0-bbea-0b894a48fd42 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:12.496176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ca9ab206-c7a8-4ab0-bbea-0b894a48fd42 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083995 Aug 31 00:48:12.496726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 980/2027] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:12 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:12.855255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-19612c1c-13a5-4891-90ef-b3e8e41d8207 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:12.855885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-19612c1c-13a5-4891-90ef-b3e8e41d8207 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:12.862642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19612c1c-13a5-4891-90ef-b3e8e41d8207 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:12.863155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19612c1c-13a5-4891-90ef-b3e8e41d8207 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:12.863597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19612c1c-13a5-4891-90ef-b3e8e41d8207 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:12.864281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19612c1c-13a5-4891-90ef-b3e8e41d8207 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:12.864737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19612c1c-13a5-4891-90ef-b3e8e41d8207 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:12.865738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19612c1c-13a5-4891-90ef-b3e8e41d8207 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:12.994810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-19612c1c-13a5-4891-90ef-b3e8e41d8207 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:13.003207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-19612c1c-13a5-4891-90ef-b3e8e41d8207 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151822 Aug 31 00:48:13.003774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1048/2028] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:12 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:13.517433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b310d389-6143-4462-9815-f295709ee0ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:13.518038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b310d389-6143-4462-9815-f295709ee0ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:13.525113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b310d389-6143-4462-9815-f295709ee0ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:13.525592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b310d389-6143-4462-9815-f295709ee0ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:13.526021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b310d389-6143-4462-9815-f295709ee0ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:13.526704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b310d389-6143-4462-9815-f295709ee0ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:13.527223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b310d389-6143-4462-9815-f295709ee0ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:13.527641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b310d389-6143-4462-9815-f295709ee0ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:13.592530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b310d389-6143-4462-9815-f295709ee0ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:13.600872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b310d389-6143-4462-9815-f295709ee0ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087391 Aug 31 00:48:13.601436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 981/2029] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:13 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:14.024518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6daddacc-4974-4809-9cb3-7db975a47859 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:14.025124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6daddacc-4974-4809-9cb3-7db975a47859 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:14.031628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6daddacc-4974-4809-9cb3-7db975a47859 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:14.032042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6daddacc-4974-4809-9cb3-7db975a47859 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:14.032477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6daddacc-4974-4809-9cb3-7db975a47859 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:14.033163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6daddacc-4974-4809-9cb3-7db975a47859 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:14.033614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6daddacc-4974-4809-9cb3-7db975a47859 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:14.034036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6daddacc-4974-4809-9cb3-7db975a47859 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:14.160244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6daddacc-4974-4809-9cb3-7db975a47859 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:14.169130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6daddacc-4974-4809-9cb3-7db975a47859 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.148460 Aug 31 00:48:14.169700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1049/2030] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:14 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:14.622423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d4983ea0-2afd-4149-9d08-d79424d40985 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:14.623021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d4983ea0-2afd-4149-9d08-d79424d40985 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:14.629756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4983ea0-2afd-4149-9d08-d79424d40985 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:14.630240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4983ea0-2afd-4149-9d08-d79424d40985 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:14.630753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4983ea0-2afd-4149-9d08-d79424d40985 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:14.631517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4983ea0-2afd-4149-9d08-d79424d40985 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:14.631970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4983ea0-2afd-4149-9d08-d79424d40985 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:14.632391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4983ea0-2afd-4149-9d08-d79424d40985 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:14.703519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d4983ea0-2afd-4149-9d08-d79424d40985 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:14.713580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d4983ea0-2afd-4149-9d08-d79424d40985 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.094926 Aug 31 00:48:14.714573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 982/2031] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:14 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:15.190804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-53825988-07ae-4816-bf4e-d1e2e492c536 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:15.191439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-53825988-07ae-4816-bf4e-d1e2e492c536 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:15.198288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53825988-07ae-4816-bf4e-d1e2e492c536 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:15.198761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53825988-07ae-4816-bf4e-d1e2e492c536 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:15.199236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53825988-07ae-4816-bf4e-d1e2e492c536 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:15.199906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53825988-07ae-4816-bf4e-d1e2e492c536 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:15.200352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53825988-07ae-4816-bf4e-d1e2e492c536 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:15.200763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53825988-07ae-4816-bf4e-d1e2e492c536 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:15.339914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-53825988-07ae-4816-bf4e-d1e2e492c536 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:15.348313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-53825988-07ae-4816-bf4e-d1e2e492c536 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.161361 Aug 31 00:48:15.348881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1050/2032] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:15 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:15.736256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a06a2a20-0ac1-4828-a774-55ef08c5d456 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:15.736858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a06a2a20-0ac1-4828-a774-55ef08c5d456 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:15.744064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a06a2a20-0ac1-4828-a774-55ef08c5d456 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:15.744535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a06a2a20-0ac1-4828-a774-55ef08c5d456 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:15.744961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a06a2a20-0ac1-4828-a774-55ef08c5d456 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:15.745636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a06a2a20-0ac1-4828-a774-55ef08c5d456 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:15.746078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a06a2a20-0ac1-4828-a774-55ef08c5d456 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:15.746488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a06a2a20-0ac1-4828-a774-55ef08c5d456 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:15.807484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a06a2a20-0ac1-4828-a774-55ef08c5d456 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:15.815521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a06a2a20-0ac1-4828-a774-55ef08c5d456 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083418 Aug 31 00:48:15.816070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 983/2033] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:15 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:16.371686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8bc1a762-175c-46f7-bedc-80dfdf7c1b9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:16.372295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8bc1a762-175c-46f7-bedc-80dfdf7c1b9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:16.378814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8bc1a762-175c-46f7-bedc-80dfdf7c1b9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:16.379332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8bc1a762-175c-46f7-bedc-80dfdf7c1b9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:16.379770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8bc1a762-175c-46f7-bedc-80dfdf7c1b9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:16.381207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8bc1a762-175c-46f7-bedc-80dfdf7c1b9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:16.381738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8bc1a762-175c-46f7-bedc-80dfdf7c1b9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:16.382187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8bc1a762-175c-46f7-bedc-80dfdf7c1b9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:16.508980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8bc1a762-175c-46f7-bedc-80dfdf7c1b9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:16.517093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8bc1a762-175c-46f7-bedc-80dfdf7c1b9c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149290 Aug 31 00:48:16.517678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1051/2034] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:16 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:16.837287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9c662b2e-db2c-4df1-8502-df2d17043a51 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:16.837900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9c662b2e-db2c-4df1-8502-df2d17043a51 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:16.844329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c662b2e-db2c-4df1-8502-df2d17043a51 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:16.844799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c662b2e-db2c-4df1-8502-df2d17043a51 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:16.845226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c662b2e-db2c-4df1-8502-df2d17043a51 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:16.845897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c662b2e-db2c-4df1-8502-df2d17043a51 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:16.846337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c662b2e-db2c-4df1-8502-df2d17043a51 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:16.846754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c662b2e-db2c-4df1-8502-df2d17043a51 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:16.910597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9c662b2e-db2c-4df1-8502-df2d17043a51 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:16.919207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9c662b2e-db2c-4df1-8502-df2d17043a51 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085946 Aug 31 00:48:16.919765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 984/2035] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:16 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:17.539287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-19019eea-1d1b-4250-ae75-624cd195a384 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:17.539893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-19019eea-1d1b-4250-ae75-624cd195a384 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:17.546345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19019eea-1d1b-4250-ae75-624cd195a384 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:17.546817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19019eea-1d1b-4250-ae75-624cd195a384 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:17.547286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19019eea-1d1b-4250-ae75-624cd195a384 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:17.547971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19019eea-1d1b-4250-ae75-624cd195a384 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:17.548421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19019eea-1d1b-4250-ae75-624cd195a384 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:17.548835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-19019eea-1d1b-4250-ae75-624cd195a384 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:17.676115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-19019eea-1d1b-4250-ae75-624cd195a384 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:17.684458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-19019eea-1d1b-4250-ae75-624cd195a384 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149707 Aug 31 00:48:17.685021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1052/2036] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:17 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:17.941566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-559bfb80-70cb-4b91-8de0-16e385dee526 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:17.942198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-559bfb80-70cb-4b91-8de0-16e385dee526 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:17.949186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-559bfb80-70cb-4b91-8de0-16e385dee526 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:17.949664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-559bfb80-70cb-4b91-8de0-16e385dee526 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:17.950098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-559bfb80-70cb-4b91-8de0-16e385dee526 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:17.950782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-559bfb80-70cb-4b91-8de0-16e385dee526 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:17.951262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-559bfb80-70cb-4b91-8de0-16e385dee526 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:17.951686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-559bfb80-70cb-4b91-8de0-16e385dee526 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:18.012773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-559bfb80-70cb-4b91-8de0-16e385dee526 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:18.021038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-559bfb80-70cb-4b91-8de0-16e385dee526 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083313 Aug 31 00:48:18.021983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 985/2037] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:17 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:18.705874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b474ad1c-ca77-47d2-bc6d-4d8049f1c0cf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:18.706474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b474ad1c-ca77-47d2-bc6d-4d8049f1c0cf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:18.713602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b474ad1c-ca77-47d2-bc6d-4d8049f1c0cf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:18.714080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b474ad1c-ca77-47d2-bc6d-4d8049f1c0cf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:18.714511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b474ad1c-ca77-47d2-bc6d-4d8049f1c0cf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:18.715220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b474ad1c-ca77-47d2-bc6d-4d8049f1c0cf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:18.715671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b474ad1c-ca77-47d2-bc6d-4d8049f1c0cf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:18.716089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b474ad1c-ca77-47d2-bc6d-4d8049f1c0cf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:18.858107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b474ad1c-ca77-47d2-bc6d-4d8049f1c0cf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:18.867649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b474ad1c-ca77-47d2-bc6d-4d8049f1c0cf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.165595 Aug 31 00:48:18.868215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1053/2038] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:18 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:19.043154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a1a33bfb-7384-4a30-9a8a-9d31a4c4e889 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:19.043790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a1a33bfb-7384-4a30-9a8a-9d31a4c4e889 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:19.050215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1a33bfb-7384-4a30-9a8a-9d31a4c4e889 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:19.050691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1a33bfb-7384-4a30-9a8a-9d31a4c4e889 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:19.051148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1a33bfb-7384-4a30-9a8a-9d31a4c4e889 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:19.051826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1a33bfb-7384-4a30-9a8a-9d31a4c4e889 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:19.052879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1a33bfb-7384-4a30-9a8a-9d31a4c4e889 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:19.053460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1a33bfb-7384-4a30-9a8a-9d31a4c4e889 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:19.114031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a1a33bfb-7384-4a30-9a8a-9d31a4c4e889 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:19.123193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a1a33bfb-7384-4a30-9a8a-9d31a4c4e889 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083911 Aug 31 00:48:19.123762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 986/2039] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:19 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:19.890442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8335ed47-81fa-4cb9-a737-6e1c72b833b8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:19.891029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8335ed47-81fa-4cb9-a737-6e1c72b833b8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:19.898007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8335ed47-81fa-4cb9-a737-6e1c72b833b8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:19.898478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8335ed47-81fa-4cb9-a737-6e1c72b833b8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:19.898904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8335ed47-81fa-4cb9-a737-6e1c72b833b8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:19.899611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8335ed47-81fa-4cb9-a737-6e1c72b833b8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:19.900057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8335ed47-81fa-4cb9-a737-6e1c72b833b8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:19.900471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8335ed47-81fa-4cb9-a737-6e1c72b833b8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:20.029296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8335ed47-81fa-4cb9-a737-6e1c72b833b8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:20.038244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8335ed47-81fa-4cb9-a737-6e1c72b833b8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151623 Aug 31 00:48:20.038805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1054/2040] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:19 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:20.145141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-84ac72ab-3471-4532-ad33-c32d3385172a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:20.145697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-84ac72ab-3471-4532-ad33-c32d3385172a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:20.152745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ac72ab-3471-4532-ad33-c32d3385172a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:20.153213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ac72ab-3471-4532-ad33-c32d3385172a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:20.153639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ac72ab-3471-4532-ad33-c32d3385172a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:20.154313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ac72ab-3471-4532-ad33-c32d3385172a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:20.154751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ac72ab-3471-4532-ad33-c32d3385172a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:20.155191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84ac72ab-3471-4532-ad33-c32d3385172a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:20.221827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-84ac72ab-3471-4532-ad33-c32d3385172a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:20.230571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-84ac72ab-3471-4532-ad33-c32d3385172a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089293 Aug 31 00:48:20.231171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 987/2041] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:20 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:21.059541 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-45e84ce4-9edd-4da6-8eb6-7b4e59239622 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:21.060152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-45e84ce4-9edd-4da6-8eb6-7b4e59239622 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:21.066137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45e84ce4-9edd-4da6-8eb6-7b4e59239622 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:21.066622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45e84ce4-9edd-4da6-8eb6-7b4e59239622 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:21.067083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45e84ce4-9edd-4da6-8eb6-7b4e59239622 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:21.067806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45e84ce4-9edd-4da6-8eb6-7b4e59239622 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:21.068269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45e84ce4-9edd-4da6-8eb6-7b4e59239622 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:21.068850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45e84ce4-9edd-4da6-8eb6-7b4e59239622 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:21.195683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-45e84ce4-9edd-4da6-8eb6-7b4e59239622 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:21.203783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-45e84ce4-9edd-4da6-8eb6-7b4e59239622 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.148249 Aug 31 00:48:21.204345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1055/2042] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:21 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:21.252379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-43d359e9-081f-4d1f-bbbd-1d8dc2989f04 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:21.252923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-43d359e9-081f-4d1f-bbbd-1d8dc2989f04 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:21.259286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43d359e9-081f-4d1f-bbbd-1d8dc2989f04 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:21.259763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43d359e9-081f-4d1f-bbbd-1d8dc2989f04 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:21.260191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43d359e9-081f-4d1f-bbbd-1d8dc2989f04 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:21.260869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43d359e9-081f-4d1f-bbbd-1d8dc2989f04 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:21.261345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43d359e9-081f-4d1f-bbbd-1d8dc2989f04 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:21.261761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43d359e9-081f-4d1f-bbbd-1d8dc2989f04 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:21.264324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:21.324074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-43d359e9-081f-4d1f-bbbd-1d8dc2989f04 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:21.332082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-43d359e9-081f-4d1f-bbbd-1d8dc2989f04 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083672 Aug 31 00:48:21.332639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 988/2043] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:21 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:22.223726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0b4dd1cf-a0da-4150-87d7-887380ce128f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:22.224395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0b4dd1cf-a0da-4150-87d7-887380ce128f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:22.230739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b4dd1cf-a0da-4150-87d7-887380ce128f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:22.231253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b4dd1cf-a0da-4150-87d7-887380ce128f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:22.231683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b4dd1cf-a0da-4150-87d7-887380ce128f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:22.232357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b4dd1cf-a0da-4150-87d7-887380ce128f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:22.232798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b4dd1cf-a0da-4150-87d7-887380ce128f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:22.233211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b4dd1cf-a0da-4150-87d7-887380ce128f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:22.355193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-119610a1-8bf8-4153-8897-0473e1c30ce8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:22.355807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-119610a1-8bf8-4153-8897-0473e1c30ce8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:22.362619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119610a1-8bf8-4153-8897-0473e1c30ce8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:22.363131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119610a1-8bf8-4153-8897-0473e1c30ce8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:22.364083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119610a1-8bf8-4153-8897-0473e1c30ce8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:22.364277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119610a1-8bf8-4153-8897-0473e1c30ce8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:22.364893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119610a1-8bf8-4153-8897-0473e1c30ce8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:22.365317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119610a1-8bf8-4153-8897-0473e1c30ce8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:22.366525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0b4dd1cf-a0da-4150-87d7-887380ce128f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:22.368758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:22.376303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0b4dd1cf-a0da-4150-87d7-887380ce128f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156293 Aug 31 00:48:22.376847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1056/2044] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:22 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:22.428603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-119610a1-8bf8-4153-8897-0473e1c30ce8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:22.436752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-119610a1-8bf8-4153-8897-0473e1c30ce8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085505 Aug 31 00:48:22.437307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 989/2045] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:22 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:23.398208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-38c17307-2da4-411b-9f62-10076eb29c67 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:23.398843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-38c17307-2da4-411b-9f62-10076eb29c67 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:23.405241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c17307-2da4-411b-9f62-10076eb29c67 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:23.405717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c17307-2da4-411b-9f62-10076eb29c67 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:23.406145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c17307-2da4-411b-9f62-10076eb29c67 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:23.406827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c17307-2da4-411b-9f62-10076eb29c67 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:23.407303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c17307-2da4-411b-9f62-10076eb29c67 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:23.407722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-38c17307-2da4-411b-9f62-10076eb29c67 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:23.457696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6f27c71e-b6f6-47fa-a319-12fecca51b47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:23.458457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6f27c71e-b6f6-47fa-a319-12fecca51b47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:23.465106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f27c71e-b6f6-47fa-a319-12fecca51b47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:23.465662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f27c71e-b6f6-47fa-a319-12fecca51b47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:23.466173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f27c71e-b6f6-47fa-a319-12fecca51b47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:23.466929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f27c71e-b6f6-47fa-a319-12fecca51b47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:23.467495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f27c71e-b6f6-47fa-a319-12fecca51b47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:23.468061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f27c71e-b6f6-47fa-a319-12fecca51b47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:23.540976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6f27c71e-b6f6-47fa-a319-12fecca51b47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:23.549263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6f27c71e-b6f6-47fa-a319-12fecca51b47 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.095347 Aug 31 00:48:23.549834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 990/2046] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:23 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:23.563855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-38c17307-2da4-411b-9f62-10076eb29c67 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:23.575506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-38c17307-2da4-411b-9f62-10076eb29c67 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.181333 Aug 31 00:48:23.576484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1057/2047] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:23 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:24.571903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8dcc24dc-ce98-40b3-a4d0-a90a8264ba5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:24.572494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8dcc24dc-ce98-40b3-a4d0-a90a8264ba5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:24.578988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dcc24dc-ce98-40b3-a4d0-a90a8264ba5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:24.579494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dcc24dc-ce98-40b3-a4d0-a90a8264ba5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:24.579923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dcc24dc-ce98-40b3-a4d0-a90a8264ba5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:24.580601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dcc24dc-ce98-40b3-a4d0-a90a8264ba5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:24.581049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dcc24dc-ce98-40b3-a4d0-a90a8264ba5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:24.581466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dcc24dc-ce98-40b3-a4d0-a90a8264ba5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:24.597767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5e5874da-1edb-4eb1-b5d7-d625567f5782 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:24.598380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5e5874da-1edb-4eb1-b5d7-d625567f5782 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:24.604848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e5874da-1edb-4eb1-b5d7-d625567f5782 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:24.605340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e5874da-1edb-4eb1-b5d7-d625567f5782 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:24.605772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e5874da-1edb-4eb1-b5d7-d625567f5782 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:24.606461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e5874da-1edb-4eb1-b5d7-d625567f5782 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:24.606915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e5874da-1edb-4eb1-b5d7-d625567f5782 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:24.607364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e5874da-1edb-4eb1-b5d7-d625567f5782 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:24.648669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8dcc24dc-ce98-40b3-a4d0-a90a8264ba5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:24.658262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8dcc24dc-ce98-40b3-a4d0-a90a8264ba5f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090947 Aug 31 00:48:24.658843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 991/2048] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:24 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:24.744457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5e5874da-1edb-4eb1-b5d7-d625567f5782 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:24.752813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5e5874da-1edb-4eb1-b5d7-d625567f5782 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159048 Aug 31 00:48:24.753374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1058/2049] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:24 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:25.684047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9d7a5977-2b11-40d7-8508-f1b74752464a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:25.684725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9d7a5977-2b11-40d7-8508-f1b74752464a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:25.694205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d7a5977-2b11-40d7-8508-f1b74752464a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:25.694684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d7a5977-2b11-40d7-8508-f1b74752464a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:25.695141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d7a5977-2b11-40d7-8508-f1b74752464a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:25.695837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d7a5977-2b11-40d7-8508-f1b74752464a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:25.696284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d7a5977-2b11-40d7-8508-f1b74752464a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:25.696704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d7a5977-2b11-40d7-8508-f1b74752464a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:25.771446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9d7a5977-2b11-40d7-8508-f1b74752464a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:25.775272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-543eb55f-87cc-468a-928f-8df5ab6e2247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:25.775891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-543eb55f-87cc-468a-928f-8df5ab6e2247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:25.781155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9d7a5977-2b11-40d7-8508-f1b74752464a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.100912 Aug 31 00:48:25.782559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 992/2050] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:25 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:25.783743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-543eb55f-87cc-468a-928f-8df5ab6e2247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:25.784259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-543eb55f-87cc-468a-928f-8df5ab6e2247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:25.784726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-543eb55f-87cc-468a-928f-8df5ab6e2247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:25.785432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-543eb55f-87cc-468a-928f-8df5ab6e2247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:25.786250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-543eb55f-87cc-468a-928f-8df5ab6e2247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:25.787594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-543eb55f-87cc-468a-928f-8df5ab6e2247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:25.937031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-543eb55f-87cc-468a-928f-8df5ab6e2247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:25.948977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-543eb55f-87cc-468a-928f-8df5ab6e2247 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.178517 Aug 31 00:48:25.949553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1059/2051] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:25 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:26.805245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c2970887-8195-48b6-a449-d85d46ca600f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:26.805852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c2970887-8195-48b6-a449-d85d46ca600f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:26.812337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2970887-8195-48b6-a449-d85d46ca600f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:26.812821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2970887-8195-48b6-a449-d85d46ca600f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:26.813254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2970887-8195-48b6-a449-d85d46ca600f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:26.813942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2970887-8195-48b6-a449-d85d46ca600f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:26.814395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2970887-8195-48b6-a449-d85d46ca600f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:26.814822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2970887-8195-48b6-a449-d85d46ca600f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:26.877197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c2970887-8195-48b6-a449-d85d46ca600f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:26.887054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c2970887-8195-48b6-a449-d85d46ca600f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086082 Aug 31 00:48:26.887626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 993/2052] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:26 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:26.974964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a090a09e-5914-45b8-89d9-215e93842211 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:26.975586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a090a09e-5914-45b8-89d9-215e93842211 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:26.981919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a090a09e-5914-45b8-89d9-215e93842211 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:26.982392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a090a09e-5914-45b8-89d9-215e93842211 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:26.982819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a090a09e-5914-45b8-89d9-215e93842211 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:26.983532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a090a09e-5914-45b8-89d9-215e93842211 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:26.984233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a090a09e-5914-45b8-89d9-215e93842211 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:26.984647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a090a09e-5914-45b8-89d9-215e93842211 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:27.116773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a090a09e-5914-45b8-89d9-215e93842211 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:27.125046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a090a09e-5914-45b8-89d9-215e93842211 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154091 Aug 31 00:48:27.125804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1060/2053] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:26 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:27.909232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f38980f9-a868-4558-b477-794d27faebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:27.909842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f38980f9-a868-4558-b477-794d27faebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:27.916874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f38980f9-a868-4558-b477-794d27faebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:27.917347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f38980f9-a868-4558-b477-794d27faebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:27.917773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f38980f9-a868-4558-b477-794d27faebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:27.918446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f38980f9-a868-4558-b477-794d27faebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:27.918889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f38980f9-a868-4558-b477-794d27faebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:27.919334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f38980f9-a868-4558-b477-794d27faebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:28.148384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e377c287-1f77-4060-9bee-e9221e4b60f6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:28.149111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e377c287-1f77-4060-9bee-e9221e4b60f6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:28.156076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e377c287-1f77-4060-9bee-e9221e4b60f6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:28.156569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e377c287-1f77-4060-9bee-e9221e4b60f6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:28.157015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e377c287-1f77-4060-9bee-e9221e4b60f6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:28.157745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e377c287-1f77-4060-9bee-e9221e4b60f6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:28.158202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e377c287-1f77-4060-9bee-e9221e4b60f6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:28.158802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e377c287-1f77-4060-9bee-e9221e4b60f6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:28.225901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f38980f9-a868-4558-b477-794d27faebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:28.234585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f38980f9-a868-4558-b477-794d27faebae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.329135 Aug 31 00:48:28.235200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 994/2054] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:27 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:28.317240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e377c287-1f77-4060-9bee-e9221e4b60f6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:28.326638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e377c287-1f77-4060-9bee-e9221e4b60f6 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.182649 Aug 31 00:48:28.327255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1061/2055] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:28 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:29.255426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dbff87d9-0ff0-454e-ab02-5597f409c2a0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:29.256029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dbff87d9-0ff0-454e-ab02-5597f409c2a0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:29.262399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbff87d9-0ff0-454e-ab02-5597f409c2a0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:29.262874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbff87d9-0ff0-454e-ab02-5597f409c2a0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:29.263337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbff87d9-0ff0-454e-ab02-5597f409c2a0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:29.264017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbff87d9-0ff0-454e-ab02-5597f409c2a0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:29.264465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbff87d9-0ff0-454e-ab02-5597f409c2a0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:29.264886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dbff87d9-0ff0-454e-ab02-5597f409c2a0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:29.326691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dbff87d9-0ff0-454e-ab02-5597f409c2a0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:29.334906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dbff87d9-0ff0-454e-ab02-5597f409c2a0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083357 Aug 31 00:48:29.335504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 995/2056] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:29 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:29.349230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-52e9c1d4-7e5f-4eaf-a4fb-5d3a94798026 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:29.350076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-52e9c1d4-7e5f-4eaf-a4fb-5d3a94798026 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:29.356484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52e9c1d4-7e5f-4eaf-a4fb-5d3a94798026 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:29.356968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52e9c1d4-7e5f-4eaf-a4fb-5d3a94798026 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:29.357400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52e9c1d4-7e5f-4eaf-a4fb-5d3a94798026 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:29.358091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52e9c1d4-7e5f-4eaf-a4fb-5d3a94798026 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:29.358545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52e9c1d4-7e5f-4eaf-a4fb-5d3a94798026 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:29.359258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52e9c1d4-7e5f-4eaf-a4fb-5d3a94798026 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:29.488137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-52e9c1d4-7e5f-4eaf-a4fb-5d3a94798026 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:29.496810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-52e9c1d4-7e5f-4eaf-a4fb-5d3a94798026 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152085 Aug 31 00:48:29.497367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1062/2057] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:29 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:30.356540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d3dd086f-519c-4654-a0c8-09f1a5e3e9aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:30.357222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d3dd086f-519c-4654-a0c8-09f1a5e3e9aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:30.364645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3dd086f-519c-4654-a0c8-09f1a5e3e9aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:30.365453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3dd086f-519c-4654-a0c8-09f1a5e3e9aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:30.365895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3dd086f-519c-4654-a0c8-09f1a5e3e9aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:30.366591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3dd086f-519c-4654-a0c8-09f1a5e3e9aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:30.367053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3dd086f-519c-4654-a0c8-09f1a5e3e9aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:30.367495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d3dd086f-519c-4654-a0c8-09f1a5e3e9aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:30.430055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d3dd086f-519c-4654-a0c8-09f1a5e3e9aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:30.438225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d3dd086f-519c-4654-a0c8-09f1a5e3e9aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085906 Aug 31 00:48:30.438793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 996/2058] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:30 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:30.517472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0eee640d-22e2-4630-8604-1ce9d50b740e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:30.518076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0eee640d-22e2-4630-8604-1ce9d50b740e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:30.524682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eee640d-22e2-4630-8604-1ce9d50b740e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:30.525157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eee640d-22e2-4630-8604-1ce9d50b740e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:30.525588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eee640d-22e2-4630-8604-1ce9d50b740e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:30.526266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eee640d-22e2-4630-8604-1ce9d50b740e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:30.526717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eee640d-22e2-4630-8604-1ce9d50b740e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:30.527172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eee640d-22e2-4630-8604-1ce9d50b740e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:30.660229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0eee640d-22e2-4630-8604-1ce9d50b740e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:30.669214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0eee640d-22e2-4630-8604-1ce9d50b740e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155649 Aug 31 00:48:30.669779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1063/2059] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:30 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:31.461012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-67a4e92f-ff10-4e22-aed0-56c7edfd6e8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:31.461739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-67a4e92f-ff10-4e22-aed0-56c7edfd6e8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:31.468187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67a4e92f-ff10-4e22-aed0-56c7edfd6e8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:31.468668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67a4e92f-ff10-4e22-aed0-56c7edfd6e8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:31.469105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67a4e92f-ff10-4e22-aed0-56c7edfd6e8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:31.469798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67a4e92f-ff10-4e22-aed0-56c7edfd6e8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:31.470250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67a4e92f-ff10-4e22-aed0-56c7edfd6e8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:31.470670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67a4e92f-ff10-4e22-aed0-56c7edfd6e8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:31.536666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-67a4e92f-ff10-4e22-aed0-56c7edfd6e8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:31.544983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-67a4e92f-ff10-4e22-aed0-56c7edfd6e8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088510 Aug 31 00:48:31.545552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 997/2060] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:31 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:31.690386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0fd6b712-e6b2-42fb-a352-14d9da5be461 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:31.690957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0fd6b712-e6b2-42fb-a352-14d9da5be461 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:31.698063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fd6b712-e6b2-42fb-a352-14d9da5be461 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:31.698538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fd6b712-e6b2-42fb-a352-14d9da5be461 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:31.698964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fd6b712-e6b2-42fb-a352-14d9da5be461 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:31.699673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fd6b712-e6b2-42fb-a352-14d9da5be461 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:31.700114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fd6b712-e6b2-42fb-a352-14d9da5be461 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:31.700526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fd6b712-e6b2-42fb-a352-14d9da5be461 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:31.827502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0fd6b712-e6b2-42fb-a352-14d9da5be461 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:31.835621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0fd6b712-e6b2-42fb-a352-14d9da5be461 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149156 Aug 31 00:48:31.836178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1064/2061] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:31 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:32.565842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e923a0c8-0adf-440d-a1bf-482ff4d043fa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:32.566519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e923a0c8-0adf-440d-a1bf-482ff4d043fa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:32.573882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e923a0c8-0adf-440d-a1bf-482ff4d043fa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:32.574370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e923a0c8-0adf-440d-a1bf-482ff4d043fa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:32.574809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e923a0c8-0adf-440d-a1bf-482ff4d043fa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:32.575531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e923a0c8-0adf-440d-a1bf-482ff4d043fa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:32.575986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e923a0c8-0adf-440d-a1bf-482ff4d043fa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:32.576413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e923a0c8-0adf-440d-a1bf-482ff4d043fa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:32.639263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e923a0c8-0adf-440d-a1bf-482ff4d043fa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:32.647782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e923a0c8-0adf-440d-a1bf-482ff4d043fa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085887 Aug 31 00:48:32.648346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 998/2062] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:32 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:32.855814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a90943e9-a6a2-4e9e-89fa-eb792813b610 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:32.856415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a90943e9-a6a2-4e9e-89fa-eb792813b610 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:32.862986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a90943e9-a6a2-4e9e-89fa-eb792813b610 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:32.863487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a90943e9-a6a2-4e9e-89fa-eb792813b610 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:32.864557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a90943e9-a6a2-4e9e-89fa-eb792813b610 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:32.865290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a90943e9-a6a2-4e9e-89fa-eb792813b610 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:32.865739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a90943e9-a6a2-4e9e-89fa-eb792813b610 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:32.866157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a90943e9-a6a2-4e9e-89fa-eb792813b610 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:32.998652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a90943e9-a6a2-4e9e-89fa-eb792813b610 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:33.007124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a90943e9-a6a2-4e9e-89fa-eb792813b610 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155116 Aug 31 00:48:33.007687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1065/2063] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:32 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:33.668790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b5a72dc6-9756-4d55-96ed-19e369476565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:33.669391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b5a72dc6-9756-4d55-96ed-19e369476565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:33.675900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5a72dc6-9756-4d55-96ed-19e369476565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:33.676378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5a72dc6-9756-4d55-96ed-19e369476565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:33.676858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5a72dc6-9756-4d55-96ed-19e369476565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:33.677564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5a72dc6-9756-4d55-96ed-19e369476565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:33.678011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5a72dc6-9756-4d55-96ed-19e369476565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:33.678428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5a72dc6-9756-4d55-96ed-19e369476565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:33.739129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b5a72dc6-9756-4d55-96ed-19e369476565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:33.747272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b5a72dc6-9756-4d55-96ed-19e369476565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082281 Aug 31 00:48:33.747833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 999/2064] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:33 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:34.028116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4d31de54-aede-46e6-8e1d-bb03e826547f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:34.028720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4d31de54-aede-46e6-8e1d-bb03e826547f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:34.035334 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d31de54-aede-46e6-8e1d-bb03e826547f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:34.035889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d31de54-aede-46e6-8e1d-bb03e826547f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:34.036328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d31de54-aede-46e6-8e1d-bb03e826547f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:34.037011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d31de54-aede-46e6-8e1d-bb03e826547f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:34.037464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d31de54-aede-46e6-8e1d-bb03e826547f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:34.037886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4d31de54-aede-46e6-8e1d-bb03e826547f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:34.166653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4d31de54-aede-46e6-8e1d-bb03e826547f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:34.175302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4d31de54-aede-46e6-8e1d-bb03e826547f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151060 Aug 31 00:48:34.175867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1066/2065] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:34 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:34.768793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9e842f60-ca24-4f30-bd49-98e92b910b9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:34.769390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9e842f60-ca24-4f30-bd49-98e92b910b9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:34.776391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e842f60-ca24-4f30-bd49-98e92b910b9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:34.776873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e842f60-ca24-4f30-bd49-98e92b910b9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:34.777284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e842f60-ca24-4f30-bd49-98e92b910b9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:34.777955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e842f60-ca24-4f30-bd49-98e92b910b9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:34.778419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e842f60-ca24-4f30-bd49-98e92b910b9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:34.778836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e842f60-ca24-4f30-bd49-98e92b910b9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:34.845414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9e842f60-ca24-4f30-bd49-98e92b910b9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:34.854147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9e842f60-ca24-4f30-bd49-98e92b910b9e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089191 Aug 31 00:48:34.854702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1000/2066] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:35.198630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c7f2dd42-9cff-4fa4-8fbb-ef17f4eb4999 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:35.199261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c7f2dd42-9cff-4fa4-8fbb-ef17f4eb4999 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:35.205577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7f2dd42-9cff-4fa4-8fbb-ef17f4eb4999 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:35.206042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7f2dd42-9cff-4fa4-8fbb-ef17f4eb4999 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:35.206463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7f2dd42-9cff-4fa4-8fbb-ef17f4eb4999 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:35.207154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7f2dd42-9cff-4fa4-8fbb-ef17f4eb4999 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:35.208209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7f2dd42-9cff-4fa4-8fbb-ef17f4eb4999 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:35.208601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7f2dd42-9cff-4fa4-8fbb-ef17f4eb4999 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:35.341913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c7f2dd42-9cff-4fa4-8fbb-ef17f4eb4999 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:35.350670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c7f2dd42-9cff-4fa4-8fbb-ef17f4eb4999 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155929 Aug 31 00:48:35.351275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1067/2067] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:35 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:35.876104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a265ef63-839e-41fc-a454-0093f2509239 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:35.876769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a265ef63-839e-41fc-a454-0093f2509239 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:35.878997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=54 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:35.884798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a265ef63-839e-41fc-a454-0093f2509239 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:35.885272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a265ef63-839e-41fc-a454-0093f2509239 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:35.885704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a265ef63-839e-41fc-a454-0093f2509239 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:35.886382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a265ef63-839e-41fc-a454-0093f2509239 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:35.886830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a265ef63-839e-41fc-a454-0093f2509239 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:35.887291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a265ef63-839e-41fc-a454-0093f2509239 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:35.947730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a265ef63-839e-41fc-a454-0093f2509239 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:35.956198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a265ef63-839e-41fc-a454-0093f2509239 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084019 Aug 31 00:48:35.956758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1001/2068] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:35 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:36.372424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2a549de1-20e5-45b7-a1cb-3a547d59fee0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:36.373072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2a549de1-20e5-45b7-a1cb-3a547d59fee0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:36.380290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a549de1-20e5-45b7-a1cb-3a547d59fee0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:36.380907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a549de1-20e5-45b7-a1cb-3a547d59fee0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:36.381334 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a549de1-20e5-45b7-a1cb-3a547d59fee0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:36.382035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a549de1-20e5-45b7-a1cb-3a547d59fee0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:36.382483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a549de1-20e5-45b7-a1cb-3a547d59fee0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:36.382904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a549de1-20e5-45b7-a1cb-3a547d59fee0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:36.512314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2a549de1-20e5-45b7-a1cb-3a547d59fee0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:36.520561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2a549de1-20e5-45b7-a1cb-3a547d59fee0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152036 Aug 31 00:48:36.521137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1068/2069] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:36 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:36.978252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-20ea28a8-3289-4353-ae0c-c0ca585740aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:36.978887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-20ea28a8-3289-4353-ae0c-c0ca585740aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:36.985647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20ea28a8-3289-4353-ae0c-c0ca585740aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:36.986127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20ea28a8-3289-4353-ae0c-c0ca585740aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:36.986581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20ea28a8-3289-4353-ae0c-c0ca585740aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:36.987287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20ea28a8-3289-4353-ae0c-c0ca585740aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:36.987942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20ea28a8-3289-4353-ae0c-c0ca585740aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:36.988376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20ea28a8-3289-4353-ae0c-c0ca585740aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:37.049893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-20ea28a8-3289-4353-ae0c-c0ca585740aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:37.058684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-20ea28a8-3289-4353-ae0c-c0ca585740aa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084331 Aug 31 00:48:37.059263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1002/2070] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:36 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:37.541773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-45002dff-423b-4920-bb59-8cf792f6bed2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:37.542367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-45002dff-423b-4920-bb59-8cf792f6bed2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:37.548959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45002dff-423b-4920-bb59-8cf792f6bed2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:37.549433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45002dff-423b-4920-bb59-8cf792f6bed2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:37.549858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45002dff-423b-4920-bb59-8cf792f6bed2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:37.550532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45002dff-423b-4920-bb59-8cf792f6bed2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:37.551622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45002dff-423b-4920-bb59-8cf792f6bed2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:37.552261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45002dff-423b-4920-bb59-8cf792f6bed2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:37.688239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-45002dff-423b-4920-bb59-8cf792f6bed2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:37.697143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-45002dff-423b-4920-bb59-8cf792f6bed2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159376 Aug 31 00:48:37.697711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1069/2071] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:37 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:38.080725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4c963603-3948-438e-a7db-ce3f235d2fe8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:38.081362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4c963603-3948-438e-a7db-ce3f235d2fe8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:38.088624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c963603-3948-438e-a7db-ce3f235d2fe8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:38.089111 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c963603-3948-438e-a7db-ce3f235d2fe8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:38.089547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c963603-3948-438e-a7db-ce3f235d2fe8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:38.090240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c963603-3948-438e-a7db-ce3f235d2fe8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:38.090693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c963603-3948-438e-a7db-ce3f235d2fe8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:38.091151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c963603-3948-438e-a7db-ce3f235d2fe8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:38.157343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4c963603-3948-438e-a7db-ce3f235d2fe8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:38.166148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4c963603-3948-438e-a7db-ce3f235d2fe8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089126 Aug 31 00:48:38.166714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1003/2072] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:38 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:38.717788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-35f5a0e5-92a8-4a4b-96a3-e4badb86dfe8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:38.718360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-35f5a0e5-92a8-4a4b-96a3-e4badb86dfe8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:38.727554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f5a0e5-92a8-4a4b-96a3-e4badb86dfe8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:38.730447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f5a0e5-92a8-4a4b-96a3-e4badb86dfe8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:38.730895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f5a0e5-92a8-4a4b-96a3-e4badb86dfe8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:38.731620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f5a0e5-92a8-4a4b-96a3-e4badb86dfe8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:38.732072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f5a0e5-92a8-4a4b-96a3-e4badb86dfe8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:38.732694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f5a0e5-92a8-4a4b-96a3-e4badb86dfe8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:38.863805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-35f5a0e5-92a8-4a4b-96a3-e4badb86dfe8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:38.871976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-35f5a0e5-92a8-4a4b-96a3-e4badb86dfe8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.158179 Aug 31 00:48:38.872537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1070/2073] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:38 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:39.186725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-728b728d-1f43-490b-9765-786c0a9ec49d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:39.187435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-728b728d-1f43-490b-9765-786c0a9ec49d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:39.193361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-728b728d-1f43-490b-9765-786c0a9ec49d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:39.193838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-728b728d-1f43-490b-9765-786c0a9ec49d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:39.194270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-728b728d-1f43-490b-9765-786c0a9ec49d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:39.194955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-728b728d-1f43-490b-9765-786c0a9ec49d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:39.195429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-728b728d-1f43-490b-9765-786c0a9ec49d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:39.195849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-728b728d-1f43-490b-9765-786c0a9ec49d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:39.257313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-728b728d-1f43-490b-9765-786c0a9ec49d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:39.259521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:39.266952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-728b728d-1f43-490b-9765-786c0a9ec49d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084245 Aug 31 00:48:39.267549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1004/2074] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:39 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:39.893841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bfa9c606-8a20-4206-b6c5-846dfd0d6834 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:39.894525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bfa9c606-8a20-4206-b6c5-846dfd0d6834 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:39.897414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:39.902737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfa9c606-8a20-4206-b6c5-846dfd0d6834 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:39.903242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfa9c606-8a20-4206-b6c5-846dfd0d6834 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:39.903673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfa9c606-8a20-4206-b6c5-846dfd0d6834 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:39.904350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfa9c606-8a20-4206-b6c5-846dfd0d6834 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:39.904796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfa9c606-8a20-4206-b6c5-846dfd0d6834 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:39.905214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfa9c606-8a20-4206-b6c5-846dfd0d6834 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:40.036955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bfa9c606-8a20-4206-b6c5-846dfd0d6834 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:40.045195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bfa9c606-8a20-4206-b6c5-846dfd0d6834 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155257 Aug 31 00:48:40.045756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1071/2075] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:39 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:40.287829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e7e6f19-591a-47a3-aa05-7b47e72ed44c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:40.288383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7e7e6f19-591a-47a3-aa05-7b47e72ed44c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:40.294740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e7e6f19-591a-47a3-aa05-7b47e72ed44c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:40.295254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e7e6f19-591a-47a3-aa05-7b47e72ed44c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:40.295682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e7e6f19-591a-47a3-aa05-7b47e72ed44c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:40.296360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e7e6f19-591a-47a3-aa05-7b47e72ed44c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:40.296803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e7e6f19-591a-47a3-aa05-7b47e72ed44c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:40.297214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e7e6f19-591a-47a3-aa05-7b47e72ed44c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:40.369916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7e7e6f19-591a-47a3-aa05-7b47e72ed44c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:40.378262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7e7e6f19-591a-47a3-aa05-7b47e72ed44c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.094344 Aug 31 00:48:40.378942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1005/2076] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:40 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:41.067067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d43c391d-e06c-421e-9396-4b6f98e672ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:41.067695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d43c391d-e06c-421e-9396-4b6f98e672ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:41.074005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d43c391d-e06c-421e-9396-4b6f98e672ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:41.074480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d43c391d-e06c-421e-9396-4b6f98e672ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:41.074907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d43c391d-e06c-421e-9396-4b6f98e672ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:41.075681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d43c391d-e06c-421e-9396-4b6f98e672ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:41.076125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d43c391d-e06c-421e-9396-4b6f98e672ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:41.076540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d43c391d-e06c-421e-9396-4b6f98e672ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:41.214400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d43c391d-e06c-421e-9396-4b6f98e672ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:41.222515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d43c391d-e06c-421e-9396-4b6f98e672ad tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.159428 Aug 31 00:48:41.223055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1072/2077] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:41 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:41.400369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9de18cc5-32c0-48c4-99c9-14ac319cc8b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:41.400975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9de18cc5-32c0-48c4-99c9-14ac319cc8b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:41.407374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9de18cc5-32c0-48c4-99c9-14ac319cc8b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:41.407854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9de18cc5-32c0-48c4-99c9-14ac319cc8b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:41.408285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9de18cc5-32c0-48c4-99c9-14ac319cc8b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:41.408963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9de18cc5-32c0-48c4-99c9-14ac319cc8b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:41.409434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9de18cc5-32c0-48c4-99c9-14ac319cc8b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:41.409853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9de18cc5-32c0-48c4-99c9-14ac319cc8b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:41.474730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9de18cc5-32c0-48c4-99c9-14ac319cc8b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:41.483018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9de18cc5-32c0-48c4-99c9-14ac319cc8b3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086504 Aug 31 00:48:41.483868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1006/2078] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:41 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:42.244519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9f8d3d40-5d0f-477f-8c6c-9fc327f29d23 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:42.245181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9f8d3d40-5d0f-477f-8c6c-9fc327f29d23 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:42.251706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f8d3d40-5d0f-477f-8c6c-9fc327f29d23 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:42.252187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f8d3d40-5d0f-477f-8c6c-9fc327f29d23 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:42.252618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f8d3d40-5d0f-477f-8c6c-9fc327f29d23 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:42.253303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f8d3d40-5d0f-477f-8c6c-9fc327f29d23 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:42.253847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f8d3d40-5d0f-477f-8c6c-9fc327f29d23 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:42.254278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f8d3d40-5d0f-477f-8c6c-9fc327f29d23 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:42.271699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:42.383993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9f8d3d40-5d0f-477f-8c6c-9fc327f29d23 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:42.392433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9f8d3d40-5d0f-477f-8c6c-9fc327f29d23 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151829 Aug 31 00:48:42.393001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1073/2079] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:42 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:42.505286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ef902d9a-2ff7-4879-9c56-bd9b8696800f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:42.505844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ef902d9a-2ff7-4879-9c56-bd9b8696800f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:42.512235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef902d9a-2ff7-4879-9c56-bd9b8696800f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:42.512716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef902d9a-2ff7-4879-9c56-bd9b8696800f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:42.513155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef902d9a-2ff7-4879-9c56-bd9b8696800f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:42.514067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef902d9a-2ff7-4879-9c56-bd9b8696800f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:42.514373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef902d9a-2ff7-4879-9c56-bd9b8696800f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:42.514800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef902d9a-2ff7-4879-9c56-bd9b8696800f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:42.577858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ef902d9a-2ff7-4879-9c56-bd9b8696800f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:42.586542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ef902d9a-2ff7-4879-9c56-bd9b8696800f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085374 Aug 31 00:48:42.587128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1007/2080] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:42 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:43.415382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-45f794f9-6540-4317-a6fb-46235c403d85 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:43.416030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-45f794f9-6540-4317-a6fb-46235c403d85 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:43.422357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f794f9-6540-4317-a6fb-46235c403d85 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:43.422836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f794f9-6540-4317-a6fb-46235c403d85 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:43.423300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f794f9-6540-4317-a6fb-46235c403d85 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:43.423971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f794f9-6540-4317-a6fb-46235c403d85 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:43.424412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f794f9-6540-4317-a6fb-46235c403d85 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:43.424822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45f794f9-6540-4317-a6fb-46235c403d85 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:43.557788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-45f794f9-6540-4317-a6fb-46235c403d85 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:43.565996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-45f794f9-6540-4317-a6fb-46235c403d85 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154456 Aug 31 00:48:43.566592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1074/2081] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:43 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:43.608549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f7788e45-d337-4837-aa23-51f04badc37f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:43.609154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f7788e45-d337-4837-aa23-51f04badc37f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:43.616221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7788e45-d337-4837-aa23-51f04badc37f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:43.616700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7788e45-d337-4837-aa23-51f04badc37f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:43.617134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7788e45-d337-4837-aa23-51f04badc37f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:43.617817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7788e45-d337-4837-aa23-51f04badc37f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:43.618267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7788e45-d337-4837-aa23-51f04badc37f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:43.618688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7788e45-d337-4837-aa23-51f04badc37f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:43.680139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f7788e45-d337-4837-aa23-51f04badc37f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:43.688176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f7788e45-d337-4837-aa23-51f04badc37f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083843 Aug 31 00:48:43.688737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1008/2082] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:43 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:44.588052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-16b0ab65-3940-4b9b-971f-b241df475780 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:44.588693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-16b0ab65-3940-4b9b-971f-b241df475780 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:44.594992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-16b0ab65-3940-4b9b-971f-b241df475780 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:44.595500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-16b0ab65-3940-4b9b-971f-b241df475780 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:44.595927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-16b0ab65-3940-4b9b-971f-b241df475780 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:44.596604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-16b0ab65-3940-4b9b-971f-b241df475780 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:44.597050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-16b0ab65-3940-4b9b-971f-b241df475780 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:44.597488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-16b0ab65-3940-4b9b-971f-b241df475780 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:44.708780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ade95774-bf80-4791-bbc6-7b0814f07ee5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:44.709370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ade95774-bf80-4791-bbc6-7b0814f07ee5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:44.716008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ade95774-bf80-4791-bbc6-7b0814f07ee5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:44.716488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ade95774-bf80-4791-bbc6-7b0814f07ee5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:44.716919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ade95774-bf80-4791-bbc6-7b0814f07ee5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:44.717601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ade95774-bf80-4791-bbc6-7b0814f07ee5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:44.718047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ade95774-bf80-4791-bbc6-7b0814f07ee5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:44.718462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ade95774-bf80-4791-bbc6-7b0814f07ee5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:44.725176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-16b0ab65-3940-4b9b-971f-b241df475780 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:44.733575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-16b0ab65-3940-4b9b-971f-b241df475780 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149106 Aug 31 00:48:44.734156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1075/2083] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:44 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:44.783439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ade95774-bf80-4791-bbc6-7b0814f07ee5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:44.791760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ade95774-bf80-4791-bbc6-7b0814f07ee5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086858 Aug 31 00:48:44.792373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1009/2084] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:44 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:45.756634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a2bce7f7-2cf6-4e8e-81a8-de840bbf5dd7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:45.757230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a2bce7f7-2cf6-4e8e-81a8-de840bbf5dd7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:45.764132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2bce7f7-2cf6-4e8e-81a8-de840bbf5dd7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:45.764620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2bce7f7-2cf6-4e8e-81a8-de840bbf5dd7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:45.765056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2bce7f7-2cf6-4e8e-81a8-de840bbf5dd7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:45.765751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2bce7f7-2cf6-4e8e-81a8-de840bbf5dd7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:45.766204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2bce7f7-2cf6-4e8e-81a8-de840bbf5dd7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:45.766628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2bce7f7-2cf6-4e8e-81a8-de840bbf5dd7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:45.813423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e08ca0a3-31be-4fd0-b904-c6727ed45db5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:45.814023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e08ca0a3-31be-4fd0-b904-c6727ed45db5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:45.820976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08ca0a3-31be-4fd0-b904-c6727ed45db5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:45.821452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08ca0a3-31be-4fd0-b904-c6727ed45db5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:45.821877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08ca0a3-31be-4fd0-b904-c6727ed45db5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:45.822557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08ca0a3-31be-4fd0-b904-c6727ed45db5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:45.823325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08ca0a3-31be-4fd0-b904-c6727ed45db5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:45.823742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e08ca0a3-31be-4fd0-b904-c6727ed45db5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:45.898537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e08ca0a3-31be-4fd0-b904-c6727ed45db5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:45.906621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e08ca0a3-31be-4fd0-b904-c6727ed45db5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.097085 Aug 31 00:48:45.907213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1010/2085] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:45 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:45.919582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a2bce7f7-2cf6-4e8e-81a8-de840bbf5dd7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:45.928119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a2bce7f7-2cf6-4e8e-81a8-de840bbf5dd7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.176926 Aug 31 00:48:45.928671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1076/2086] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:45 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:46.929808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bf852455-7ce9-4a82-b812-06acced6f8eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:46.930623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bf852455-7ce9-4a82-b812-06acced6f8eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:46.937935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf852455-7ce9-4a82-b812-06acced6f8eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:46.938410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf852455-7ce9-4a82-b812-06acced6f8eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:46.938840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf852455-7ce9-4a82-b812-06acced6f8eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:46.939548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf852455-7ce9-4a82-b812-06acced6f8eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:46.939996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf852455-7ce9-4a82-b812-06acced6f8eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:46.940415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf852455-7ce9-4a82-b812-06acced6f8eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:46.949015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fc1ec981-da95-4633-9aa7-aa6e9b35810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:46.949712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fc1ec981-da95-4633-9aa7-aa6e9b35810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:46.956103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc1ec981-da95-4633-9aa7-aa6e9b35810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:46.957108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc1ec981-da95-4633-9aa7-aa6e9b35810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:46.957686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc1ec981-da95-4633-9aa7-aa6e9b35810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:46.958605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc1ec981-da95-4633-9aa7-aa6e9b35810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:46.959107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc1ec981-da95-4633-9aa7-aa6e9b35810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:46.959547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc1ec981-da95-4633-9aa7-aa6e9b35810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:47.017783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bf852455-7ce9-4a82-b812-06acced6f8eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:47.026441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bf852455-7ce9-4a82-b812-06acced6f8eb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.101219 Aug 31 00:48:47.026985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1011/2087] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:46 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:47.109944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fc1ec981-da95-4633-9aa7-aa6e9b35810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:47.118138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fc1ec981-da95-4633-9aa7-aa6e9b35810a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.173018 Aug 31 00:48:47.118700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1077/2088] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:46 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:48.048635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be7aaff0-40e0-4d9c-9379-aeb1f8a34d15 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:48.049243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-be7aaff0-40e0-4d9c-9379-aeb1f8a34d15 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:48.056474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7aaff0-40e0-4d9c-9379-aeb1f8a34d15 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:48.056955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7aaff0-40e0-4d9c-9379-aeb1f8a34d15 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:48.057390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7aaff0-40e0-4d9c-9379-aeb1f8a34d15 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:48.058077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7aaff0-40e0-4d9c-9379-aeb1f8a34d15 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:48.058529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7aaff0-40e0-4d9c-9379-aeb1f8a34d15 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:48.058950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7aaff0-40e0-4d9c-9379-aeb1f8a34d15 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:48.120526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be7aaff0-40e0-4d9c-9379-aeb1f8a34d15 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:48.128861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-be7aaff0-40e0-4d9c-9379-aeb1f8a34d15 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083927 Aug 31 00:48:48.129568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1012/2089] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:48 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:48.138719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f2a0832f-b149-478a-b60e-33d48f9e9c89 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:48.139350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f2a0832f-b149-478a-b60e-33d48f9e9c89 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:48.146008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2a0832f-b149-478a-b60e-33d48f9e9c89 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:48.146489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2a0832f-b149-478a-b60e-33d48f9e9c89 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:48.146918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2a0832f-b149-478a-b60e-33d48f9e9c89 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:48.147628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2a0832f-b149-478a-b60e-33d48f9e9c89 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:48.148079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2a0832f-b149-478a-b60e-33d48f9e9c89 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:48.148499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2a0832f-b149-478a-b60e-33d48f9e9c89 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:48.277251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f2a0832f-b149-478a-b60e-33d48f9e9c89 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:48.286195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f2a0832f-b149-478a-b60e-33d48f9e9c89 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151359 Aug 31 00:48:48.286759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1078/2090] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:48 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:49.149848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6ce69daa-4b2b-4c29-8706-41705ae4ac8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:49.150453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6ce69daa-4b2b-4c29-8706-41705ae4ac8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:49.156848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ce69daa-4b2b-4c29-8706-41705ae4ac8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:49.157318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ce69daa-4b2b-4c29-8706-41705ae4ac8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:49.157743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ce69daa-4b2b-4c29-8706-41705ae4ac8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:49.158422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ce69daa-4b2b-4c29-8706-41705ae4ac8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:49.158870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ce69daa-4b2b-4c29-8706-41705ae4ac8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:49.159318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ce69daa-4b2b-4c29-8706-41705ae4ac8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:49.223678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6ce69daa-4b2b-4c29-8706-41705ae4ac8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:49.232014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6ce69daa-4b2b-4c29-8706-41705ae4ac8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086246 Aug 31 00:48:49.232581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1013/2091] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:49 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:49.307602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-039d8615-51e6-468e-90e5-77a018f0a605 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:49.308124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-039d8615-51e6-468e-90e5-77a018f0a605 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:49.314635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-039d8615-51e6-468e-90e5-77a018f0a605 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:49.315147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-039d8615-51e6-468e-90e5-77a018f0a605 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:49.315575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-039d8615-51e6-468e-90e5-77a018f0a605 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:49.316245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-039d8615-51e6-468e-90e5-77a018f0a605 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:49.316697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-039d8615-51e6-468e-90e5-77a018f0a605 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:49.317715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-039d8615-51e6-468e-90e5-77a018f0a605 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:49.448500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-039d8615-51e6-468e-90e5-77a018f0a605 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:49.457727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-039d8615-51e6-468e-90e5-77a018f0a605 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153100 Aug 31 00:48:49.457727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1079/2092] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:49 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:50.254214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2ea89152-7776-4296-a2e0-6b89dd165dc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:50.255412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2ea89152-7776-4296-a2e0-6b89dd165dc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:50.261701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ea89152-7776-4296-a2e0-6b89dd165dc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:50.262172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ea89152-7776-4296-a2e0-6b89dd165dc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:50.262598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ea89152-7776-4296-a2e0-6b89dd165dc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:50.263311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ea89152-7776-4296-a2e0-6b89dd165dc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:50.264546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ea89152-7776-4296-a2e0-6b89dd165dc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:50.264546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ea89152-7776-4296-a2e0-6b89dd165dc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:50.327284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2ea89152-7776-4296-a2e0-6b89dd165dc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:50.336298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2ea89152-7776-4296-a2e0-6b89dd165dc7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085995 Aug 31 00:48:50.336853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1014/2093] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:50 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:50.478164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e979b72a-642b-4fa3-b1d0-41887b17dc5d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:50.478756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e979b72a-642b-4fa3-b1d0-41887b17dc5d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:50.485312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e979b72a-642b-4fa3-b1d0-41887b17dc5d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:50.485787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e979b72a-642b-4fa3-b1d0-41887b17dc5d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:50.486207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e979b72a-642b-4fa3-b1d0-41887b17dc5d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:50.486868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e979b72a-642b-4fa3-b1d0-41887b17dc5d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:50.487340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e979b72a-642b-4fa3-b1d0-41887b17dc5d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:50.487781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e979b72a-642b-4fa3-b1d0-41887b17dc5d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:50.619935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e979b72a-642b-4fa3-b1d0-41887b17dc5d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:50.627949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e979b72a-642b-4fa3-b1d0-41887b17dc5d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153639 Aug 31 00:48:50.628501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1080/2094] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:50 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:51.357380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4c725fe3-0f55-40e7-9fcb-25950471ee13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:51.358229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4c725fe3-0f55-40e7-9fcb-25950471ee13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:51.364800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c725fe3-0f55-40e7-9fcb-25950471ee13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:51.365267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c725fe3-0f55-40e7-9fcb-25950471ee13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:51.365692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c725fe3-0f55-40e7-9fcb-25950471ee13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:51.366352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c725fe3-0f55-40e7-9fcb-25950471ee13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:51.366796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c725fe3-0f55-40e7-9fcb-25950471ee13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:51.367237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c725fe3-0f55-40e7-9fcb-25950471ee13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:51.428591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4c725fe3-0f55-40e7-9fcb-25950471ee13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:51.436752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4c725fe3-0f55-40e7-9fcb-25950471ee13 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083193 Aug 31 00:48:51.437315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1015/2095] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:51 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:51.649723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a8edc827-e53c-4bcc-8739-69ff3720d786 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:51.650277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a8edc827-e53c-4bcc-8739-69ff3720d786 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:51.656643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8edc827-e53c-4bcc-8739-69ff3720d786 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:51.657117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8edc827-e53c-4bcc-8739-69ff3720d786 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:51.657545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8edc827-e53c-4bcc-8739-69ff3720d786 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:51.658218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8edc827-e53c-4bcc-8739-69ff3720d786 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:51.658664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8edc827-e53c-4bcc-8739-69ff3720d786 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:51.659106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8edc827-e53c-4bcc-8739-69ff3720d786 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:51.787950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a8edc827-e53c-4bcc-8739-69ff3720d786 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:51.796364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a8edc827-e53c-4bcc-8739-69ff3720d786 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150616 Aug 31 00:48:51.796930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1081/2096] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:51 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:52.457715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-529f4405-775b-43f9-97b5-42ed63b358f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:52.458300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-529f4405-775b-43f9-97b5-42ed63b358f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:52.464657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-529f4405-775b-43f9-97b5-42ed63b358f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:52.465129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-529f4405-775b-43f9-97b5-42ed63b358f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:52.465551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-529f4405-775b-43f9-97b5-42ed63b358f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:52.466226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-529f4405-775b-43f9-97b5-42ed63b358f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:52.466669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-529f4405-775b-43f9-97b5-42ed63b358f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:52.467112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-529f4405-775b-43f9-97b5-42ed63b358f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:52.532056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-529f4405-775b-43f9-97b5-42ed63b358f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:52.540969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-529f4405-775b-43f9-97b5-42ed63b358f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087052 Aug 31 00:48:52.541537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1016/2097] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:52 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:52.817708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-00d6fc02-2b9e-4672-9316-825ed3204482 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:52.818239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-00d6fc02-2b9e-4672-9316-825ed3204482 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:52.824672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d6fc02-2b9e-4672-9316-825ed3204482 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:52.825150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d6fc02-2b9e-4672-9316-825ed3204482 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:52.825585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d6fc02-2b9e-4672-9316-825ed3204482 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:52.826258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d6fc02-2b9e-4672-9316-825ed3204482 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:52.826754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d6fc02-2b9e-4672-9316-825ed3204482 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:52.827981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d6fc02-2b9e-4672-9316-825ed3204482 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:52.956782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-00d6fc02-2b9e-4672-9316-825ed3204482 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:52.965339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-00d6fc02-2b9e-4672-9316-825ed3204482 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151734 Aug 31 00:48:52.965905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1082/2098] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:52 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:53.562984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8bd38d7e-f07b-4355-9b7a-399e979722d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:53.563610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8bd38d7e-f07b-4355-9b7a-399e979722d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:53.570878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bd38d7e-f07b-4355-9b7a-399e979722d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:53.571396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bd38d7e-f07b-4355-9b7a-399e979722d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:53.571830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bd38d7e-f07b-4355-9b7a-399e979722d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:53.572519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bd38d7e-f07b-4355-9b7a-399e979722d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:53.572971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bd38d7e-f07b-4355-9b7a-399e979722d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:53.573391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bd38d7e-f07b-4355-9b7a-399e979722d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:53.636153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8bd38d7e-f07b-4355-9b7a-399e979722d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:53.649002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8bd38d7e-f07b-4355-9b7a-399e979722d9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089769 Aug 31 00:48:53.649588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1017/2099] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:53 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:53.987130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7e7e3f9c-67e9-4e22-8f80-e541da2c539e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:53.987837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7e7e3f9c-67e9-4e22-8f80-e541da2c539e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:53.994053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e7e3f9c-67e9-4e22-8f80-e541da2c539e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:53.994525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e7e3f9c-67e9-4e22-8f80-e541da2c539e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:53.995105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e7e3f9c-67e9-4e22-8f80-e541da2c539e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:53.995633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e7e3f9c-67e9-4e22-8f80-e541da2c539e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:53.996077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e7e3f9c-67e9-4e22-8f80-e541da2c539e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:53.996492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e7e3f9c-67e9-4e22-8f80-e541da2c539e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:54.128502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7e7e3f9c-67e9-4e22-8f80-e541da2c539e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:54.137272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7e7e3f9c-67e9-4e22-8f80-e541da2c539e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153977 Aug 31 00:48:54.137843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1083/2100] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:53 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:54.670094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1dafe39a-cf41-4eca-8bee-ecc260ca1a8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:54.670690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1dafe39a-cf41-4eca-8bee-ecc260ca1a8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:54.678250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dafe39a-cf41-4eca-8bee-ecc260ca1a8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:54.678723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dafe39a-cf41-4eca-8bee-ecc260ca1a8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:54.679183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dafe39a-cf41-4eca-8bee-ecc260ca1a8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:54.679861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dafe39a-cf41-4eca-8bee-ecc260ca1a8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:54.680332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dafe39a-cf41-4eca-8bee-ecc260ca1a8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:54.680754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dafe39a-cf41-4eca-8bee-ecc260ca1a8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:54.743134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1dafe39a-cf41-4eca-8bee-ecc260ca1a8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:54.751413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1dafe39a-cf41-4eca-8bee-ecc260ca1a8b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085108 Aug 31 00:48:54.751985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1018/2101] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:54 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:55.159332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-37cd25ba-5238-475f-a89b-a98f9d678d79 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:55.159924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-37cd25ba-5238-475f-a89b-a98f9d678d79 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:55.166972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37cd25ba-5238-475f-a89b-a98f9d678d79 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:55.167476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37cd25ba-5238-475f-a89b-a98f9d678d79 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:55.167903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37cd25ba-5238-475f-a89b-a98f9d678d79 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:55.168573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37cd25ba-5238-475f-a89b-a98f9d678d79 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:55.169013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37cd25ba-5238-475f-a89b-a98f9d678d79 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:55.169425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37cd25ba-5238-475f-a89b-a98f9d678d79 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:55.296683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37cd25ba-5238-475f-a89b-a98f9d678d79 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:55.305077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-37cd25ba-5238-475f-a89b-a98f9d678d79 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149649 Aug 31 00:48:55.305631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1084/2102] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:55 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:55.773766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b2b45595-50ab-4412-b255-b15af815098a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:55.774408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b2b45595-50ab-4412-b255-b15af815098a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:55.780849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2b45595-50ab-4412-b255-b15af815098a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:55.781332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2b45595-50ab-4412-b255-b15af815098a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:55.781765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2b45595-50ab-4412-b255-b15af815098a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:55.782451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2b45595-50ab-4412-b255-b15af815098a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:55.782903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2b45595-50ab-4412-b255-b15af815098a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:55.783351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2b45595-50ab-4412-b255-b15af815098a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:55.848102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2b45595-50ab-4412-b255-b15af815098a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:55.856134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b2b45595-50ab-4412-b255-b15af815098a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086428 Aug 31 00:48:55.856693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1019/2103] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:55 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:56.326120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2366eba0-94a0-436e-b624-db6de73ece01 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:56.326713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2366eba0-94a0-436e-b624-db6de73ece01 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:56.333799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2366eba0-94a0-436e-b624-db6de73ece01 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:56.334271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2366eba0-94a0-436e-b624-db6de73ece01 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:56.334694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2366eba0-94a0-436e-b624-db6de73ece01 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:56.335394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2366eba0-94a0-436e-b624-db6de73ece01 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:56.335838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2366eba0-94a0-436e-b624-db6de73ece01 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:56.336250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2366eba0-94a0-436e-b624-db6de73ece01 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:56.464324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2366eba0-94a0-436e-b624-db6de73ece01 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:56.472520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2366eba0-94a0-436e-b624-db6de73ece01 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150216 Aug 31 00:48:56.473268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1085/2104] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:56 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:56.878232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a99feac3-8f93-4420-9255-a687921b1243 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:56.878861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a99feac3-8f93-4420-9255-a687921b1243 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:56.885860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a99feac3-8f93-4420-9255-a687921b1243 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:56.886333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a99feac3-8f93-4420-9255-a687921b1243 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:56.886758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a99feac3-8f93-4420-9255-a687921b1243 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:56.887485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a99feac3-8f93-4420-9255-a687921b1243 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:56.887928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a99feac3-8f93-4420-9255-a687921b1243 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:56.888344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a99feac3-8f93-4420-9255-a687921b1243 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:56.951798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a99feac3-8f93-4420-9255-a687921b1243 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:56.960547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a99feac3-8f93-4420-9255-a687921b1243 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086130 Aug 31 00:48:56.961106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1020/2105] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:56 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:57.494372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-65c76763-6e03-4a31-8028-321e2b1a32b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:57.494917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-65c76763-6e03-4a31-8028-321e2b1a32b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:57.501352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c76763-6e03-4a31-8028-321e2b1a32b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:57.501828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c76763-6e03-4a31-8028-321e2b1a32b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:57.502260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c76763-6e03-4a31-8028-321e2b1a32b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:57.502933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c76763-6e03-4a31-8028-321e2b1a32b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:57.503458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c76763-6e03-4a31-8028-321e2b1a32b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:57.503802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c76763-6e03-4a31-8028-321e2b1a32b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:57.635851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-65c76763-6e03-4a31-8028-321e2b1a32b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:57.644129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-65c76763-6e03-4a31-8028-321e2b1a32b4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153620 Aug 31 00:48:57.644727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1086/2106] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:57 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:48:57.981964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-722669b6-2a35-4ecf-b5c2-5a923dc3a04b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:57.982879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-722669b6-2a35-4ecf-b5c2-5a923dc3a04b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:57.989845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-722669b6-2a35-4ecf-b5c2-5a923dc3a04b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:57.990323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-722669b6-2a35-4ecf-b5c2-5a923dc3a04b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:57.990769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-722669b6-2a35-4ecf-b5c2-5a923dc3a04b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:57.991721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-722669b6-2a35-4ecf-b5c2-5a923dc3a04b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:57.992282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-722669b6-2a35-4ecf-b5c2-5a923dc3a04b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:57.992800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-722669b6-2a35-4ecf-b5c2-5a923dc3a04b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:58.008773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:58.054963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-722669b6-2a35-4ecf-b5c2-5a923dc3a04b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:58.063122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-722669b6-2a35-4ecf-b5c2-5a923dc3a04b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084981 Aug 31 00:48:58.063669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1021/2107] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:57 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:58.665920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e51034c6-b8b2-4d1a-8008-abc3299e527a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:58.666552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e51034c6-b8b2-4d1a-8008-abc3299e527a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:58.673322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51034c6-b8b2-4d1a-8008-abc3299e527a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:58.673798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51034c6-b8b2-4d1a-8008-abc3299e527a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:58.674228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51034c6-b8b2-4d1a-8008-abc3299e527a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:58.674904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51034c6-b8b2-4d1a-8008-abc3299e527a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:58.675378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51034c6-b8b2-4d1a-8008-abc3299e527a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:58.676646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e51034c6-b8b2-4d1a-8008-abc3299e527a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:58.805590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e51034c6-b8b2-4d1a-8008-abc3299e527a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:58.813791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e51034c6-b8b2-4d1a-8008-abc3299e527a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151750 Aug 31 00:48:58.814364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1087/2108] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:58 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:59.085847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-794ee58a-0fbf-4f75-bf2c-63ef60ee9812 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:59.086463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-794ee58a-0fbf-4f75-bf2c-63ef60ee9812 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:59.092861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-794ee58a-0fbf-4f75-bf2c-63ef60ee9812 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:59.093344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-794ee58a-0fbf-4f75-bf2c-63ef60ee9812 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:59.093776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-794ee58a-0fbf-4f75-bf2c-63ef60ee9812 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:59.094460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-794ee58a-0fbf-4f75-bf2c-63ef60ee9812 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:59.094913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-794ee58a-0fbf-4f75-bf2c-63ef60ee9812 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:59.095368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-794ee58a-0fbf-4f75-bf2c-63ef60ee9812 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:59.161720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-794ee58a-0fbf-4f75-bf2c-63ef60ee9812 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:59.169989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-794ee58a-0fbf-4f75-bf2c-63ef60ee9812 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088848 Aug 31 00:48:59.170546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1022/2109] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:59 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:48:59.838274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4f01195c-7f09-4ee5-8446-24d52755917e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:48:59.838997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4f01195c-7f09-4ee5-8446-24d52755917e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:48:59.845543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f01195c-7f09-4ee5-8446-24d52755917e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:59.846022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f01195c-7f09-4ee5-8446-24d52755917e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:59.846452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f01195c-7f09-4ee5-8446-24d52755917e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:59.847160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f01195c-7f09-4ee5-8446-24d52755917e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:48:59.848575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f01195c-7f09-4ee5-8446-24d52755917e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:48:59.849040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f01195c-7f09-4ee5-8446-24d52755917e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:48:59.978387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4f01195c-7f09-4ee5-8446-24d52755917e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:48:59.986994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4f01195c-7f09-4ee5-8446-24d52755917e tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152551 Aug 31 00:48:59.987585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1088/2110] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:48:59 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:00.191769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-928fec5b-00d8-4c36-aefa-a0aee07ad7d0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:00.192479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-928fec5b-00d8-4c36-aefa-a0aee07ad7d0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:00.198874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-928fec5b-00d8-4c36-aefa-a0aee07ad7d0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:00.199397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-928fec5b-00d8-4c36-aefa-a0aee07ad7d0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:00.199837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-928fec5b-00d8-4c36-aefa-a0aee07ad7d0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:00.200527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-928fec5b-00d8-4c36-aefa-a0aee07ad7d0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:00.200985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-928fec5b-00d8-4c36-aefa-a0aee07ad7d0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:00.201409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-928fec5b-00d8-4c36-aefa-a0aee07ad7d0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:00.262975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-928fec5b-00d8-4c36-aefa-a0aee07ad7d0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:00.272054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-928fec5b-00d8-4c36-aefa-a0aee07ad7d0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084307 Aug 31 00:49:00.272662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1023/2111] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:01.012550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-adfede30-b170-44ae-ac2f-048549662fd4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:01.013238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-adfede30-b170-44ae-ac2f-048549662fd4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:01.020384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-adfede30-b170-44ae-ac2f-048549662fd4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:01.020874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-adfede30-b170-44ae-ac2f-048549662fd4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:01.021308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-adfede30-b170-44ae-ac2f-048549662fd4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:01.021992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-adfede30-b170-44ae-ac2f-048549662fd4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:01.022433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-adfede30-b170-44ae-ac2f-048549662fd4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:01.022846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-adfede30-b170-44ae-ac2f-048549662fd4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:01.156315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-adfede30-b170-44ae-ac2f-048549662fd4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:01.164790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-adfede30-b170-44ae-ac2f-048549662fd4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156965 Aug 31 00:49:01.165350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1089/2112] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:01 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:01.295378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-727e1048-2ace-4f29-80a3-b90f34afa956 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:01.296018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-727e1048-2ace-4f29-80a3-b90f34afa956 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:01.303183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-727e1048-2ace-4f29-80a3-b90f34afa956 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:01.303663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-727e1048-2ace-4f29-80a3-b90f34afa956 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:01.304110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-727e1048-2ace-4f29-80a3-b90f34afa956 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:01.304798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-727e1048-2ace-4f29-80a3-b90f34afa956 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:01.305244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-727e1048-2ace-4f29-80a3-b90f34afa956 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:01.305663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-727e1048-2ace-4f29-80a3-b90f34afa956 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:01.369133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-727e1048-2ace-4f29-80a3-b90f34afa956 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:01.377345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-727e1048-2ace-4f29-80a3-b90f34afa956 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085914 Aug 31 00:49:01.377907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1024/2113] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:01 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:02.186628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-faf46d8a-fb4b-43cc-847c-662cb648718c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:02.187268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-faf46d8a-fb4b-43cc-847c-662cb648718c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:02.194612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-faf46d8a-fb4b-43cc-847c-662cb648718c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:02.195123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-faf46d8a-fb4b-43cc-847c-662cb648718c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:02.195562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-faf46d8a-fb4b-43cc-847c-662cb648718c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:02.196244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-faf46d8a-fb4b-43cc-847c-662cb648718c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:02.196696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-faf46d8a-fb4b-43cc-847c-662cb648718c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:02.197118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-faf46d8a-fb4b-43cc-847c-662cb648718c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:02.199701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:02.379392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-faf46d8a-fb4b-43cc-847c-662cb648718c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:02.387537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-faf46d8a-fb4b-43cc-847c-662cb648718c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.204775 Aug 31 00:49:02.388264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1090/2114] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:02 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:02.399281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-95058983-e333-4ca6-94ce-91128b187505 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:02.399893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-95058983-e333-4ca6-94ce-91128b187505 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:02.406441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95058983-e333-4ca6-94ce-91128b187505 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:02.406913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95058983-e333-4ca6-94ce-91128b187505 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:02.407377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95058983-e333-4ca6-94ce-91128b187505 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:02.408049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95058983-e333-4ca6-94ce-91128b187505 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:02.408491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95058983-e333-4ca6-94ce-91128b187505 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:02.409169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-95058983-e333-4ca6-94ce-91128b187505 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:02.472793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-95058983-e333-4ca6-94ce-91128b187505 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:02.481081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-95058983-e333-4ca6-94ce-91128b187505 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085590 Aug 31 00:49:02.481646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1025/2115] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:02 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:03.409593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-46cdc86c-ee2c-48ab-8609-948c7bddd745 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:03.410924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-46cdc86c-ee2c-48ab-8609-948c7bddd745 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:03.417586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cdc86c-ee2c-48ab-8609-948c7bddd745 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:03.418067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cdc86c-ee2c-48ab-8609-948c7bddd745 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:03.418501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cdc86c-ee2c-48ab-8609-948c7bddd745 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:03.419216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cdc86c-ee2c-48ab-8609-948c7bddd745 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:03.419669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cdc86c-ee2c-48ab-8609-948c7bddd745 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:03.420093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cdc86c-ee2c-48ab-8609-948c7bddd745 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:03.502610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d9a6f462-d896-4e3b-90ff-b903864a3165 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:03.503242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d9a6f462-d896-4e3b-90ff-b903864a3165 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:03.512242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a6f462-d896-4e3b-90ff-b903864a3165 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:03.512742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a6f462-d896-4e3b-90ff-b903864a3165 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:03.513152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a6f462-d896-4e3b-90ff-b903864a3165 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:03.513843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a6f462-d896-4e3b-90ff-b903864a3165 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:03.514286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a6f462-d896-4e3b-90ff-b903864a3165 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:03.514696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9a6f462-d896-4e3b-90ff-b903864a3165 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:03.550606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-46cdc86c-ee2c-48ab-8609-948c7bddd745 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:03.559435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-46cdc86c-ee2c-48ab-8609-948c7bddd745 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153640 Aug 31 00:49:03.560006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1091/2116] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:03 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:03.630432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d9a6f462-d896-4e3b-90ff-b903864a3165 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:03.639055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d9a6f462-d896-4e3b-90ff-b903864a3165 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.140226 Aug 31 00:49:03.639618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1026/2117] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:03 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:04.580215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e93e3a59-37a1-4b31-918c-e2df393d9045 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:04.580815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e93e3a59-37a1-4b31-918c-e2df393d9045 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:04.587829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e93e3a59-37a1-4b31-918c-e2df393d9045 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:04.588300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e93e3a59-37a1-4b31-918c-e2df393d9045 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:04.588728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e93e3a59-37a1-4b31-918c-e2df393d9045 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:04.589397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e93e3a59-37a1-4b31-918c-e2df393d9045 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:04.589842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e93e3a59-37a1-4b31-918c-e2df393d9045 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:04.590254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e93e3a59-37a1-4b31-918c-e2df393d9045 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:04.661882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-23e7a438-a47d-44f9-bc96-b27ae37ab3af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:04.662579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-23e7a438-a47d-44f9-bc96-b27ae37ab3af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:04.669037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e7a438-a47d-44f9-bc96-b27ae37ab3af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:04.669584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e7a438-a47d-44f9-bc96-b27ae37ab3af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:04.670019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e7a438-a47d-44f9-bc96-b27ae37ab3af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:04.670817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e7a438-a47d-44f9-bc96-b27ae37ab3af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:04.671165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e7a438-a47d-44f9-bc96-b27ae37ab3af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:04.671591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-23e7a438-a47d-44f9-bc96-b27ae37ab3af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:04.744612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-23e7a438-a47d-44f9-bc96-b27ae37ab3af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:04.751852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e93e3a59-37a1-4b31-918c-e2df393d9045 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:04.752849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-23e7a438-a47d-44f9-bc96-b27ae37ab3af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.094946 Aug 31 00:49:04.753432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1027/2118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:04 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:04.760684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e93e3a59-37a1-4b31-918c-e2df393d9045 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.184276 Aug 31 00:49:04.761245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1092/2119] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:04 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:05.775356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3e06a960-4552-4ece-aea1-40ecd600a058 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:05.775982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3e06a960-4552-4ece-aea1-40ecd600a058 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:05.781778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a1da4c21-2cfe-4adf-a50a-f353238b78d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:05.782384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a1da4c21-2cfe-4adf-a50a-f353238b78d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:05.782509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e06a960-4552-4ece-aea1-40ecd600a058 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:05.782944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e06a960-4552-4ece-aea1-40ecd600a058 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:05.784021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e06a960-4552-4ece-aea1-40ecd600a058 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:05.784723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e06a960-4552-4ece-aea1-40ecd600a058 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:05.785177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e06a960-4552-4ece-aea1-40ecd600a058 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:05.786312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e06a960-4552-4ece-aea1-40ecd600a058 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:05.789704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1da4c21-2cfe-4adf-a50a-f353238b78d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:05.790185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1da4c21-2cfe-4adf-a50a-f353238b78d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:05.790619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1da4c21-2cfe-4adf-a50a-f353238b78d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:05.791336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1da4c21-2cfe-4adf-a50a-f353238b78d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:05.791788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1da4c21-2cfe-4adf-a50a-f353238b78d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:05.792204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1da4c21-2cfe-4adf-a50a-f353238b78d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:05.856737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e06a960-4552-4ece-aea1-40ecd600a058 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:05.865163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3e06a960-4552-4ece-aea1-40ecd600a058 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.093670 Aug 31 00:49:05.865724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1028/2120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:05 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:05.938028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1da4c21-2cfe-4adf-a50a-f353238b78d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:05.946714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a1da4c21-2cfe-4adf-a50a-f353238b78d3 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.168795 Aug 31 00:49:05.947307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1093/2121] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:05 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:06.885885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-81e6d24a-1d76-4e72-a6ed-7b302048b7af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:06.886492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-81e6d24a-1d76-4e72-a6ed-7b302048b7af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:06.888797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=56 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:06.894015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81e6d24a-1d76-4e72-a6ed-7b302048b7af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:06.894500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81e6d24a-1d76-4e72-a6ed-7b302048b7af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:06.895014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81e6d24a-1d76-4e72-a6ed-7b302048b7af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:06.895778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81e6d24a-1d76-4e72-a6ed-7b302048b7af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:06.896238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81e6d24a-1d76-4e72-a6ed-7b302048b7af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:06.896663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-81e6d24a-1d76-4e72-a6ed-7b302048b7af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:06.961829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-81e6d24a-1d76-4e72-a6ed-7b302048b7af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:06.970873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f21d97dd-479f-4f3a-aca1-1116172f0c94 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:06.971659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f21d97dd-479f-4f3a-aca1-1116172f0c94 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:06.977549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-81e6d24a-1d76-4e72-a6ed-7b302048b7af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.095058 Aug 31 00:49:06.978392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1029/2122] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:06 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:06.978798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21d97dd-479f-4f3a-aca1-1116172f0c94 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:06.979320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21d97dd-479f-4f3a-aca1-1116172f0c94 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:06.979756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21d97dd-479f-4f3a-aca1-1116172f0c94 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:06.980455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21d97dd-479f-4f3a-aca1-1116172f0c94 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:06.980907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21d97dd-479f-4f3a-aca1-1116172f0c94 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:06.981327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21d97dd-479f-4f3a-aca1-1116172f0c94 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:07.113348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f21d97dd-479f-4f3a-aca1-1116172f0c94 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:07.121720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f21d97dd-479f-4f3a-aca1-1116172f0c94 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157195 Aug 31 00:49:07.122396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1094/2123] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:06 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:07.998829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-71a45bc9-9927-48c4-8048-542f75118d0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:07.999468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-71a45bc9-9927-48c4-8048-542f75118d0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:08.006369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a45bc9-9927-48c4-8048-542f75118d0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:08.006852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a45bc9-9927-48c4-8048-542f75118d0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:08.007319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a45bc9-9927-48c4-8048-542f75118d0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:08.008012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a45bc9-9927-48c4-8048-542f75118d0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:08.008461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a45bc9-9927-48c4-8048-542f75118d0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:08.008886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a45bc9-9927-48c4-8048-542f75118d0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:08.085616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-71a45bc9-9927-48c4-8048-542f75118d0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:08.093731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-71a45bc9-9927-48c4-8048-542f75118d0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.098731 Aug 31 00:49:08.094296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1030/2124] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:07 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:08.143094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a8e0c030-81d9-4fda-8089-1096d6bd0d4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:08.143800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a8e0c030-81d9-4fda-8089-1096d6bd0d4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:08.151774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8e0c030-81d9-4fda-8089-1096d6bd0d4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:08.152381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8e0c030-81d9-4fda-8089-1096d6bd0d4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:08.152857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8e0c030-81d9-4fda-8089-1096d6bd0d4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:08.153647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8e0c030-81d9-4fda-8089-1096d6bd0d4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:08.154170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8e0c030-81d9-4fda-8089-1096d6bd0d4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:08.154680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8e0c030-81d9-4fda-8089-1096d6bd0d4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:08.377618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a8e0c030-81d9-4fda-8089-1096d6bd0d4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:08.388455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a8e0c030-81d9-4fda-8089-1096d6bd0d4a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.249170 Aug 31 00:49:08.389050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1095/2125] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:08 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:09.116016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a42694aa-c4fd-43be-8c4e-a38ca3c64d26 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:09.116625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a42694aa-c4fd-43be-8c4e-a38ca3c64d26 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:09.122774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a42694aa-c4fd-43be-8c4e-a38ca3c64d26 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:09.123291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a42694aa-c4fd-43be-8c4e-a38ca3c64d26 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:09.123725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a42694aa-c4fd-43be-8c4e-a38ca3c64d26 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:09.124408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a42694aa-c4fd-43be-8c4e-a38ca3c64d26 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:09.124858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a42694aa-c4fd-43be-8c4e-a38ca3c64d26 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:09.125276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a42694aa-c4fd-43be-8c4e-a38ca3c64d26 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:09.187460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a42694aa-c4fd-43be-8c4e-a38ca3c64d26 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:09.196205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a42694aa-c4fd-43be-8c4e-a38ca3c64d26 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084769 Aug 31 00:49:09.196764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1031/2126] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:09 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:09.409823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-39c91850-aac2-4bce-b1f7-9f637cc7a33a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:09.410423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-39c91850-aac2-4bce-b1f7-9f637cc7a33a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:09.417200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39c91850-aac2-4bce-b1f7-9f637cc7a33a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:09.417684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39c91850-aac2-4bce-b1f7-9f637cc7a33a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:09.418124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39c91850-aac2-4bce-b1f7-9f637cc7a33a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:09.418811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39c91850-aac2-4bce-b1f7-9f637cc7a33a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:09.419291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39c91850-aac2-4bce-b1f7-9f637cc7a33a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:09.419715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-39c91850-aac2-4bce-b1f7-9f637cc7a33a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:09.551456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-39c91850-aac2-4bce-b1f7-9f637cc7a33a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:09.560376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-39c91850-aac2-4bce-b1f7-9f637cc7a33a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.154381 Aug 31 00:49:09.560948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1096/2127] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:09 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:10.217772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6915c3e1-af45-4fb9-aa2b-37b871beaffe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:10.218399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6915c3e1-af45-4fb9-aa2b-37b871beaffe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:10.226048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6915c3e1-af45-4fb9-aa2b-37b871beaffe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:10.226775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6915c3e1-af45-4fb9-aa2b-37b871beaffe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:10.227460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6915c3e1-af45-4fb9-aa2b-37b871beaffe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:10.228507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6915c3e1-af45-4fb9-aa2b-37b871beaffe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:10.229230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6915c3e1-af45-4fb9-aa2b-37b871beaffe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:10.229914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6915c3e1-af45-4fb9-aa2b-37b871beaffe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:10.294858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6915c3e1-af45-4fb9-aa2b-37b871beaffe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:10.303338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6915c3e1-af45-4fb9-aa2b-37b871beaffe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089348 Aug 31 00:49:10.303893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1032/2128] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:10 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:10.581800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0cd32b6-0bd3-44af-941d-8a40fd815626 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:10.583063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0cd32b6-0bd3-44af-941d-8a40fd815626 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:10.585499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:10.590729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0cd32b6-0bd3-44af-941d-8a40fd815626 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:10.591241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0cd32b6-0bd3-44af-941d-8a40fd815626 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:10.591674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0cd32b6-0bd3-44af-941d-8a40fd815626 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:10.592354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0cd32b6-0bd3-44af-941d-8a40fd815626 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:10.592803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0cd32b6-0bd3-44af-941d-8a40fd815626 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:10.593220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0cd32b6-0bd3-44af-941d-8a40fd815626 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:10.720297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0cd32b6-0bd3-44af-941d-8a40fd815626 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:10.728551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0cd32b6-0bd3-44af-941d-8a40fd815626 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150616 Aug 31 00:49:10.729119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1097/2129] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:10 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:11.324883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e9cd77a0-66cf-4e19-9df3-56834629eb03 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:11.325452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e9cd77a0-66cf-4e19-9df3-56834629eb03 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:11.331754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9cd77a0-66cf-4e19-9df3-56834629eb03 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:11.332340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9cd77a0-66cf-4e19-9df3-56834629eb03 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:11.332792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9cd77a0-66cf-4e19-9df3-56834629eb03 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:11.333477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9cd77a0-66cf-4e19-9df3-56834629eb03 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:11.333926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9cd77a0-66cf-4e19-9df3-56834629eb03 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:11.334343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9cd77a0-66cf-4e19-9df3-56834629eb03 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:11.397341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e9cd77a0-66cf-4e19-9df3-56834629eb03 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:11.405644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e9cd77a0-66cf-4e19-9df3-56834629eb03 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084741 Aug 31 00:49:11.406203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1033/2130] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:11 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:11.749811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5b7cf101-dd26-4c99-8abb-742d50c2a70a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:11.750405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5b7cf101-dd26-4c99-8abb-742d50c2a70a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:11.756743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b7cf101-dd26-4c99-8abb-742d50c2a70a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:11.757215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b7cf101-dd26-4c99-8abb-742d50c2a70a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:11.757638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b7cf101-dd26-4c99-8abb-742d50c2a70a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:11.758304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b7cf101-dd26-4c99-8abb-742d50c2a70a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:11.758743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b7cf101-dd26-4c99-8abb-742d50c2a70a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:11.759178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5b7cf101-dd26-4c99-8abb-742d50c2a70a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:11.890326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5b7cf101-dd26-4c99-8abb-742d50c2a70a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:11.899173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5b7cf101-dd26-4c99-8abb-742d50c2a70a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153193 Aug 31 00:49:11.899733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1098/2131] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:11 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:12.427691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-770f64e2-a0b7-430d-9a51-d6d40e096346 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:12.428282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-770f64e2-a0b7-430d-9a51-d6d40e096346 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:12.434695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-770f64e2-a0b7-430d-9a51-d6d40e096346 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:12.435210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-770f64e2-a0b7-430d-9a51-d6d40e096346 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:12.435647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-770f64e2-a0b7-430d-9a51-d6d40e096346 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:12.436332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-770f64e2-a0b7-430d-9a51-d6d40e096346 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:12.436782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-770f64e2-a0b7-430d-9a51-d6d40e096346 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:12.437202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-770f64e2-a0b7-430d-9a51-d6d40e096346 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:12.498436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-770f64e2-a0b7-430d-9a51-d6d40e096346 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:12.507832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-770f64e2-a0b7-430d-9a51-d6d40e096346 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084865 Aug 31 00:49:12.508399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1034/2132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:12 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:12.920426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d61cc96a-2fd9-4a06-b168-219eb4151ac2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:12.921078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d61cc96a-2fd9-4a06-b168-219eb4151ac2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:12.928486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d61cc96a-2fd9-4a06-b168-219eb4151ac2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:12.928970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d61cc96a-2fd9-4a06-b168-219eb4151ac2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:12.929405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d61cc96a-2fd9-4a06-b168-219eb4151ac2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:12.930094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d61cc96a-2fd9-4a06-b168-219eb4151ac2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:12.930543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d61cc96a-2fd9-4a06-b168-219eb4151ac2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:12.930961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d61cc96a-2fd9-4a06-b168-219eb4151ac2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:13.063859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d61cc96a-2fd9-4a06-b168-219eb4151ac2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:13.074962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d61cc96a-2fd9-4a06-b168-219eb4151ac2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.158396 Aug 31 00:49:13.075580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1099/2133] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:12 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:13.528963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-eccee1cb-4932-48c9-ae35-c59f8e365040 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:13.529593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eccee1cb-4932-48c9-ae35-c59f8e365040 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:13.536095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eccee1cb-4932-48c9-ae35-c59f8e365040 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:13.536574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eccee1cb-4932-48c9-ae35-c59f8e365040 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:13.537038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eccee1cb-4932-48c9-ae35-c59f8e365040 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:13.537722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eccee1cb-4932-48c9-ae35-c59f8e365040 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:13.538168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eccee1cb-4932-48c9-ae35-c59f8e365040 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:13.538584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eccee1cb-4932-48c9-ae35-c59f8e365040 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:13.599954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-eccee1cb-4932-48c9-ae35-c59f8e365040 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:13.608249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-eccee1cb-4932-48c9-ae35-c59f8e365040 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083162 Aug 31 00:49:13.608807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1035/2134] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:13 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:14.097442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ccef460c-a1da-4d00-b9f4-3ef8eece3456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:14.098585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ccef460c-a1da-4d00-b9f4-3ef8eece3456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:14.105027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccef460c-a1da-4d00-b9f4-3ef8eece3456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:14.105506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccef460c-a1da-4d00-b9f4-3ef8eece3456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:14.105941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccef460c-a1da-4d00-b9f4-3ef8eece3456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:14.106887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccef460c-a1da-4d00-b9f4-3ef8eece3456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:14.107544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccef460c-a1da-4d00-b9f4-3ef8eece3456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:14.107976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccef460c-a1da-4d00-b9f4-3ef8eece3456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:14.238003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ccef460c-a1da-4d00-b9f4-3ef8eece3456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:14.246884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ccef460c-a1da-4d00-b9f4-3ef8eece3456 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153271 Aug 31 00:49:14.247412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1100/2135] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:14 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:14.629587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8d6e5b9f-59ef-4a7c-b38b-7051bf96880d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:14.630291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8d6e5b9f-59ef-4a7c-b38b-7051bf96880d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:14.636747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d6e5b9f-59ef-4a7c-b38b-7051bf96880d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:14.637225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d6e5b9f-59ef-4a7c-b38b-7051bf96880d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:14.637657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d6e5b9f-59ef-4a7c-b38b-7051bf96880d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:14.638339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d6e5b9f-59ef-4a7c-b38b-7051bf96880d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:14.638790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d6e5b9f-59ef-4a7c-b38b-7051bf96880d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:14.639252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d6e5b9f-59ef-4a7c-b38b-7051bf96880d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:14.701086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8d6e5b9f-59ef-4a7c-b38b-7051bf96880d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:14.709911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8d6e5b9f-59ef-4a7c-b38b-7051bf96880d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084440 Aug 31 00:49:14.710470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1036/2136] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:14 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:15.268236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0711f554-9f51-423e-aa00-e7969e6779c0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:15.268788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0711f554-9f51-423e-aa00-e7969e6779c0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:15.275662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0711f554-9f51-423e-aa00-e7969e6779c0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:15.276260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0711f554-9f51-423e-aa00-e7969e6779c0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:15.276818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0711f554-9f51-423e-aa00-e7969e6779c0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:15.277615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0711f554-9f51-423e-aa00-e7969e6779c0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:15.278190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0711f554-9f51-423e-aa00-e7969e6779c0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:15.278715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0711f554-9f51-423e-aa00-e7969e6779c0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:15.409627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0711f554-9f51-423e-aa00-e7969e6779c0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:15.418033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0711f554-9f51-423e-aa00-e7969e6779c0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153729 Aug 31 00:49:15.418605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1101/2137] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:15 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:15.732177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-58fe99ea-1254-4608-ba45-a23be51f1a1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:15.732776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-58fe99ea-1254-4608-ba45-a23be51f1a1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:15.739775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58fe99ea-1254-4608-ba45-a23be51f1a1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:15.740249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58fe99ea-1254-4608-ba45-a23be51f1a1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:15.740774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58fe99ea-1254-4608-ba45-a23be51f1a1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:15.741469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58fe99ea-1254-4608-ba45-a23be51f1a1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:15.741910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58fe99ea-1254-4608-ba45-a23be51f1a1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:15.742359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-58fe99ea-1254-4608-ba45-a23be51f1a1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:15.802949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-58fe99ea-1254-4608-ba45-a23be51f1a1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:15.810978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-58fe99ea-1254-4608-ba45-a23be51f1a1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082976 Aug 31 00:49:15.811557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1037/2138] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:15 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:16.440097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-acb31e53-735e-4c02-802c-b1038eadf311 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:16.440684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-acb31e53-735e-4c02-802c-b1038eadf311 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:16.447717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acb31e53-735e-4c02-802c-b1038eadf311 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:16.448194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acb31e53-735e-4c02-802c-b1038eadf311 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:16.448622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acb31e53-735e-4c02-802c-b1038eadf311 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:16.449299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acb31e53-735e-4c02-802c-b1038eadf311 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:16.449743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acb31e53-735e-4c02-802c-b1038eadf311 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:16.450160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acb31e53-735e-4c02-802c-b1038eadf311 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:16.580949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-acb31e53-735e-4c02-802c-b1038eadf311 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:16.591851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-acb31e53-735e-4c02-802c-b1038eadf311 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155576 Aug 31 00:49:16.592426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1102/2139] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:16 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:16.832875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-430bef8f-6513-4b1a-b78e-5c6b6ff74511 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:16.833478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-430bef8f-6513-4b1a-b78e-5c6b6ff74511 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:16.839787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-430bef8f-6513-4b1a-b78e-5c6b6ff74511 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:16.840257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-430bef8f-6513-4b1a-b78e-5c6b6ff74511 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:16.840681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-430bef8f-6513-4b1a-b78e-5c6b6ff74511 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:16.841395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-430bef8f-6513-4b1a-b78e-5c6b6ff74511 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:16.841826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-430bef8f-6513-4b1a-b78e-5c6b6ff74511 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:16.842241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-430bef8f-6513-4b1a-b78e-5c6b6ff74511 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:16.844745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:16.903983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-430bef8f-6513-4b1a-b78e-5c6b6ff74511 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:16.912101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-430bef8f-6513-4b1a-b78e-5c6b6ff74511 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083398 Aug 31 00:49:16.912675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1038/2140] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:16 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:17.613072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4809a852-79c5-4a9f-8a34-aacc469602e7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:17.613761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4809a852-79c5-4a9f-8a34-aacc469602e7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:17.620212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4809a852-79c5-4a9f-8a34-aacc469602e7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:17.620696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4809a852-79c5-4a9f-8a34-aacc469602e7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:17.621121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4809a852-79c5-4a9f-8a34-aacc469602e7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:17.621795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4809a852-79c5-4a9f-8a34-aacc469602e7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:17.622243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4809a852-79c5-4a9f-8a34-aacc469602e7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:17.622659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4809a852-79c5-4a9f-8a34-aacc469602e7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:17.749617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4809a852-79c5-4a9f-8a34-aacc469602e7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:17.757682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4809a852-79c5-4a9f-8a34-aacc469602e7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.148535 Aug 31 00:49:17.758238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1103/2141] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:17 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:17.933121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bf7ec080-bc76-4833-a406-79dc20436bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:17.933727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bf7ec080-bc76-4833-a406-79dc20436bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:17.940223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf7ec080-bc76-4833-a406-79dc20436bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:17.940697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf7ec080-bc76-4833-a406-79dc20436bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:17.941647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf7ec080-bc76-4833-a406-79dc20436bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:17.942322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf7ec080-bc76-4833-a406-79dc20436bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:17.942767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf7ec080-bc76-4833-a406-79dc20436bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:17.943218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf7ec080-bc76-4833-a406-79dc20436bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:18.004221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bf7ec080-bc76-4833-a406-79dc20436bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:18.012807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bf7ec080-bc76-4833-a406-79dc20436bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083497 Aug 31 00:49:18.013373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1039/2142] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:17 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:18.779148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d5c0d36d-59fd-4399-8853-8686f970b0da tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:18.779746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d5c0d36d-59fd-4399-8853-8686f970b0da tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:18.786793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c0d36d-59fd-4399-8853-8686f970b0da tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:18.787302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c0d36d-59fd-4399-8853-8686f970b0da tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:18.787735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c0d36d-59fd-4399-8853-8686f970b0da tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:18.788413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c0d36d-59fd-4399-8853-8686f970b0da tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:18.788862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c0d36d-59fd-4399-8853-8686f970b0da tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:18.789278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c0d36d-59fd-4399-8853-8686f970b0da tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:18.917010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d5c0d36d-59fd-4399-8853-8686f970b0da tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:18.925089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d5c0d36d-59fd-4399-8853-8686f970b0da tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149825 Aug 31 00:49:18.926246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1104/2143] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:18 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:19.034569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f34bf2fd-ee77-479a-9817-c42264d8602c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:19.036023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f34bf2fd-ee77-479a-9817-c42264d8602c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:19.042633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34bf2fd-ee77-479a-9817-c42264d8602c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:19.043148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34bf2fd-ee77-479a-9817-c42264d8602c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:19.043586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34bf2fd-ee77-479a-9817-c42264d8602c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:19.044278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34bf2fd-ee77-479a-9817-c42264d8602c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:19.044755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34bf2fd-ee77-479a-9817-c42264d8602c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:19.045178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34bf2fd-ee77-479a-9817-c42264d8602c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:19.115428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f34bf2fd-ee77-479a-9817-c42264d8602c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:19.123805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f34bf2fd-ee77-479a-9817-c42264d8602c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.093245 Aug 31 00:49:19.124376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1040/2144] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:19 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:19.946402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0fb21af9-e46a-4386-b491-c7b8047fa9ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:19.947007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0fb21af9-e46a-4386-b491-c7b8047fa9ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:19.953447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb21af9-e46a-4386-b491-c7b8047fa9ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:19.953929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb21af9-e46a-4386-b491-c7b8047fa9ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:19.954361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb21af9-e46a-4386-b491-c7b8047fa9ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:19.955055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb21af9-e46a-4386-b491-c7b8047fa9ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:19.955520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb21af9-e46a-4386-b491-c7b8047fa9ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:19.955943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb21af9-e46a-4386-b491-c7b8047fa9ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:20.091491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0fb21af9-e46a-4386-b491-c7b8047fa9ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:20.099621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0fb21af9-e46a-4386-b491-c7b8047fa9ff tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157026 Aug 31 00:49:20.100174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1105/2145] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:19 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:20.146398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6d8d7ae1-47fb-4b12-a01a-32ad635252bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:20.146999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6d8d7ae1-47fb-4b12-a01a-32ad635252bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:20.153456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d8d7ae1-47fb-4b12-a01a-32ad635252bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:20.153930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d8d7ae1-47fb-4b12-a01a-32ad635252bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:20.154356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d8d7ae1-47fb-4b12-a01a-32ad635252bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:20.155029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d8d7ae1-47fb-4b12-a01a-32ad635252bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:20.155499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d8d7ae1-47fb-4b12-a01a-32ad635252bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:20.155914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6d8d7ae1-47fb-4b12-a01a-32ad635252bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:20.217735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6d8d7ae1-47fb-4b12-a01a-32ad635252bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:20.226066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6d8d7ae1-47fb-4b12-a01a-32ad635252bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084337 Aug 31 00:49:20.226624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1041/2146] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:20 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:21.121318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0ae62f5-d222-43db-8a71-784e4674fc00 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:21.121910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0ae62f5-d222-43db-8a71-784e4674fc00 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:21.124019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:49:21.124162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:49:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 (ip 10.222.0.67) !!! Aug 31 00:49:21.130487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0ae62f5-d222-43db-8a71-784e4674fc00 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:21.130972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0ae62f5-d222-43db-8a71-784e4674fc00 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:21.131434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0ae62f5-d222-43db-8a71-784e4674fc00 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:21.132120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0ae62f5-d222-43db-8a71-784e4674fc00 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:21.132570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0ae62f5-d222-43db-8a71-784e4674fc00 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:21.132991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0ae62f5-d222-43db-8a71-784e4674fc00 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:21.247684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f95e4449-d48a-4762-8ffe-a96c92d509ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:21.248241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f95e4449-d48a-4762-8ffe-a96c92d509ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:21.250158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:49:21.250383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:49:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 (ip 10.222.0.67) !!! Aug 31 00:49:21.252452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:49:21.252622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:49:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 (ip 10.222.0.67) !!! Aug 31 00:49:21.263904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0ae62f5-d222-43db-8a71-784e4674fc00 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:21.266056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:21.269792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f95e4449-d48a-4762-8ffe-a96c92d509ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:21.270284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f95e4449-d48a-4762-8ffe-a96c92d509ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:21.270724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f95e4449-d48a-4762-8ffe-a96c92d509ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:21.271498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f95e4449-d48a-4762-8ffe-a96c92d509ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:21.272184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f95e4449-d48a-4762-8ffe-a96c92d509ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:21.272817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f95e4449-d48a-4762-8ffe-a96c92d509ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:21.274067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0ae62f5-d222-43db-8a71-784e4674fc00 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156873 Aug 31 00:49:21.274642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1106/2147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:21 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:21.334305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f95e4449-d48a-4762-8ffe-a96c92d509ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:21.342543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f95e4449-d48a-4762-8ffe-a96c92d509ae tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.098791 Aug 31 00:49:21.343116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1042/2148] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:21 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:22.295170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-24c76126-2318-4dee-b17c-4ad4537710d7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:22.295717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-24c76126-2318-4dee-b17c-4ad4537710d7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:22.302085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24c76126-2318-4dee-b17c-4ad4537710d7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:22.303502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24c76126-2318-4dee-b17c-4ad4537710d7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:22.303502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24c76126-2318-4dee-b17c-4ad4537710d7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:22.303842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24c76126-2318-4dee-b17c-4ad4537710d7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:22.304290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24c76126-2318-4dee-b17c-4ad4537710d7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:22.304707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24c76126-2318-4dee-b17c-4ad4537710d7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:22.363447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5559e0fa-b636-4f7e-91ef-5ab03e6e3d2b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:22.364082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5559e0fa-b636-4f7e-91ef-5ab03e6e3d2b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:22.370731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5559e0fa-b636-4f7e-91ef-5ab03e6e3d2b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:22.371138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5559e0fa-b636-4f7e-91ef-5ab03e6e3d2b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:22.371538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5559e0fa-b636-4f7e-91ef-5ab03e6e3d2b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:22.372254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5559e0fa-b636-4f7e-91ef-5ab03e6e3d2b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:22.372676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5559e0fa-b636-4f7e-91ef-5ab03e6e3d2b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:22.373090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5559e0fa-b636-4f7e-91ef-5ab03e6e3d2b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:22.446593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5559e0fa-b636-4f7e-91ef-5ab03e6e3d2b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:22.454714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5559e0fa-b636-4f7e-91ef-5ab03e6e3d2b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.095081 Aug 31 00:49:22.455311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1043/2149] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:22 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:22.463971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-24c76126-2318-4dee-b17c-4ad4537710d7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:22.472126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-24c76126-2318-4dee-b17c-4ad4537710d7 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.180928 Aug 31 00:49:22.472680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1107/2150] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:22 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:23.476656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6f713f9d-2a24-46f9-83dc-c0661954f626 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:23.477265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6f713f9d-2a24-46f9-83dc-c0661954f626 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:23.484108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f713f9d-2a24-46f9-83dc-c0661954f626 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:23.484590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f713f9d-2a24-46f9-83dc-c0661954f626 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:23.485038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f713f9d-2a24-46f9-83dc-c0661954f626 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:23.485713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f713f9d-2a24-46f9-83dc-c0661954f626 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:23.486168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f713f9d-2a24-46f9-83dc-c0661954f626 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:23.486592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f713f9d-2a24-46f9-83dc-c0661954f626 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:23.493842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-58ba38a6-b49d-4909-ab3e-89970deefc90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:23.494485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-58ba38a6-b49d-4909-ab3e-89970deefc90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:23.500842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58ba38a6-b49d-4909-ab3e-89970deefc90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:23.501319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58ba38a6-b49d-4909-ab3e-89970deefc90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:23.502077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58ba38a6-b49d-4909-ab3e-89970deefc90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:23.502423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58ba38a6-b49d-4909-ab3e-89970deefc90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:23.502869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58ba38a6-b49d-4909-ab3e-89970deefc90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:23.503313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58ba38a6-b49d-4909-ab3e-89970deefc90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:23.551807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6f713f9d-2a24-46f9-83dc-c0661954f626 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:23.560996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6f713f9d-2a24-46f9-83dc-c0661954f626 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088258 Aug 31 00:49:23.561598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1044/2151] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:23 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:23.647501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-58ba38a6-b49d-4909-ab3e-89970deefc90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:23.655593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-58ba38a6-b49d-4909-ab3e-89970deefc90 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.166157 Aug 31 00:49:23.656157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1108/2152] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:23 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:24.582518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-24d94cfd-a218-4a76-90ad-27b81a3072d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:24.583142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-24d94cfd-a218-4a76-90ad-27b81a3072d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:24.589451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d94cfd-a218-4a76-90ad-27b81a3072d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:24.589923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d94cfd-a218-4a76-90ad-27b81a3072d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:24.590351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d94cfd-a218-4a76-90ad-27b81a3072d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:24.591020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d94cfd-a218-4a76-90ad-27b81a3072d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:24.591489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d94cfd-a218-4a76-90ad-27b81a3072d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:24.591899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d94cfd-a218-4a76-90ad-27b81a3072d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:24.657931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-24d94cfd-a218-4a76-90ad-27b81a3072d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:24.667028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-24d94cfd-a218-4a76-90ad-27b81a3072d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088305 Aug 31 00:49:24.667623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1045/2153] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:24 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:24.676396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-13162753-d4b4-4e61-a89a-da5872a6ef10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:24.677008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-13162753-d4b4-4e61-a89a-da5872a6ef10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:24.684794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13162753-d4b4-4e61-a89a-da5872a6ef10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:24.685280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13162753-d4b4-4e61-a89a-da5872a6ef10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:24.685717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13162753-d4b4-4e61-a89a-da5872a6ef10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:24.686436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13162753-d4b4-4e61-a89a-da5872a6ef10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:24.686887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13162753-d4b4-4e61-a89a-da5872a6ef10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:24.687373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13162753-d4b4-4e61-a89a-da5872a6ef10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:24.813799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13162753-d4b4-4e61-a89a-da5872a6ef10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:24.822561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-13162753-d4b4-4e61-a89a-da5872a6ef10 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.149970 Aug 31 00:49:24.823155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1109/2154] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:24 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:25.688600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f8689840-8fbe-4b6c-a0ea-eb445033e7f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:25.689202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f8689840-8fbe-4b6c-a0ea-eb445033e7f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:25.696517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8689840-8fbe-4b6c-a0ea-eb445033e7f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:25.696990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8689840-8fbe-4b6c-a0ea-eb445033e7f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:25.697506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8689840-8fbe-4b6c-a0ea-eb445033e7f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:25.698365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8689840-8fbe-4b6c-a0ea-eb445033e7f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:25.699169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8689840-8fbe-4b6c-a0ea-eb445033e7f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:25.699833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8689840-8fbe-4b6c-a0ea-eb445033e7f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:25.778113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f8689840-8fbe-4b6c-a0ea-eb445033e7f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:25.788966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f8689840-8fbe-4b6c-a0ea-eb445033e7f1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.103058 Aug 31 00:49:25.789549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1046/2155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:25 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:25.843832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-98f5f18a-50a8-4a01-8d1b-934d3a255d92 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:25.844864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-98f5f18a-50a8-4a01-8d1b-934d3a255d92 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:25.853245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98f5f18a-50a8-4a01-8d1b-934d3a255d92 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:25.853728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98f5f18a-50a8-4a01-8d1b-934d3a255d92 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:25.854162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98f5f18a-50a8-4a01-8d1b-934d3a255d92 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:25.854853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98f5f18a-50a8-4a01-8d1b-934d3a255d92 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:25.855691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98f5f18a-50a8-4a01-8d1b-934d3a255d92 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:25.856232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98f5f18a-50a8-4a01-8d1b-934d3a255d92 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:26.010927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-98f5f18a-50a8-4a01-8d1b-934d3a255d92 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:26.019190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-98f5f18a-50a8-4a01-8d1b-934d3a255d92 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.179246 Aug 31 00:49:26.019763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1110/2156] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:25 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:26.812257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7cd476ac-9e41-43d3-86f3-b3b41fce683d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:26.812843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7cd476ac-9e41-43d3-86f3-b3b41fce683d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:26.819452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cd476ac-9e41-43d3-86f3-b3b41fce683d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:26.819921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cd476ac-9e41-43d3-86f3-b3b41fce683d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:26.820344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cd476ac-9e41-43d3-86f3-b3b41fce683d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:26.821013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cd476ac-9e41-43d3-86f3-b3b41fce683d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:26.821452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cd476ac-9e41-43d3-86f3-b3b41fce683d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:26.821863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cd476ac-9e41-43d3-86f3-b3b41fce683d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:26.883520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7cd476ac-9e41-43d3-86f3-b3b41fce683d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:26.891660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7cd476ac-9e41-43d3-86f3-b3b41fce683d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083241 Aug 31 00:49:26.892225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1047/2157] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:26 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:27.043406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-44236b55-d81d-4f7e-8ab9-215ef4bbb892 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:27.043998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-44236b55-d81d-4f7e-8ab9-215ef4bbb892 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:27.054531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44236b55-d81d-4f7e-8ab9-215ef4bbb892 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:27.055011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44236b55-d81d-4f7e-8ab9-215ef4bbb892 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:27.055473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44236b55-d81d-4f7e-8ab9-215ef4bbb892 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:27.056161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44236b55-d81d-4f7e-8ab9-215ef4bbb892 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:27.056608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44236b55-d81d-4f7e-8ab9-215ef4bbb892 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:27.057277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44236b55-d81d-4f7e-8ab9-215ef4bbb892 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:27.196826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-44236b55-d81d-4f7e-8ab9-215ef4bbb892 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:27.205083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-44236b55-d81d-4f7e-8ab9-215ef4bbb892 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.167000 Aug 31 00:49:27.205646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1111/2158] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:27 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:27.913991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fa625046-1ce2-489c-bcf1-6d1b86d90c1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:27.914588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fa625046-1ce2-489c-bcf1-6d1b86d90c1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:27.921041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa625046-1ce2-489c-bcf1-6d1b86d90c1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:27.921513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa625046-1ce2-489c-bcf1-6d1b86d90c1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:27.921941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa625046-1ce2-489c-bcf1-6d1b86d90c1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:27.922621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa625046-1ce2-489c-bcf1-6d1b86d90c1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:27.923163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa625046-1ce2-489c-bcf1-6d1b86d90c1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:27.923619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa625046-1ce2-489c-bcf1-6d1b86d90c1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:27.985164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fa625046-1ce2-489c-bcf1-6d1b86d90c1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:27.993524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fa625046-1ce2-489c-bcf1-6d1b86d90c1d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084009 Aug 31 00:49:27.994635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1048/2159] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:27 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:28.227112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-672f55a5-c198-4af1-a5ce-4bd24f8bdeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:28.227677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-672f55a5-c198-4af1-a5ce-4bd24f8bdeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:28.234516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672f55a5-c198-4af1-a5ce-4bd24f8bdeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:28.234999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672f55a5-c198-4af1-a5ce-4bd24f8bdeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:28.236130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672f55a5-c198-4af1-a5ce-4bd24f8bdeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:28.236838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672f55a5-c198-4af1-a5ce-4bd24f8bdeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:28.237298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672f55a5-c198-4af1-a5ce-4bd24f8bdeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:28.237724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672f55a5-c198-4af1-a5ce-4bd24f8bdeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:28.372411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-672f55a5-c198-4af1-a5ce-4bd24f8bdeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:28.380453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-672f55a5-c198-4af1-a5ce-4bd24f8bdeec tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.158342 Aug 31 00:49:28.381763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1112/2160] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:28 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:29.013677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9fcf5b13-f392-4c57-a798-965d0e48c667 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:29.014283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9fcf5b13-f392-4c57-a798-965d0e48c667 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:29.020694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b13-f392-4c57-a798-965d0e48c667 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:29.021204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b13-f392-4c57-a798-965d0e48c667 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:29.021640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b13-f392-4c57-a798-965d0e48c667 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:29.022313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b13-f392-4c57-a798-965d0e48c667 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:29.022759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b13-f392-4c57-a798-965d0e48c667 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:29.023219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9fcf5b13-f392-4c57-a798-965d0e48c667 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:29.088397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9fcf5b13-f392-4c57-a798-965d0e48c667 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:29.096780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9fcf5b13-f392-4c57-a798-965d0e48c667 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086868 Aug 31 00:49:29.097337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1049/2161] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:29 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:29.406044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2d4eeaa8-ad60-4b72-843c-744530d5ca0d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:29.407060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2d4eeaa8-ad60-4b72-843c-744530d5ca0d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:29.415310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4eeaa8-ad60-4b72-843c-744530d5ca0d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:29.415802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4eeaa8-ad60-4b72-843c-744530d5ca0d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:29.416245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4eeaa8-ad60-4b72-843c-744530d5ca0d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:29.416940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4eeaa8-ad60-4b72-843c-744530d5ca0d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:29.417404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4eeaa8-ad60-4b72-843c-744530d5ca0d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:29.417825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4eeaa8-ad60-4b72-843c-744530d5ca0d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:29.544721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2d4eeaa8-ad60-4b72-843c-744530d5ca0d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:29.552822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2d4eeaa8-ad60-4b72-843c-744530d5ca0d tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151186 Aug 31 00:49:29.553382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1113/2162] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:29 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:30.119166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3d537012-dcd1-418a-bd73-42480c5d5e49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:30.119771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3d537012-dcd1-418a-bd73-42480c5d5e49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:30.125673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d537012-dcd1-418a-bd73-42480c5d5e49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:30.126154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d537012-dcd1-418a-bd73-42480c5d5e49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:30.126588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d537012-dcd1-418a-bd73-42480c5d5e49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:30.127298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d537012-dcd1-418a-bd73-42480c5d5e49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:30.127752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d537012-dcd1-418a-bd73-42480c5d5e49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:30.128170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d537012-dcd1-418a-bd73-42480c5d5e49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:30.189354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3d537012-dcd1-418a-bd73-42480c5d5e49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:30.198437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3d537012-dcd1-418a-bd73-42480c5d5e49 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083639 Aug 31 00:49:30.199001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1050/2163] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:30 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:30.574371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fb26f6cd-dfdf-4b24-ad79-45a6328d6499 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:30.574979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fb26f6cd-dfdf-4b24-ad79-45a6328d6499 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:30.581418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb26f6cd-dfdf-4b24-ad79-45a6328d6499 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:30.581896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb26f6cd-dfdf-4b24-ad79-45a6328d6499 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:30.582325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb26f6cd-dfdf-4b24-ad79-45a6328d6499 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:30.583006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb26f6cd-dfdf-4b24-ad79-45a6328d6499 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:30.583485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb26f6cd-dfdf-4b24-ad79-45a6328d6499 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:30.584704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fb26f6cd-dfdf-4b24-ad79-45a6328d6499 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:30.713429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fb26f6cd-dfdf-4b24-ad79-45a6328d6499 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:30.721779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fb26f6cd-dfdf-4b24-ad79-45a6328d6499 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.151416 Aug 31 00:49:30.722341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1114/2164] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:30 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:31.219656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e043b7cc-e9d5-4eb7-83ae-c5177de33417 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:31.220367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e043b7cc-e9d5-4eb7-83ae-c5177de33417 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:31.227261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e043b7cc-e9d5-4eb7-83ae-c5177de33417 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:31.227743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e043b7cc-e9d5-4eb7-83ae-c5177de33417 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:31.228171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e043b7cc-e9d5-4eb7-83ae-c5177de33417 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:31.228862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e043b7cc-e9d5-4eb7-83ae-c5177de33417 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:31.229309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e043b7cc-e9d5-4eb7-83ae-c5177de33417 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:31.229730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e043b7cc-e9d5-4eb7-83ae-c5177de33417 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:31.292030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e043b7cc-e9d5-4eb7-83ae-c5177de33417 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:31.300365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e043b7cc-e9d5-4eb7-83ae-c5177de33417 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084660 Aug 31 00:49:31.300926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1051/2165] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:31 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:31.743413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c38b6f36-6622-4416-971a-bf4f5d1edfaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:31.744036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c38b6f36-6622-4416-971a-bf4f5d1edfaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:31.750509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c38b6f36-6622-4416-971a-bf4f5d1edfaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:31.750982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c38b6f36-6622-4416-971a-bf4f5d1edfaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:31.751437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c38b6f36-6622-4416-971a-bf4f5d1edfaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:31.752109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c38b6f36-6622-4416-971a-bf4f5d1edfaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:31.752556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c38b6f36-6622-4416-971a-bf4f5d1edfaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:31.752971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c38b6f36-6622-4416-971a-bf4f5d1edfaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:31.887918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c38b6f36-6622-4416-971a-bf4f5d1edfaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:31.896481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c38b6f36-6622-4416-971a-bf4f5d1edfaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156723 Aug 31 00:49:31.897214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1115/2166] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:31 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:32.322922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a5e88600-4785-4d4c-90fb-c03bb59b8e86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:32.323512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a5e88600-4785-4d4c-90fb-c03bb59b8e86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:32.329352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e88600-4785-4d4c-90fb-c03bb59b8e86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:32.329836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e88600-4785-4d4c-90fb-c03bb59b8e86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:32.330270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e88600-4785-4d4c-90fb-c03bb59b8e86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:32.330951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e88600-4785-4d4c-90fb-c03bb59b8e86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:32.331432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e88600-4785-4d4c-90fb-c03bb59b8e86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:32.331853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e88600-4785-4d4c-90fb-c03bb59b8e86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:32.402079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a5e88600-4785-4d4c-90fb-c03bb59b8e86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:32.410737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a5e88600-4785-4d4c-90fb-c03bb59b8e86 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.092771 Aug 31 00:49:32.411397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1052/2167] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:32 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:32.917706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04dd9a5b-789c-4f2c-8f93-672e48842715 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:32.918246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-04dd9a5b-789c-4f2c-8f93-672e48842715 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:32.924625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04dd9a5b-789c-4f2c-8f93-672e48842715 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:32.925104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04dd9a5b-789c-4f2c-8f93-672e48842715 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:32.925530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04dd9a5b-789c-4f2c-8f93-672e48842715 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:32.926205 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04dd9a5b-789c-4f2c-8f93-672e48842715 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:32.926646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04dd9a5b-789c-4f2c-8f93-672e48842715 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:32.927076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04dd9a5b-789c-4f2c-8f93-672e48842715 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:33.053815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-04dd9a5b-789c-4f2c-8f93-672e48842715 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:33.061884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-04dd9a5b-789c-4f2c-8f93-672e48842715 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.148079 Aug 31 00:49:33.062442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1116/2168] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:32 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:33.433102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-40763828-a8d3-4237-acfd-a6b903fe4edb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:33.433703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-40763828-a8d3-4237-acfd-a6b903fe4edb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:33.440048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40763828-a8d3-4237-acfd-a6b903fe4edb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:33.440525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40763828-a8d3-4237-acfd-a6b903fe4edb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:33.441022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40763828-a8d3-4237-acfd-a6b903fe4edb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:33.441701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40763828-a8d3-4237-acfd-a6b903fe4edb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:33.442148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40763828-a8d3-4237-acfd-a6b903fe4edb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:33.442566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40763828-a8d3-4237-acfd-a6b903fe4edb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:33.506675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-40763828-a8d3-4237-acfd-a6b903fe4edb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:33.514933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-40763828-a8d3-4237-acfd-a6b903fe4edb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086055 Aug 31 00:49:33.515521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1053/2169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:33 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:34.082359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-21a32fc0-f78b-4a94-a5eb-e3bac8bcf763 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:34.082962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-21a32fc0-f78b-4a94-a5eb-e3bac8bcf763 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:34.089871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a32fc0-f78b-4a94-a5eb-e3bac8bcf763 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:34.090341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a32fc0-f78b-4a94-a5eb-e3bac8bcf763 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:34.090767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a32fc0-f78b-4a94-a5eb-e3bac8bcf763 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:34.091472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a32fc0-f78b-4a94-a5eb-e3bac8bcf763 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:34.091917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a32fc0-f78b-4a94-a5eb-e3bac8bcf763 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:34.092328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a32fc0-f78b-4a94-a5eb-e3bac8bcf763 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:34.223909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-21a32fc0-f78b-4a94-a5eb-e3bac8bcf763 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:34.232396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-21a32fc0-f78b-4a94-a5eb-e3bac8bcf763 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153935 Aug 31 00:49:34.232980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1117/2170] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:34 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:34.537071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-68a0d681-8f03-4059-bc3b-eebc3ff146df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:34.537818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-68a0d681-8f03-4059-bc3b-eebc3ff146df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:34.543856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68a0d681-8f03-4059-bc3b-eebc3ff146df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:34.544370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68a0d681-8f03-4059-bc3b-eebc3ff146df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:34.544802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68a0d681-8f03-4059-bc3b-eebc3ff146df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:34.545482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68a0d681-8f03-4059-bc3b-eebc3ff146df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:34.546131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68a0d681-8f03-4059-bc3b-eebc3ff146df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:34.546560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68a0d681-8f03-4059-bc3b-eebc3ff146df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:34.607641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-68a0d681-8f03-4059-bc3b-eebc3ff146df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:34.609863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:34.618021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-68a0d681-8f03-4059-bc3b-eebc3ff146df tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085476 Aug 31 00:49:34.618600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1054/2171] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:35.254259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7676c821-22e8-48d6-a38c-d14ae53f7f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:35.254819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7676c821-22e8-48d6-a38c-d14ae53f7f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:35.262017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7676c821-22e8-48d6-a38c-d14ae53f7f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:35.262493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7676c821-22e8-48d6-a38c-d14ae53f7f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:35.262924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7676c821-22e8-48d6-a38c-d14ae53f7f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:35.263628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7676c821-22e8-48d6-a38c-d14ae53f7f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:35.264075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7676c821-22e8-48d6-a38c-d14ae53f7f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:35.264489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7676c821-22e8-48d6-a38c-d14ae53f7f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:35.395164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7676c821-22e8-48d6-a38c-d14ae53f7f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:35.403748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7676c821-22e8-48d6-a38c-d14ae53f7f68 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153415 Aug 31 00:49:35.404322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1118/2172] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:35 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:35.638652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-348fe760-3bd0-4cf8-8dce-a2ab84e73606 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:35.639299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-348fe760-3bd0-4cf8-8dce-a2ab84e73606 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:35.645909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-348fe760-3bd0-4cf8-8dce-a2ab84e73606 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:35.646461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-348fe760-3bd0-4cf8-8dce-a2ab84e73606 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:35.646900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-348fe760-3bd0-4cf8-8dce-a2ab84e73606 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:35.647614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-348fe760-3bd0-4cf8-8dce-a2ab84e73606 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:35.648068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-348fe760-3bd0-4cf8-8dce-a2ab84e73606 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:35.648490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-348fe760-3bd0-4cf8-8dce-a2ab84e73606 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:35.711662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-348fe760-3bd0-4cf8-8dce-a2ab84e73606 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:35.719801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-348fe760-3bd0-4cf8-8dce-a2ab84e73606 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085041 Aug 31 00:49:35.720356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1055/2173] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:35 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:36.425173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c72d17a0-a561-436a-ab69-34825d355641 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:36.425782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c72d17a0-a561-436a-ab69-34825d355641 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:36.432129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72d17a0-a561-436a-ab69-34825d355641 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:36.432597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72d17a0-a561-436a-ab69-34825d355641 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:36.433022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72d17a0-a561-436a-ab69-34825d355641 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:36.433688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72d17a0-a561-436a-ab69-34825d355641 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:36.434130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72d17a0-a561-436a-ab69-34825d355641 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:36.434540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72d17a0-a561-436a-ab69-34825d355641 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:36.560626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c72d17a0-a561-436a-ab69-34825d355641 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:36.569422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c72d17a0-a561-436a-ab69-34825d355641 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.148155 Aug 31 00:49:36.569986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1119/2174] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:36 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:36.745683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6f7a8a6b-eeec-43fd-9c56-e380a681c0fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:36.746213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6f7a8a6b-eeec-43fd-9c56-e380a681c0fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:36.752578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f7a8a6b-eeec-43fd-9c56-e380a681c0fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:36.753051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f7a8a6b-eeec-43fd-9c56-e380a681c0fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:36.753476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f7a8a6b-eeec-43fd-9c56-e380a681c0fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:36.754147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f7a8a6b-eeec-43fd-9c56-e380a681c0fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:36.754588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f7a8a6b-eeec-43fd-9c56-e380a681c0fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:36.755001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6f7a8a6b-eeec-43fd-9c56-e380a681c0fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:36.815894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6f7a8a6b-eeec-43fd-9c56-e380a681c0fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:36.824782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6f7a8a6b-eeec-43fd-9c56-e380a681c0fb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083177 Aug 31 00:49:36.825340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1056/2175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:36 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:37.590351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-794c6844-db04-4986-a785-a2e3aab93138 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:37.590957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-794c6844-db04-4986-a785-a2e3aab93138 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:37.597405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794c6844-db04-4986-a785-a2e3aab93138 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:37.597897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794c6844-db04-4986-a785-a2e3aab93138 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:37.598325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794c6844-db04-4986-a785-a2e3aab93138 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:37.599559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794c6844-db04-4986-a785-a2e3aab93138 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:37.600101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794c6844-db04-4986-a785-a2e3aab93138 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:37.600549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-794c6844-db04-4986-a785-a2e3aab93138 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:37.738288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-794c6844-db04-4986-a785-a2e3aab93138 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:37.747353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-794c6844-db04-4986-a785-a2e3aab93138 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.160864 Aug 31 00:49:37.747925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1120/2176] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:37 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:37.846514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-97bd2d2e-7271-47c2-a460-b0f25af852f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:37.847153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-97bd2d2e-7271-47c2-a460-b0f25af852f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:37.849450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=56 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:37.854649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97bd2d2e-7271-47c2-a460-b0f25af852f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:37.855212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97bd2d2e-7271-47c2-a460-b0f25af852f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:37.855858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97bd2d2e-7271-47c2-a460-b0f25af852f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:37.856539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97bd2d2e-7271-47c2-a460-b0f25af852f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:37.856987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97bd2d2e-7271-47c2-a460-b0f25af852f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:37.857407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97bd2d2e-7271-47c2-a460-b0f25af852f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:37.918170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-97bd2d2e-7271-47c2-a460-b0f25af852f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:37.926303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-97bd2d2e-7271-47c2-a460-b0f25af852f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083689 Aug 31 00:49:37.927403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1057/2177] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:37 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:38.768974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7f321762-d85d-4fe3-ba7a-820f57f2a925 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:38.769618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7f321762-d85d-4fe3-ba7a-820f57f2a925 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:38.777917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f321762-d85d-4fe3-ba7a-820f57f2a925 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:38.778404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f321762-d85d-4fe3-ba7a-820f57f2a925 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:38.778836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f321762-d85d-4fe3-ba7a-820f57f2a925 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:38.779561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f321762-d85d-4fe3-ba7a-820f57f2a925 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:38.780015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f321762-d85d-4fe3-ba7a-820f57f2a925 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:38.780440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f321762-d85d-4fe3-ba7a-820f57f2a925 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:38.906813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7f321762-d85d-4fe3-ba7a-820f57f2a925 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:38.915061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7f321762-d85d-4fe3-ba7a-820f57f2a925 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.150060 Aug 31 00:49:38.915645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1121/2178] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:38 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:38.948469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f39d9ffa-533c-4e82-be47-623a27a8e137 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:38.949075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f39d9ffa-533c-4e82-be47-623a27a8e137 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:38.955177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f39d9ffa-533c-4e82-be47-623a27a8e137 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:38.955662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f39d9ffa-533c-4e82-be47-623a27a8e137 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:38.956096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f39d9ffa-533c-4e82-be47-623a27a8e137 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:38.956773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f39d9ffa-533c-4e82-be47-623a27a8e137 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:38.957226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f39d9ffa-533c-4e82-be47-623a27a8e137 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:38.957646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f39d9ffa-533c-4e82-be47-623a27a8e137 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:39.022154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f39d9ffa-533c-4e82-be47-623a27a8e137 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:39.030535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f39d9ffa-533c-4e82-be47-623a27a8e137 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085871 Aug 31 00:49:39.031133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1058/2179] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:38 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:39.935719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1d8b9fee-33bd-4c8d-bc0e-e59f89b674d4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:39.936340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1d8b9fee-33bd-4c8d-bc0e-e59f89b674d4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:39.942772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d8b9fee-33bd-4c8d-bc0e-e59f89b674d4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:39.943383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d8b9fee-33bd-4c8d-bc0e-e59f89b674d4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:39.943823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d8b9fee-33bd-4c8d-bc0e-e59f89b674d4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:39.944499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d8b9fee-33bd-4c8d-bc0e-e59f89b674d4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:39.944948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d8b9fee-33bd-4c8d-bc0e-e59f89b674d4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:39.945365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d8b9fee-33bd-4c8d-bc0e-e59f89b674d4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:40.052258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e0eb47bd-a089-496b-8d7b-31ff30af70f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:40.052960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e0eb47bd-a089-496b-8d7b-31ff30af70f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:40.059636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0eb47bd-a089-496b-8d7b-31ff30af70f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:40.060116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0eb47bd-a089-496b-8d7b-31ff30af70f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:40.060540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0eb47bd-a089-496b-8d7b-31ff30af70f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:40.061229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0eb47bd-a089-496b-8d7b-31ff30af70f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:40.061678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0eb47bd-a089-496b-8d7b-31ff30af70f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:40.062092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0eb47bd-a089-496b-8d7b-31ff30af70f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:40.289434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e0eb47bd-a089-496b-8d7b-31ff30af70f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:40.297797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e0eb47bd-a089-496b-8d7b-31ff30af70f6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.249366 Aug 31 00:49:40.298368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1059/2180] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:40 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:40.348178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1d8b9fee-33bd-4c8d-bc0e-e59f89b674d4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:40.356934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1d8b9fee-33bd-4c8d-bc0e-e59f89b674d4 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.425054 Aug 31 00:49:40.357503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1122/2181] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:39 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:41.320297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-83e99a63-4320-4656-acb4-755307a9fda2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:41.320886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-83e99a63-4320-4656-acb4-755307a9fda2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:41.327243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83e99a63-4320-4656-acb4-755307a9fda2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:41.327715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83e99a63-4320-4656-acb4-755307a9fda2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:41.328141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83e99a63-4320-4656-acb4-755307a9fda2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:41.328811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83e99a63-4320-4656-acb4-755307a9fda2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:41.329256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83e99a63-4320-4656-acb4-755307a9fda2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:41.329667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83e99a63-4320-4656-acb4-755307a9fda2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:41.377235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-872ec003-ed00-44a2-aec6-f9d08aa0ad4c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:41.377837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-872ec003-ed00-44a2-aec6-f9d08aa0ad4c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:41.380839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:41.386473 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872ec003-ed00-44a2-aec6-f9d08aa0ad4c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:41.386990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872ec003-ed00-44a2-aec6-f9d08aa0ad4c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:41.387443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872ec003-ed00-44a2-aec6-f9d08aa0ad4c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:41.388128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872ec003-ed00-44a2-aec6-f9d08aa0ad4c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:41.388568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872ec003-ed00-44a2-aec6-f9d08aa0ad4c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:41.388981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872ec003-ed00-44a2-aec6-f9d08aa0ad4c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:41.396709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-83e99a63-4320-4656-acb4-755307a9fda2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:41.404850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:41.405039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-83e99a63-4320-4656-acb4-755307a9fda2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089281 Aug 31 00:49:41.405522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1060/2182] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:41 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:41.522021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-872ec003-ed00-44a2-aec6-f9d08aa0ad4c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:41.530332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-872ec003-ed00-44a2-aec6-f9d08aa0ad4c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156897 Aug 31 00:49:41.530917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1123/2183] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:41 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:42.427938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ccdaf7d8-4005-4d53-812f-71e515e0bcce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:42.428538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ccdaf7d8-4005-4d53-812f-71e515e0bcce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:42.434941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccdaf7d8-4005-4d53-812f-71e515e0bcce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:42.435447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccdaf7d8-4005-4d53-812f-71e515e0bcce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:42.435879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccdaf7d8-4005-4d53-812f-71e515e0bcce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:42.436560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccdaf7d8-4005-4d53-812f-71e515e0bcce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:42.437008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccdaf7d8-4005-4d53-812f-71e515e0bcce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:42.437429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccdaf7d8-4005-4d53-812f-71e515e0bcce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:42.514593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ccdaf7d8-4005-4d53-812f-71e515e0bcce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:42.523303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ccdaf7d8-4005-4d53-812f-71e515e0bcce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.099874 Aug 31 00:49:42.523898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1061/2184] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:42 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:42.553050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1224f63c-d3fc-4c20-bac2-84a799341f1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:42.553702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1224f63c-d3fc-4c20-bac2-84a799341f1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:42.560595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1224f63c-d3fc-4c20-bac2-84a799341f1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:42.561074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1224f63c-d3fc-4c20-bac2-84a799341f1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:42.561526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1224f63c-d3fc-4c20-bac2-84a799341f1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:42.562195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1224f63c-d3fc-4c20-bac2-84a799341f1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:42.562656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1224f63c-d3fc-4c20-bac2-84a799341f1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:42.563109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1224f63c-d3fc-4c20-bac2-84a799341f1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:42.697222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1224f63c-d3fc-4c20-bac2-84a799341f1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:42.705537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1224f63c-d3fc-4c20-bac2-84a799341f1f tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157243 Aug 31 00:49:42.706102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1124/2185] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:42 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:43.544968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8ad25d21-8732-41f6-ae08-bdf95ca9794f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:43.545577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8ad25d21-8732-41f6-ae08-bdf95ca9794f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:43.552786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ad25d21-8732-41f6-ae08-bdf95ca9794f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:43.553270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ad25d21-8732-41f6-ae08-bdf95ca9794f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:43.553752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ad25d21-8732-41f6-ae08-bdf95ca9794f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:43.554430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ad25d21-8732-41f6-ae08-bdf95ca9794f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:43.555023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ad25d21-8732-41f6-ae08-bdf95ca9794f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:43.555531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ad25d21-8732-41f6-ae08-bdf95ca9794f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:43.617027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8ad25d21-8732-41f6-ae08-bdf95ca9794f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:43.625323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8ad25d21-8732-41f6-ae08-bdf95ca9794f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084155 Aug 31 00:49:43.625887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1062/2186] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:43 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:43.728415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2af2d8e7-6bb4-4074-892d-b98b87c4ec80 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:43.729006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2af2d8e7-6bb4-4074-892d-b98b87c4ec80 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:43.735694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af2d8e7-6bb4-4074-892d-b98b87c4ec80 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:43.736168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af2d8e7-6bb4-4074-892d-b98b87c4ec80 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:43.736591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af2d8e7-6bb4-4074-892d-b98b87c4ec80 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:43.737264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af2d8e7-6bb4-4074-892d-b98b87c4ec80 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:43.737703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af2d8e7-6bb4-4074-892d-b98b87c4ec80 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:43.738121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2af2d8e7-6bb4-4074-892d-b98b87c4ec80 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:43.868928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2af2d8e7-6bb4-4074-892d-b98b87c4ec80 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:43.877232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2af2d8e7-6bb4-4074-892d-b98b87c4ec80 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153154 Aug 31 00:49:43.877801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1125/2187] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:43 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:44.645926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2bce769b-2257-4238-8a3b-ef2aaf88cc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:44.646588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2bce769b-2257-4238-8a3b-ef2aaf88cc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:44.653011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bce769b-2257-4238-8a3b-ef2aaf88cc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:44.653482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bce769b-2257-4238-8a3b-ef2aaf88cc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:44.653905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bce769b-2257-4238-8a3b-ef2aaf88cc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:44.654580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bce769b-2257-4238-8a3b-ef2aaf88cc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:44.655020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bce769b-2257-4238-8a3b-ef2aaf88cc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:44.655459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2bce769b-2257-4238-8a3b-ef2aaf88cc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:44.718436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2bce769b-2257-4238-8a3b-ef2aaf88cc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:44.726755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2bce769b-2257-4238-8a3b-ef2aaf88cc0a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084825 Aug 31 00:49:44.727346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1063/2188] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:44 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:44.898268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-89ec4993-7967-42e9-8728-c70f3a2a630a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:44.898805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-89ec4993-7967-42e9-8728-c70f3a2a630a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:44.905216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89ec4993-7967-42e9-8728-c70f3a2a630a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:44.905689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89ec4993-7967-42e9-8728-c70f3a2a630a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:44.906111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89ec4993-7967-42e9-8728-c70f3a2a630a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:44.906780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89ec4993-7967-42e9-8728-c70f3a2a630a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:44.907249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89ec4993-7967-42e9-8728-c70f3a2a630a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:44.907665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89ec4993-7967-42e9-8728-c70f3a2a630a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:45.033245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-89ec4993-7967-42e9-8728-c70f3a2a630a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:45.041648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-89ec4993-7967-42e9-8728-c70f3a2a630a tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.147855 Aug 31 00:49:45.042219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1126/2189] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:44 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:45.748609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-22f0ac81-ebc8-461e-8bfa-b3b283894bd4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:45.749246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-22f0ac81-ebc8-461e-8bfa-b3b283894bd4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:45.755787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22f0ac81-ebc8-461e-8bfa-b3b283894bd4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:45.756257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22f0ac81-ebc8-461e-8bfa-b3b283894bd4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:45.756686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22f0ac81-ebc8-461e-8bfa-b3b283894bd4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:45.757365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22f0ac81-ebc8-461e-8bfa-b3b283894bd4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:45.757843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22f0ac81-ebc8-461e-8bfa-b3b283894bd4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:45.758263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22f0ac81-ebc8-461e-8bfa-b3b283894bd4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:45.818681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-22f0ac81-ebc8-461e-8bfa-b3b283894bd4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:45.826858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-22f0ac81-ebc8-461e-8bfa-b3b283894bd4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082085 Aug 31 00:49:45.827430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1064/2190] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:45 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:46.063137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c99cc54c-11b5-4b6d-805e-931cbc210107 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:46.063731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c99cc54c-11b5-4b6d-805e-931cbc210107 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:46.071905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99cc54c-11b5-4b6d-805e-931cbc210107 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:46.072545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99cc54c-11b5-4b6d-805e-931cbc210107 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:46.072977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99cc54c-11b5-4b6d-805e-931cbc210107 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:46.073660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99cc54c-11b5-4b6d-805e-931cbc210107 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:46.074108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99cc54c-11b5-4b6d-805e-931cbc210107 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:46.074527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99cc54c-11b5-4b6d-805e-931cbc210107 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:46.205083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c99cc54c-11b5-4b6d-805e-931cbc210107 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:46.214079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c99cc54c-11b5-4b6d-805e-931cbc210107 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155055 Aug 31 00:49:46.214646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1127/2191] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:46 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:46.847939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f4a6611a-2105-4467-b1ca-1ddb9a5646d3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:46.848766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f4a6611a-2105-4467-b1ca-1ddb9a5646d3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:46.855599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4a6611a-2105-4467-b1ca-1ddb9a5646d3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:46.856073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4a6611a-2105-4467-b1ca-1ddb9a5646d3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:46.856501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4a6611a-2105-4467-b1ca-1ddb9a5646d3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:46.857176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4a6611a-2105-4467-b1ca-1ddb9a5646d3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:46.857623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4a6611a-2105-4467-b1ca-1ddb9a5646d3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:46.858036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4a6611a-2105-4467-b1ca-1ddb9a5646d3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:46.918843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f4a6611a-2105-4467-b1ca-1ddb9a5646d3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:46.927660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f4a6611a-2105-4467-b1ca-1ddb9a5646d3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083603 Aug 31 00:49:46.928213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1065/2192] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:46 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:47.236188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-185a718b-89e7-47c3-867b-2072a4213867 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:47.236755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-185a718b-89e7-47c3-867b-2072a4213867 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:47.244068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-185a718b-89e7-47c3-867b-2072a4213867 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:47.244552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-185a718b-89e7-47c3-867b-2072a4213867 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:47.244989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-185a718b-89e7-47c3-867b-2072a4213867 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:47.245679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-185a718b-89e7-47c3-867b-2072a4213867 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:47.246133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-185a718b-89e7-47c3-867b-2072a4213867 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:47.246557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-185a718b-89e7-47c3-867b-2072a4213867 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:47.372410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-185a718b-89e7-47c3-867b-2072a4213867 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:47.380971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-185a718b-89e7-47c3-867b-2072a4213867 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.148782 Aug 31 00:49:47.381546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1128/2193] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:47 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:47.949504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e4bf27a9-a224-463c-897e-e62be74132d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:47.950117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e4bf27a9-a224-463c-897e-e62be74132d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:47.956576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4bf27a9-a224-463c-897e-e62be74132d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:47.957054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4bf27a9-a224-463c-897e-e62be74132d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:47.957481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4bf27a9-a224-463c-897e-e62be74132d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:47.959024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4bf27a9-a224-463c-897e-e62be74132d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:47.959497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4bf27a9-a224-463c-897e-e62be74132d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:47.959916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4bf27a9-a224-463c-897e-e62be74132d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:48.027448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e4bf27a9-a224-463c-897e-e62be74132d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:48.035614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e4bf27a9-a224-463c-897e-e62be74132d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090078 Aug 31 00:49:48.036579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1066/2194] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:47 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:48.403677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a22c060b-b89c-4fa4-b32b-a223be204251 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:48.404289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a22c060b-b89c-4fa4-b32b-a223be204251 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:48.411418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c060b-b89c-4fa4-b32b-a223be204251 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:48.412208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c060b-b89c-4fa4-b32b-a223be204251 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:48.412781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c060b-b89c-4fa4-b32b-a223be204251 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:48.413509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c060b-b89c-4fa4-b32b-a223be204251 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:48.413961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c060b-b89c-4fa4-b32b-a223be204251 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:48.414390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c060b-b89c-4fa4-b32b-a223be204251 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:48.547887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a22c060b-b89c-4fa4-b32b-a223be204251 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:48.556822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a22c060b-b89c-4fa4-b32b-a223be204251 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157140 Aug 31 00:49:48.557392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1129/2195] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:48 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:49.057133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-933ed07b-b629-481a-bea3-08b504e75024 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:49.057734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-933ed07b-b629-481a-bea3-08b504e75024 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:49.064229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-933ed07b-b629-481a-bea3-08b504e75024 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:49.064709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-933ed07b-b629-481a-bea3-08b504e75024 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:49.065144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-933ed07b-b629-481a-bea3-08b504e75024 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:49.065826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-933ed07b-b629-481a-bea3-08b504e75024 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:49.066280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-933ed07b-b629-481a-bea3-08b504e75024 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:49.066700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-933ed07b-b629-481a-bea3-08b504e75024 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:49.128943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-933ed07b-b629-481a-bea3-08b504e75024 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:49.137276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-933ed07b-b629-481a-bea3-08b504e75024 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084074 Aug 31 00:49:49.137835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1067/2196] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:49 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:49.579611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-78447255-67ca-42b4-a47b-c2a7e31a24c2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:49.580217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-78447255-67ca-42b4-a47b-c2a7e31a24c2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:49.587291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78447255-67ca-42b4-a47b-c2a7e31a24c2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:49.587765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78447255-67ca-42b4-a47b-c2a7e31a24c2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:49.588192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78447255-67ca-42b4-a47b-c2a7e31a24c2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:49.588859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78447255-67ca-42b4-a47b-c2a7e31a24c2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:49.589300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78447255-67ca-42b4-a47b-c2a7e31a24c2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:49.589710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78447255-67ca-42b4-a47b-c2a7e31a24c2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:49.719158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-78447255-67ca-42b4-a47b-c2a7e31a24c2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:49.727969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-78447255-67ca-42b4-a47b-c2a7e31a24c2 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.152234 Aug 31 00:49:49.728533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1130/2197] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:49 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:50.158915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b86a0d7d-dcf7-4098-9b74-ee09fdeaa79b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:50.159549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b86a0d7d-dcf7-4098-9b74-ee09fdeaa79b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:50.166166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b86a0d7d-dcf7-4098-9b74-ee09fdeaa79b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:50.166644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b86a0d7d-dcf7-4098-9b74-ee09fdeaa79b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:50.167101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b86a0d7d-dcf7-4098-9b74-ee09fdeaa79b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:50.167786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b86a0d7d-dcf7-4098-9b74-ee09fdeaa79b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:50.168233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b86a0d7d-dcf7-4098-9b74-ee09fdeaa79b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:50.168648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b86a0d7d-dcf7-4098-9b74-ee09fdeaa79b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:50.229545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b86a0d7d-dcf7-4098-9b74-ee09fdeaa79b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:50.237876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b86a0d7d-dcf7-4098-9b74-ee09fdeaa79b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082843 Aug 31 00:49:50.238433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1068/2198] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:50 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:50.755406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ad0ec2b0-055e-4f8b-bb74-3deae6d40eaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:50.756143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ad0ec2b0-055e-4f8b-bb74-3deae6d40eaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:50.762154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad0ec2b0-055e-4f8b-bb74-3deae6d40eaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:50.762639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad0ec2b0-055e-4f8b-bb74-3deae6d40eaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:50.763104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad0ec2b0-055e-4f8b-bb74-3deae6d40eaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:50.763796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad0ec2b0-055e-4f8b-bb74-3deae6d40eaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:50.764247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad0ec2b0-055e-4f8b-bb74-3deae6d40eaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:50.764668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ad0ec2b0-055e-4f8b-bb74-3deae6d40eaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:50.895945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ad0ec2b0-055e-4f8b-bb74-3deae6d40eaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:50.904099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ad0ec2b0-055e-4f8b-bb74-3deae6d40eaa tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156634 Aug 31 00:49:50.904670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1131/2199] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:50 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:51.259527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f93216b4-1370-4f82-b686-aec1f5143cad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:51.260110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f93216b4-1370-4f82-b686-aec1f5143cad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:51.266757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f93216b4-1370-4f82-b686-aec1f5143cad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:51.267282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f93216b4-1370-4f82-b686-aec1f5143cad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:51.267709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f93216b4-1370-4f82-b686-aec1f5143cad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:51.268380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f93216b4-1370-4f82-b686-aec1f5143cad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:51.268823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f93216b4-1370-4f82-b686-aec1f5143cad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:51.269236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f93216b4-1370-4f82-b686-aec1f5143cad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:51.332319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f93216b4-1370-4f82-b686-aec1f5143cad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:51.340508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f93216b4-1370-4f82-b686-aec1f5143cad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084761 Aug 31 00:49:51.341065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1069/2200] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:51 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:51.924973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b42f9b99-8c12-40ce-ba93-7d2739c56ac0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:51.925572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b42f9b99-8c12-40ce-ba93-7d2739c56ac0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:51.932268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42f9b99-8c12-40ce-ba93-7d2739c56ac0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:51.932746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42f9b99-8c12-40ce-ba93-7d2739c56ac0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:51.933174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42f9b99-8c12-40ce-ba93-7d2739c56ac0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:51.933846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42f9b99-8c12-40ce-ba93-7d2739c56ac0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:51.934286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42f9b99-8c12-40ce-ba93-7d2739c56ac0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:51.934700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42f9b99-8c12-40ce-ba93-7d2739c56ac0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:52.069043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b42f9b99-8c12-40ce-ba93-7d2739c56ac0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:52.077206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b42f9b99-8c12-40ce-ba93-7d2739c56ac0 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.156091 Aug 31 00:49:52.077779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1132/2201] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:51 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:52.360699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-902070cf-0c63-42f3-986f-89f127378cef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:52.361308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-902070cf-0c63-42f3-986f-89f127378cef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:52.367980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-902070cf-0c63-42f3-986f-89f127378cef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:52.368607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-902070cf-0c63-42f3-986f-89f127378cef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:52.369044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-902070cf-0c63-42f3-986f-89f127378cef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:52.369735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-902070cf-0c63-42f3-986f-89f127378cef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:52.370187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-902070cf-0c63-42f3-986f-89f127378cef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:52.370607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-902070cf-0c63-42f3-986f-89f127378cef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:52.433608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-902070cf-0c63-42f3-986f-89f127378cef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:52.442349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-902070cf-0c63-42f3-986f-89f127378cef tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084958 Aug 31 00:49:52.443076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1070/2202] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:52 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:53.099486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-12786dea-3722-4f12-aa32-0896dfa65f19 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:53.100094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-12786dea-3722-4f12-aa32-0896dfa65f19 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:53.107017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12786dea-3722-4f12-aa32-0896dfa65f19 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:53.107521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12786dea-3722-4f12-aa32-0896dfa65f19 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:53.107951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12786dea-3722-4f12-aa32-0896dfa65f19 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:53.108629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12786dea-3722-4f12-aa32-0896dfa65f19 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:53.109079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12786dea-3722-4f12-aa32-0896dfa65f19 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:53.109496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12786dea-3722-4f12-aa32-0896dfa65f19 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:53.242646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-12786dea-3722-4f12-aa32-0896dfa65f19 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:53.250961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-12786dea-3722-4f12-aa32-0896dfa65f19 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155516 Aug 31 00:49:53.251493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1133/2203] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:53 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:53.463815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-62bc95d0-9f78-4336-a8f5-97aa5640e2ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:53.464395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-62bc95d0-9f78-4336-a8f5-97aa5640e2ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:53.470854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62bc95d0-9f78-4336-a8f5-97aa5640e2ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:53.471359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62bc95d0-9f78-4336-a8f5-97aa5640e2ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:53.471791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62bc95d0-9f78-4336-a8f5-97aa5640e2ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:53.472484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62bc95d0-9f78-4336-a8f5-97aa5640e2ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:53.472966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62bc95d0-9f78-4336-a8f5-97aa5640e2ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:53.473387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62bc95d0-9f78-4336-a8f5-97aa5640e2ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:53.488191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:53.535861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-62bc95d0-9f78-4336-a8f5-97aa5640e2ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:53.544264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-62bc95d0-9f78-4336-a8f5-97aa5640e2ee tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084375 Aug 31 00:49:53.544826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1071/2204] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:53 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:54.273467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-70115eaf-a4c0-455c-ae90-28527c8e025c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:54.274021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-70115eaf-a4c0-455c-ae90-28527c8e025c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:54.280487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70115eaf-a4c0-455c-ae90-28527c8e025c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:54.280952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70115eaf-a4c0-455c-ae90-28527c8e025c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:54.281382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70115eaf-a4c0-455c-ae90-28527c8e025c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:54.282062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70115eaf-a4c0-455c-ae90-28527c8e025c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:54.282514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70115eaf-a4c0-455c-ae90-28527c8e025c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:54.282938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70115eaf-a4c0-455c-ae90-28527c8e025c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:54.414809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-70115eaf-a4c0-455c-ae90-28527c8e025c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:54.424194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-70115eaf-a4c0-455c-ae90-28527c8e025c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155423 Aug 31 00:49:54.424780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1134/2205] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:54 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:54.566226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-190cc8fc-6bd3-459c-a8a9-879e74a3102e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:54.566814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-190cc8fc-6bd3-459c-a8a9-879e74a3102e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:54.573754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-190cc8fc-6bd3-459c-a8a9-879e74a3102e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:54.574235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-190cc8fc-6bd3-459c-a8a9-879e74a3102e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:54.574658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-190cc8fc-6bd3-459c-a8a9-879e74a3102e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:54.575366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-190cc8fc-6bd3-459c-a8a9-879e74a3102e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:54.575807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-190cc8fc-6bd3-459c-a8a9-879e74a3102e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:54.576219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-190cc8fc-6bd3-459c-a8a9-879e74a3102e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:54.642483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-190cc8fc-6bd3-459c-a8a9-879e74a3102e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:54.652811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-190cc8fc-6bd3-459c-a8a9-879e74a3102e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090600 Aug 31 00:49:54.653368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1072/2206] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:54 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:55.445628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a65b34e3-a051-4160-8564-de0d70db5730 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:55.446266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a65b34e3-a051-4160-8564-de0d70db5730 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:55.452634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a65b34e3-a051-4160-8564-de0d70db5730 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:55.453111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a65b34e3-a051-4160-8564-de0d70db5730 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:55.453543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a65b34e3-a051-4160-8564-de0d70db5730 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:55.454214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a65b34e3-a051-4160-8564-de0d70db5730 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:55.454661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a65b34e3-a051-4160-8564-de0d70db5730 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:55.455109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a65b34e3-a051-4160-8564-de0d70db5730 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:55.586929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a65b34e3-a051-4160-8564-de0d70db5730 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:55.595017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a65b34e3-a051-4160-8564-de0d70db5730 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153356 Aug 31 00:49:55.595597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1135/2207] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:55 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:55.673649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-35fa9bb7-a83e-44d0-b277-f482989af819 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:55.674256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-35fa9bb7-a83e-44d0-b277-f482989af819 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:55.680824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35fa9bb7-a83e-44d0-b277-f482989af819 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:55.681294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35fa9bb7-a83e-44d0-b277-f482989af819 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:55.681725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35fa9bb7-a83e-44d0-b277-f482989af819 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:55.682410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35fa9bb7-a83e-44d0-b277-f482989af819 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:55.682860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35fa9bb7-a83e-44d0-b277-f482989af819 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:55.683305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35fa9bb7-a83e-44d0-b277-f482989af819 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:55.746869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-35fa9bb7-a83e-44d0-b277-f482989af819 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:55.755187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-35fa9bb7-a83e-44d0-b277-f482989af819 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085373 Aug 31 00:49:55.755997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1073/2208] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:55 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:56.618353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8535dc9a-9f7a-4424-b253-774fb56cbdb8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:56.618961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8535dc9a-9f7a-4424-b253-774fb56cbdb8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:56.625531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8535dc9a-9f7a-4424-b253-774fb56cbdb8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:56.626020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8535dc9a-9f7a-4424-b253-774fb56cbdb8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:56.626452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8535dc9a-9f7a-4424-b253-774fb56cbdb8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:56.627160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8535dc9a-9f7a-4424-b253-774fb56cbdb8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:56.627608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8535dc9a-9f7a-4424-b253-774fb56cbdb8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:56.628023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8535dc9a-9f7a-4424-b253-774fb56cbdb8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:56.759399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8535dc9a-9f7a-4424-b253-774fb56cbdb8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:56.767558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8535dc9a-9f7a-4424-b253-774fb56cbdb8 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.153767 Aug 31 00:49:56.768122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1136/2209] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:56 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:56.776187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-568b2cc5-7c89-4258-a677-4c1ceb89819e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:56.776799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-568b2cc5-7c89-4258-a677-4c1ceb89819e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:56.783530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568b2cc5-7c89-4258-a677-4c1ceb89819e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:56.784015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568b2cc5-7c89-4258-a677-4c1ceb89819e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:56.784450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568b2cc5-7c89-4258-a677-4c1ceb89819e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:56.787644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568b2cc5-7c89-4258-a677-4c1ceb89819e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:56.788112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568b2cc5-7c89-4258-a677-4c1ceb89819e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:56.788534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-568b2cc5-7c89-4258-a677-4c1ceb89819e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:56.854128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-568b2cc5-7c89-4258-a677-4c1ceb89819e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:56.862636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-568b2cc5-7c89-4258-a677-4c1ceb89819e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090520 Aug 31 00:49:56.863227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1074/2210] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:56 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:57.789345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1aaabb93-f4ac-4247-9c60-0448a55c4388 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:57.789910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1aaabb93-f4ac-4247-9c60-0448a55c4388 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:57.796292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1aaabb93-f4ac-4247-9c60-0448a55c4388 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:57.796769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1aaabb93-f4ac-4247-9c60-0448a55c4388 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:57.797196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1aaabb93-f4ac-4247-9c60-0448a55c4388 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:57.797867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1aaabb93-f4ac-4247-9c60-0448a55c4388 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:57.798309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1aaabb93-f4ac-4247-9c60-0448a55c4388 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:57.798723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1aaabb93-f4ac-4247-9c60-0448a55c4388 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:57.884751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8d0c81d1-69e2-4103-bb48-43cb1678f250 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:57.885364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8d0c81d1-69e2-4103-bb48-43cb1678f250 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:57.891945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0c81d1-69e2-4103-bb48-43cb1678f250 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:57.892424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0c81d1-69e2-4103-bb48-43cb1678f250 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:57.892855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0c81d1-69e2-4103-bb48-43cb1678f250 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:57.893540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0c81d1-69e2-4103-bb48-43cb1678f250 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:57.893987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0c81d1-69e2-4103-bb48-43cb1678f250 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:57.894409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0c81d1-69e2-4103-bb48-43cb1678f250 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:57.933007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1aaabb93-f4ac-4247-9c60-0448a55c4388 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:57.941330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1aaabb93-f4ac-4247-9c60-0448a55c4388 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.155845 Aug 31 00:49:57.941914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1137/2211] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:57 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:49:57.959832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8d0c81d1-69e2-4103-bb48-43cb1678f250 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:57.968027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8d0c81d1-69e2-4103-bb48-43cb1678f250 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087674 Aug 31 00:49:57.968590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1075/2212] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:57 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:58.963654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f593526a-51e8-4779-b810-eb977480ba99 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:58.964202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f593526a-51e8-4779-b810-eb977480ba99 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:58.970581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f593526a-51e8-4779-b810-eb977480ba99 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:58.971079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f593526a-51e8-4779-b810-eb977480ba99 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:58.971507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f593526a-51e8-4779-b810-eb977480ba99 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:58.972182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f593526a-51e8-4779-b810-eb977480ba99 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:58.972625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f593526a-51e8-4779-b810-eb977480ba99 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:58.973034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f593526a-51e8-4779-b810-eb977480ba99 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:58.989484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2d55e5f5-7d51-4308-b2e9-abc3e45d134b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:49:58.990223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2d55e5f5-7d51-4308-b2e9-abc3e45d134b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:49:58.997678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55e5f5-7d51-4308-b2e9-abc3e45d134b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:58.998162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55e5f5-7d51-4308-b2e9-abc3e45d134b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:58.998592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55e5f5-7d51-4308-b2e9-abc3e45d134b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:58.999305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55e5f5-7d51-4308-b2e9-abc3e45d134b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:49:58.999755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55e5f5-7d51-4308-b2e9-abc3e45d134b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:49:59.000207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55e5f5-7d51-4308-b2e9-abc3e45d134b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:49:59.072665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d55e5f5-7d51-4308-b2e9-abc3e45d134b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:59.080811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2d55e5f5-7d51-4308-b2e9-abc3e45d134b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.095161 Aug 31 00:49:59.081384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1076/2213] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:58 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:49:59.129638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f593526a-51e8-4779-b810-eb977480ba99 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:49:59.138036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f593526a-51e8-4779-b810-eb977480ba99 tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.178253 Aug 31 00:49:59.138605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1138/2214] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:49:58 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:00.102166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b928094a-a39a-4df6-bc3d-4208dc9e741c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:00.102767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b928094a-a39a-4df6-bc3d-4208dc9e741c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:00.109414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b928094a-a39a-4df6-bc3d-4208dc9e741c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:00.109887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b928094a-a39a-4df6-bc3d-4208dc9e741c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:00.110310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b928094a-a39a-4df6-bc3d-4208dc9e741c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:00.110980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b928094a-a39a-4df6-bc3d-4208dc9e741c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:00.111449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b928094a-a39a-4df6-bc3d-4208dc9e741c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:00.111866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b928094a-a39a-4df6-bc3d-4208dc9e741c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:00.159339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7aca51ba-f2b8-43cd-becf-6f2b763764fe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:00.159936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7aca51ba-f2b8-43cd-becf-6f2b763764fe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:00.167027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aca51ba-f2b8-43cd-becf-6f2b763764fe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:00.167615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aca51ba-f2b8-43cd-becf-6f2b763764fe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:00.168048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aca51ba-f2b8-43cd-becf-6f2b763764fe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:00.168741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aca51ba-f2b8-43cd-becf-6f2b763764fe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:00.169196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aca51ba-f2b8-43cd-becf-6f2b763764fe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:00.169617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7aca51ba-f2b8-43cd-becf-6f2b763764fe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:00.173800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b928094a-a39a-4df6-bc3d-4208dc9e741c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:00.182408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b928094a-a39a-4df6-bc3d-4208dc9e741c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084270 Aug 31 00:50:00.183227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1077/2215] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:00.304289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7aca51ba-f2b8-43cd-becf-6f2b763764fe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:00.312805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7aca51ba-f2b8-43cd-becf-6f2b763764fe tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.157337 Aug 31 00:50:00.313365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1139/2216] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:00 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:01.194994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e30c9c36-b3b3-4958-a993-686a383e11e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:01.196310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e30c9c36-b3b3-4958-a993-686a383e11e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:01.206128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e30c9c36-b3b3-4958-a993-686a383e11e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.207471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e30c9c36-b3b3-4958-a993-686a383e11e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.207897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e30c9c36-b3b3-4958-a993-686a383e11e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.208516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6942f6cc-d159-47be-ac8b-372991b4be37 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:01.209070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e30c9c36-b3b3-4958-a993-686a383e11e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.209358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6942f6cc-d159-47be-ac8b-372991b4be37 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:01.209540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e30c9c36-b3b3-4958-a993-686a383e11e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.210221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e30c9c36-b3b3-4958-a993-686a383e11e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.216099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6942f6cc-d159-47be-ac8b-372991b4be37 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.216951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6942f6cc-d159-47be-ac8b-372991b4be37 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.217386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6942f6cc-d159-47be-ac8b-372991b4be37 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.218240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6942f6cc-d159-47be-ac8b-372991b4be37 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.218699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6942f6cc-d159-47be-ac8b-372991b4be37 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.219147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6942f6cc-d159-47be-ac8b-372991b4be37 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.225366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:01.258048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e30c9c36-b3b3-4958-a993-686a383e11e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:50:01.306252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6942f6cc-d159-47be-ac8b-372991b4be37 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:01.315992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6942f6cc-d159-47be-ac8b-372991b4be37 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.111635 Aug 31 00:50:01.316587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1140/2217] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:01 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:01.321272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4ad54098-e645-4a95-ad30-7b8028508287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:01.321791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4ad54098-e645-4a95-ad30-7b8028508287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:01.327733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad54098-e645-4a95-ad30-7b8028508287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.328195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad54098-e645-4a95-ad30-7b8028508287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.328620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad54098-e645-4a95-ad30-7b8028508287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.329303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad54098-e645-4a95-ad30-7b8028508287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.329929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad54098-e645-4a95-ad30-7b8028508287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.330529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad54098-e645-4a95-ad30-7b8028508287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.362486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4ad54098-e645-4a95-ad30-7b8028508287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:50:01.369684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e30c9c36-b3b3-4958-a993-686a383e11e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 204 len: 0 microversion: 2.20 time: 0.177661 Aug 31 00:50:01.374841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1078/2218] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 31 00:50:01 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 00:50:01.383802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a4606181-b1ae-46cd-8af9-4f4daead8bbf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:01.385094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a4606181-b1ae-46cd-8af9-4f4daead8bbf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:01.390939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4606181-b1ae-46cd-8af9-4f4daead8bbf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.391469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4606181-b1ae-46cd-8af9-4f4daead8bbf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.391926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4606181-b1ae-46cd-8af9-4f4daead8bbf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.392613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4606181-b1ae-46cd-8af9-4f4daead8bbf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.393058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4606181-b1ae-46cd-8af9-4f4daead8bbf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.393473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4606181-b1ae-46cd-8af9-4f4daead8bbf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.449420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4ad54098-e645-4a95-ad30-7b8028508287 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 204 len: 0 microversion: 2.1 time: 0.131399 Aug 31 00:50:01.450011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1141/2219] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:50:01 2022] DELETE /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:50:01.456325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:01.457359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:01.464192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.464615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.465039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.465722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.466172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.466589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.573855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a4606181-b1ae-46cd-8af9-4f4daead8bbf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:01.583030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a4606181-b1ae-46cd-8af9-4f4daead8bbf tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.206615 Aug 31 00:50:01.583701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1079/2220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:01 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:01.589386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0f938505-7cab-47e7-b6e1-7f42b9ae74e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:01.590329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0f938505-7cab-47e7-b6e1-7f42b9ae74e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:01.596067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f938505-7cab-47e7-b6e1-7f42b9ae74e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.596538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f938505-7cab-47e7-b6e1-7f42b9ae74e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.596968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f938505-7cab-47e7-b6e1-7f42b9ae74e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.597789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f938505-7cab-47e7-b6e1-7f42b9ae74e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:01.598323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f938505-7cab-47e7-b6e1-7f42b9ae74e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:01.598780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f938505-7cab-47e7-b6e1-7f42b9ae74e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:01.624730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:01.635494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:01.638196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:01.639800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a4e84c1a-a2d0-44b1-91b9-3d6f8a48caf8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1803 microversion: 2.20 time: 0.188473 Aug 31 00:50:01.640374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1142/2221] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1803 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:01.735212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0f938505-7cab-47e7-b6e1-7f42b9ae74e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:01.744291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0f938505-7cab-47e7-b6e1-7f42b9ae74e3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.158424 Aug 31 00:50:01.744861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1080/2222] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:02.339229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9ec05b3e-a54a-4faa-be59-84019be2a0fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:02.339840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9ec05b3e-a54a-4faa-be59-84019be2a0fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:02.346314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec05b3e-a54a-4faa-be59-84019be2a0fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:02.346788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec05b3e-a54a-4faa-be59-84019be2a0fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:02.347254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec05b3e-a54a-4faa-be59-84019be2a0fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:02.347931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec05b3e-a54a-4faa-be59-84019be2a0fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:02.348376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec05b3e-a54a-4faa-be59-84019be2a0fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:02.348790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec05b3e-a54a-4faa-be59-84019be2a0fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:02.413945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9ec05b3e-a54a-4faa-be59-84019be2a0fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:02.422137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9ec05b3e-a54a-4faa-be59-84019be2a0fe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087553 Aug 31 00:50:02.422695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1143/2223] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:02 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:02.605513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e4b75800-5e14-48f8-8cb7-3704ad294a6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:02.606074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e4b75800-5e14-48f8-8cb7-3704ad294a6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] [instance: 503c21ab-7fcf-41a4-b1b6-58109d0217f3] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:02.612539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4b75800-5e14-48f8-8cb7-3704ad294a6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:02.613047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4b75800-5e14-48f8-8cb7-3704ad294a6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:02.613483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4b75800-5e14-48f8-8cb7-3704ad294a6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:02.614179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4b75800-5e14-48f8-8cb7-3704ad294a6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:02.614627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4b75800-5e14-48f8-8cb7-3704ad294a6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:02.615579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4b75800-5e14-48f8-8cb7-3704ad294a6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:02.665657 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:02.666267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:02.672527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:02.672822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:02.673249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:02.673933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:02.674372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:02.674781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:02.903350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e4b75800-5e14-48f8-8cb7-3704ad294a6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03932102b7541f89a60a9c535a42e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32cbe1a05ce414fb55f1de8bf71581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:02.911428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e4b75800-5e14-48f8-8cb7-3704ad294a6c tempest-VolumesSnapshotTestJSON-187862735 tempest-VolumesSnapshotTestJSON-187862735-project] 10.222.0.67 "GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3" status: 200 len: 1559 microversion: 2.1 time: 0.310194 Aug 31 00:50:02.912579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1081/2224] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:02 2022] GET /compute/v2.1/servers/503c21ab-7fcf-41a4-b1b6-58109d0217f3 => generated 1559 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:02.917329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-db3999c2-a060-4d5f-9110-77892af0cdaa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:02.917929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-db3999c2-a060-4d5f-9110-77892af0cdaa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:02.924687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db3999c2-a060-4d5f-9110-77892af0cdaa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:02.925169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db3999c2-a060-4d5f-9110-77892af0cdaa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:02.925610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db3999c2-a060-4d5f-9110-77892af0cdaa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:02.926285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db3999c2-a060-4d5f-9110-77892af0cdaa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:02.926733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db3999c2-a060-4d5f-9110-77892af0cdaa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:02.927189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db3999c2-a060-4d5f-9110-77892af0cdaa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:02.963960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:02.982900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:02.984500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:02.986146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0185b7f2-c5f6-4b5e-b357-783a2d44942c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1803 microversion: 2.20 time: 0.326431 Aug 31 00:50:02.986772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1144/2225] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1803 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:50:03.170603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-db3999c2-a060-4d5f-9110-77892af0cdaa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:03.179665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-db3999c2-a060-4d5f-9110-77892af0cdaa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.265951 Aug 31 00:50:03.180236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1082/2226] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:03.444345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ccf7a59d-0bbe-4944-af33-30a7a17f7e35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:03.445308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ccf7a59d-0bbe-4944-af33-30a7a17f7e35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:03.451778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccf7a59d-0bbe-4944-af33-30a7a17f7e35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:03.452377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccf7a59d-0bbe-4944-af33-30a7a17f7e35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:03.452845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccf7a59d-0bbe-4944-af33-30a7a17f7e35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:03.453656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccf7a59d-0bbe-4944-af33-30a7a17f7e35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:03.454114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccf7a59d-0bbe-4944-af33-30a7a17f7e35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:03.454535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ccf7a59d-0bbe-4944-af33-30a7a17f7e35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:03.551164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ccf7a59d-0bbe-4944-af33-30a7a17f7e35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:03.560700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ccf7a59d-0bbe-4944-af33-30a7a17f7e35 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.120896 Aug 31 00:50:03.561306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1145/2227] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:03 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:03.625644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-0e9df6b7-90c0-4273-ad94-b4fec4056da7 req-aeb44c0b-5bfc-4ea1-8857-d0fc046f32f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e4497e-f74f-4b4e-aac6-88c39ead5f38", "name": "network-vif-deleted", "tag": "8dddb3be-7ff7-4bfa-aebb-406f077a2133"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:50:03.641032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0e9df6b7-90c0-4273-ad94-b4fec4056da7 req-aeb44c0b-5bfc-4ea1-8857-d0fc046f32f5 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:03.641923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0e9df6b7-90c0-4273-ad94-b4fec4056da7 req-aeb44c0b-5bfc-4ea1-8857-d0fc046f32f5 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:03.642644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0e9df6b7-90c0-4273-ad94-b4fec4056da7 req-aeb44c0b-5bfc-4ea1-8857-d0fc046f32f5 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:03.657634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-0e9df6b7-90c0-4273-ad94-b4fec4056da7 req-aeb44c0b-5bfc-4ea1-8857-d0fc046f32f5 service nova] Creating event network-vif-deleted:8dddb3be-7ff7-4bfa-aebb-406f077a2133 for instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 on hv-cinder-85506 Aug 31 00:50:03.663979 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-0e9df6b7-90c0-4273-ad94-b4fec4056da7 req-aeb44c0b-5bfc-4ea1-8857-d0fc046f32f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041946 Aug 31 00:50:03.665364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1083/2228] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:50:04.010696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:04.011321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:04.017244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:04.017717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:04.018145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:04.018815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:04.019288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:04.019703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:04.082672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:04.091451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:04.092874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:04.093998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c93a13ac-5db2-48a8-9992-9a1220aeed7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087191 Aug 31 00:50:04.094550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1146/2229] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:04.202351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-64885249-2f0b-4e6f-afc8-cb4411842fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:04.202964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-64885249-2f0b-4e6f-afc8-cb4411842fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:04.209105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64885249-2f0b-4e6f-afc8-cb4411842fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:04.209709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64885249-2f0b-4e6f-afc8-cb4411842fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:04.210077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64885249-2f0b-4e6f-afc8-cb4411842fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:04.210767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64885249-2f0b-4e6f-afc8-cb4411842fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:04.211333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64885249-2f0b-4e6f-afc8-cb4411842fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:04.211945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64885249-2f0b-4e6f-afc8-cb4411842fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:04.354963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-64885249-2f0b-4e6f-afc8-cb4411842fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:04.363371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-64885249-2f0b-4e6f-afc8-cb4411842fe7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.165240 Aug 31 00:50:04.364147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1084/2230] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:04.583271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fc3605a7-9417-4c40-8805-1bf335b96d28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:04.584556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fc3605a7-9417-4c40-8805-1bf335b96d28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:04.591116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc3605a7-9417-4c40-8805-1bf335b96d28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:04.591606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc3605a7-9417-4c40-8805-1bf335b96d28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:04.592052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc3605a7-9417-4c40-8805-1bf335b96d28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:04.592745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc3605a7-9417-4c40-8805-1bf335b96d28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:04.593199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc3605a7-9417-4c40-8805-1bf335b96d28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:04.593622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc3605a7-9417-4c40-8805-1bf335b96d28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:04.659977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fc3605a7-9417-4c40-8805-1bf335b96d28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:04.669376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fc3605a7-9417-4c40-8805-1bf335b96d28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090053 Aug 31 00:50:04.669959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1147/2231] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:04 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:05.117841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:05.118444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:05.124921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:05.125398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:05.125833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:05.126513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:05.126959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:05.127399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:05.188906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:05.197884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:05.199345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:05.200471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c1b33e4e-4af5-42e3-84eb-9911c649638f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087325 Aug 31 00:50:05.201022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1085/2232] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:05.385519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0ac855d5-c49a-4d9e-96c0-2e5276699f7e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:05.386123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0ac855d5-c49a-4d9e-96c0-2e5276699f7e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:05.392072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ac855d5-c49a-4d9e-96c0-2e5276699f7e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:05.392581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ac855d5-c49a-4d9e-96c0-2e5276699f7e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:05.393010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ac855d5-c49a-4d9e-96c0-2e5276699f7e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:05.393685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ac855d5-c49a-4d9e-96c0-2e5276699f7e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:05.394133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ac855d5-c49a-4d9e-96c0-2e5276699f7e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:05.394551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ac855d5-c49a-4d9e-96c0-2e5276699f7e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:05.524763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0ac855d5-c49a-4d9e-96c0-2e5276699f7e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:05.533042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0ac855d5-c49a-4d9e-96c0-2e5276699f7e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151455 Aug 31 00:50:05.533610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1148/2233] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:05.690257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-458e1c0c-2061-42e9-8ee6-e1e6670619dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:05.691003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-458e1c0c-2061-42e9-8ee6-e1e6670619dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:05.697558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-458e1c0c-2061-42e9-8ee6-e1e6670619dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:05.698027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-458e1c0c-2061-42e9-8ee6-e1e6670619dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:05.698449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-458e1c0c-2061-42e9-8ee6-e1e6670619dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:05.699161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-458e1c0c-2061-42e9-8ee6-e1e6670619dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:05.699602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-458e1c0c-2061-42e9-8ee6-e1e6670619dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:05.700013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-458e1c0c-2061-42e9-8ee6-e1e6670619dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:05.762115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-458e1c0c-2061-42e9-8ee6-e1e6670619dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:05.770221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-458e1c0c-2061-42e9-8ee6-e1e6670619dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083842 Aug 31 00:50:05.770780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1086/2234] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:05 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:06.223294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:06.223902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:06.231601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:06.232079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:06.232513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:06.233188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:06.233632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:06.234043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:06.298342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:06.307592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:06.309017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:06.310136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2680e1fa-cfd6-4f29-aea7-4989a09c672c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090801 Aug 31 00:50:06.310690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1149/2235] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:06.554887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2c41e08f-8c68-42eb-abd5-be1643900eec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:06.555450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2c41e08f-8c68-42eb-abd5-be1643900eec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:06.561744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c41e08f-8c68-42eb-abd5-be1643900eec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:06.562215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c41e08f-8c68-42eb-abd5-be1643900eec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:06.562642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c41e08f-8c68-42eb-abd5-be1643900eec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:06.563336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c41e08f-8c68-42eb-abd5-be1643900eec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:06.563782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c41e08f-8c68-42eb-abd5-be1643900eec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:06.564196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c41e08f-8c68-42eb-abd5-be1643900eec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:06.568112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:06.693672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c41e08f-8c68-42eb-abd5-be1643900eec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:06.702426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2c41e08f-8c68-42eb-abd5-be1643900eec tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152136 Aug 31 00:50:06.702984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1087/2236] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:06.792256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1ad0da32-7d92-4bd9-b11f-a4a88f8b9256 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:06.792868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1ad0da32-7d92-4bd9-b11f-a4a88f8b9256 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:06.798826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ad0da32-7d92-4bd9-b11f-a4a88f8b9256 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:06.799337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ad0da32-7d92-4bd9-b11f-a4a88f8b9256 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:06.799777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ad0da32-7d92-4bd9-b11f-a4a88f8b9256 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:06.800458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ad0da32-7d92-4bd9-b11f-a4a88f8b9256 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:06.800911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ad0da32-7d92-4bd9-b11f-a4a88f8b9256 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:06.801335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ad0da32-7d92-4bd9-b11f-a4a88f8b9256 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:06.863198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1ad0da32-7d92-4bd9-b11f-a4a88f8b9256 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:06.872606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1ad0da32-7d92-4bd9-b11f-a4a88f8b9256 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084617 Aug 31 00:50:06.873208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1150/2237] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:06 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:07.332355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:07.332984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:07.339113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:07.339593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:07.340021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:07.340700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:07.341146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:07.341565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:07.406532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:07.415656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:07.420815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:07.420815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b653b230-b98c-4aac-a089-7c780abe4b47 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091782 Aug 31 00:50:07.420815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1088/2238] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:07.724290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9ae62673-8c20-4d70-8699-7c75d661f03e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:07.724825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9ae62673-8c20-4d70-8699-7c75d661f03e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:07.732922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ae62673-8c20-4d70-8699-7c75d661f03e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:07.733410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ae62673-8c20-4d70-8699-7c75d661f03e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:07.733842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ae62673-8c20-4d70-8699-7c75d661f03e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:07.734529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ae62673-8c20-4d70-8699-7c75d661f03e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:07.734978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ae62673-8c20-4d70-8699-7c75d661f03e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:07.735421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ae62673-8c20-4d70-8699-7c75d661f03e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:07.892547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9ae62673-8c20-4d70-8699-7c75d661f03e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:07.896103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-169684f3-2925-407e-9544-08646e1c348a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:07.896719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-169684f3-2925-407e-9544-08646e1c348a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:07.899837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:07.903014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9ae62673-8c20-4d70-8699-7c75d661f03e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.182515 Aug 31 00:50:07.903861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1151/2239] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:07.905437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169684f3-2925-407e-9544-08646e1c348a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:07.905929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169684f3-2925-407e-9544-08646e1c348a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:07.906365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169684f3-2925-407e-9544-08646e1c348a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:07.907082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169684f3-2925-407e-9544-08646e1c348a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:07.907543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169684f3-2925-407e-9544-08646e1c348a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:07.907966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-169684f3-2925-407e-9544-08646e1c348a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:07.980972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-169684f3-2925-407e-9544-08646e1c348a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:07.989236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-169684f3-2925-407e-9544-08646e1c348a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.098098 Aug 31 00:50:07.990005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1089/2240] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:07 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:08.443420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:08.445100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:08.450377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:08.450839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:08.451307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:08.451999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:08.452442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:08.452862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:08.525633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:08.534332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:08.535714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:08.536862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a4b2c238-9d46-4208-ae58-8999c295d8c5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.097502 Aug 31 00:50:08.537413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1152/2241] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:08.924640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0dbf6205-676e-42b9-9ce2-3d3547b44aad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:08.925237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0dbf6205-676e-42b9-9ce2-3d3547b44aad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:08.931527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dbf6205-676e-42b9-9ce2-3d3547b44aad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:08.931999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dbf6205-676e-42b9-9ce2-3d3547b44aad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:08.932425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dbf6205-676e-42b9-9ce2-3d3547b44aad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:08.933096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dbf6205-676e-42b9-9ce2-3d3547b44aad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:08.933536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dbf6205-676e-42b9-9ce2-3d3547b44aad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:08.933947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dbf6205-676e-42b9-9ce2-3d3547b44aad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:09.010566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e77e15d7-5789-4656-a8f1-a2b7b49ba466 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:09.011668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e77e15d7-5789-4656-a8f1-a2b7b49ba466 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:09.017676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e77e15d7-5789-4656-a8f1-a2b7b49ba466 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:09.018162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e77e15d7-5789-4656-a8f1-a2b7b49ba466 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:09.018597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e77e15d7-5789-4656-a8f1-a2b7b49ba466 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:09.019318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e77e15d7-5789-4656-a8f1-a2b7b49ba466 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:09.019772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e77e15d7-5789-4656-a8f1-a2b7b49ba466 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:09.020198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e77e15d7-5789-4656-a8f1-a2b7b49ba466 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:09.073044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0dbf6205-676e-42b9-9ce2-3d3547b44aad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:09.081280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0dbf6205-676e-42b9-9ce2-3d3547b44aad tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.160370 Aug 31 00:50:09.081854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1090/2242] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:09.088956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e77e15d7-5789-4656-a8f1-a2b7b49ba466 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:09.097052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e77e15d7-5789-4656-a8f1-a2b7b49ba466 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.091229 Aug 31 00:50:09.097607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1153/2243] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:09 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:09.559511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:09.560124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:09.566179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:09.566667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:09.567144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:09.567832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:09.568281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:09.568733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:09.630750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:09.639580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:09.641017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:09.642141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ebba7a09-bfc6-44f8-9696-1b9e2f2fd2f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086629 Aug 31 00:50:09.642697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1091/2244] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:10.103697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-70ac00bf-414c-4d20-b44b-cdc0855cad73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:10.104549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-70ac00bf-414c-4d20-b44b-cdc0855cad73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:10.110885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70ac00bf-414c-4d20-b44b-cdc0855cad73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:10.111398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70ac00bf-414c-4d20-b44b-cdc0855cad73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:10.111823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70ac00bf-414c-4d20-b44b-cdc0855cad73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:10.112524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70ac00bf-414c-4d20-b44b-cdc0855cad73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:10.112971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70ac00bf-414c-4d20-b44b-cdc0855cad73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:10.113388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70ac00bf-414c-4d20-b44b-cdc0855cad73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:10.119447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b1761b3c-c606-479e-abdd-76c525c27435 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:10.120060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b1761b3c-c606-479e-abdd-76c525c27435 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:10.126190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1761b3c-c606-479e-abdd-76c525c27435 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:10.126676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1761b3c-c606-479e-abdd-76c525c27435 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:10.127141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1761b3c-c606-479e-abdd-76c525c27435 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:10.127852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1761b3c-c606-479e-abdd-76c525c27435 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:10.128309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1761b3c-c606-479e-abdd-76c525c27435 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:10.128731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1761b3c-c606-479e-abdd-76c525c27435 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:10.214308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b1761b3c-c606-479e-abdd-76c525c27435 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:10.222537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b1761b3c-c606-479e-abdd-76c525c27435 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.107655 Aug 31 00:50:10.223130 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1092/2245] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:10 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:10.269668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-70ac00bf-414c-4d20-b44b-cdc0855cad73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:10.277809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-70ac00bf-414c-4d20-b44b-cdc0855cad73 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.178246 Aug 31 00:50:10.278369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1154/2246] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:10.665688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:10.666289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:10.672448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:10.672923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:10.673355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:10.674028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:10.674472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:10.674889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:10.735138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:10.744586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:10.746032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:10.747214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7bf11559-98ab-4112-b710-63bfef12688f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086025 Aug 31 00:50:10.747769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1093/2247] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:11.246116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e200065e-577d-485d-b0bf-f7c63fc1af2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:11.247134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e200065e-577d-485d-b0bf-f7c63fc1af2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:11.254375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e200065e-577d-485d-b0bf-f7c63fc1af2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:11.254848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e200065e-577d-485d-b0bf-f7c63fc1af2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:11.255306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e200065e-577d-485d-b0bf-f7c63fc1af2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:11.255980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e200065e-577d-485d-b0bf-f7c63fc1af2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:11.256446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e200065e-577d-485d-b0bf-f7c63fc1af2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:11.256862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e200065e-577d-485d-b0bf-f7c63fc1af2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:11.259567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:11.300063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f08da40f-a51a-4614-a7d7-8737a9edc294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:11.300677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f08da40f-a51a-4614-a7d7-8737a9edc294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:11.310878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f08da40f-a51a-4614-a7d7-8737a9edc294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:11.311416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f08da40f-a51a-4614-a7d7-8737a9edc294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:11.311853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f08da40f-a51a-4614-a7d7-8737a9edc294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:11.312549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f08da40f-a51a-4614-a7d7-8737a9edc294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:11.313000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f08da40f-a51a-4614-a7d7-8737a9edc294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:11.313420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f08da40f-a51a-4614-a7d7-8737a9edc294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:11.322337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e200065e-577d-485d-b0bf-f7c63fc1af2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:11.330736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e200065e-577d-485d-b0bf-f7c63fc1af2e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090379 Aug 31 00:50:11.331338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1155/2248] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:11 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:11.442396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f08da40f-a51a-4614-a7d7-8737a9edc294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:11.450962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f08da40f-a51a-4614-a7d7-8737a9edc294 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154684 Aug 31 00:50:11.451563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1094/2249] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:11.769698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:11.770302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:11.772831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:11.778452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:11.778928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:11.779384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:11.780063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:11.780512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:11.780929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:11.860985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:11.870750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:11.872238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:11.873372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a22c07b6-081c-4484-956d-19a07d11b711 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.107580 Aug 31 00:50:11.873923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1156/2250] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:12.353005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ccadbd97-1c74-4ce8-823e-e57d8a4bf35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:12.353610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ccadbd97-1c74-4ce8-823e-e57d8a4bf35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:12.360382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccadbd97-1c74-4ce8-823e-e57d8a4bf35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:12.360876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccadbd97-1c74-4ce8-823e-e57d8a4bf35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:12.361289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccadbd97-1c74-4ce8-823e-e57d8a4bf35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:12.361961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccadbd97-1c74-4ce8-823e-e57d8a4bf35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:12.362402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccadbd97-1c74-4ce8-823e-e57d8a4bf35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:12.362816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccadbd97-1c74-4ce8-823e-e57d8a4bf35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:12.424919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ccadbd97-1c74-4ce8-823e-e57d8a4bf35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:12.433030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ccadbd97-1c74-4ce8-823e-e57d8a4bf35c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084573 Aug 31 00:50:12.433583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1095/2251] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:12 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:12.472829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-97bdae76-ecb5-41a8-b6c4-f9f0972b2243 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:12.473429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-97bdae76-ecb5-41a8-b6c4-f9f0972b2243 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:12.480330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97bdae76-ecb5-41a8-b6c4-f9f0972b2243 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:12.480906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97bdae76-ecb5-41a8-b6c4-f9f0972b2243 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:12.481239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97bdae76-ecb5-41a8-b6c4-f9f0972b2243 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:12.481920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97bdae76-ecb5-41a8-b6c4-f9f0972b2243 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:12.482365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97bdae76-ecb5-41a8-b6c4-f9f0972b2243 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:12.482777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97bdae76-ecb5-41a8-b6c4-f9f0972b2243 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:12.630002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-97bdae76-ecb5-41a8-b6c4-f9f0972b2243 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:12.638626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-97bdae76-ecb5-41a8-b6c4-f9f0972b2243 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.169636 Aug 31 00:50:12.639233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1157/2252] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:12.896944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:12.897575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:12.903519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:12.903989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:12.904417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:12.905083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:12.905525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:12.905935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:13.118859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:13.127283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:13.128699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:13.129812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4e7211cb-3071-4d05-bd33-3cafbcd566ee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.236903 Aug 31 00:50:13.130359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1096/2253] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:13.454451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-db49965c-97cd-423d-8b9f-117f57acfb4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:13.455075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-db49965c-97cd-423d-8b9f-117f57acfb4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:13.461480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db49965c-97cd-423d-8b9f-117f57acfb4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:13.461958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db49965c-97cd-423d-8b9f-117f57acfb4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:13.462389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db49965c-97cd-423d-8b9f-117f57acfb4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:13.463087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db49965c-97cd-423d-8b9f-117f57acfb4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:13.463542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db49965c-97cd-423d-8b9f-117f57acfb4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:13.463962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db49965c-97cd-423d-8b9f-117f57acfb4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:13.525107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-db49965c-97cd-423d-8b9f-117f57acfb4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:13.533368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-db49965c-97cd-423d-8b9f-117f57acfb4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082772 Aug 31 00:50:13.533934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1158/2254] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:13 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:13.659144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8f072dd8-7861-4f17-9064-0e40f6082f87 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:13.659771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8f072dd8-7861-4f17-9064-0e40f6082f87 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:13.666772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f072dd8-7861-4f17-9064-0e40f6082f87 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:13.667275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f072dd8-7861-4f17-9064-0e40f6082f87 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:13.667711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f072dd8-7861-4f17-9064-0e40f6082f87 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:13.668369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f072dd8-7861-4f17-9064-0e40f6082f87 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:13.668809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f072dd8-7861-4f17-9064-0e40f6082f87 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:13.669219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f072dd8-7861-4f17-9064-0e40f6082f87 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:13.807836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8f072dd8-7861-4f17-9064-0e40f6082f87 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:13.815974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8f072dd8-7861-4f17-9064-0e40f6082f87 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.160669 Aug 31 00:50:13.816524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1097/2255] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:14.153979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:14.154590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:14.160767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:14.161249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:14.161681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:14.162394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:14.163063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:14.163537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:14.226181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:14.234931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:14.236392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:14.237690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-21a1043b-7ca2-4595-90c8-e4ccb0e878a5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087481 Aug 31 00:50:14.238309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1159/2256] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:14.555174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9d2de499-aafe-45bd-b979-e75bbd4574d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:14.555781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9d2de499-aafe-45bd-b979-e75bbd4574d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:14.561714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d2de499-aafe-45bd-b979-e75bbd4574d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:14.562195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d2de499-aafe-45bd-b979-e75bbd4574d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:14.562627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d2de499-aafe-45bd-b979-e75bbd4574d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:14.563341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d2de499-aafe-45bd-b979-e75bbd4574d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:14.563791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d2de499-aafe-45bd-b979-e75bbd4574d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:14.564213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d2de499-aafe-45bd-b979-e75bbd4574d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:14.625568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9d2de499-aafe-45bd-b979-e75bbd4574d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:14.634520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9d2de499-aafe-45bd-b979-e75bbd4574d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083575 Aug 31 00:50:14.635091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1098/2257] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:14 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:14.838042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aef6889f-5075-4bc9-b617-c624de3e26f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:14.838675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aef6889f-5075-4bc9-b617-c624de3e26f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:14.845161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aef6889f-5075-4bc9-b617-c624de3e26f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:14.845646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aef6889f-5075-4bc9-b617-c624de3e26f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:14.846081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aef6889f-5075-4bc9-b617-c624de3e26f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:14.846756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aef6889f-5075-4bc9-b617-c624de3e26f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:14.847244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aef6889f-5075-4bc9-b617-c624de3e26f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:14.847664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aef6889f-5075-4bc9-b617-c624de3e26f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:14.993413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aef6889f-5075-4bc9-b617-c624de3e26f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:15.001764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aef6889f-5075-4bc9-b617-c624de3e26f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.167873 Aug 31 00:50:15.002336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1160/2258] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:15.261226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:15.261756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:15.268158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:15.268638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:15.269071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:15.269748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:15.270197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:15.270614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:15.333485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:15.346132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:15.347596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:15.348814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d7adcf4e-fe15-43c5-a2b8-8418dea96d6e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092376 Aug 31 00:50:15.349359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1099/2259] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:15.656132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f63d559d-d3f0-4863-beaf-8cf34c9a72e4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:15.656730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f63d559d-d3f0-4863-beaf-8cf34c9a72e4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:15.662638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f63d559d-d3f0-4863-beaf-8cf34c9a72e4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:15.663252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f63d559d-d3f0-4863-beaf-8cf34c9a72e4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:15.663681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f63d559d-d3f0-4863-beaf-8cf34c9a72e4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:15.664362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f63d559d-d3f0-4863-beaf-8cf34c9a72e4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:15.664806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f63d559d-d3f0-4863-beaf-8cf34c9a72e4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:15.665222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f63d559d-d3f0-4863-beaf-8cf34c9a72e4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:15.725460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f63d559d-d3f0-4863-beaf-8cf34c9a72e4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:15.733869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f63d559d-d3f0-4863-beaf-8cf34c9a72e4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.081567 Aug 31 00:50:15.734427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1161/2260] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:15 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:16.023871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-eb4ead31-2fdd-404e-b8d6-36d804c033e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:16.024468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eb4ead31-2fdd-404e-b8d6-36d804c033e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:16.030424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb4ead31-2fdd-404e-b8d6-36d804c033e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:16.030893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb4ead31-2fdd-404e-b8d6-36d804c033e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:16.031353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb4ead31-2fdd-404e-b8d6-36d804c033e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:16.032020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb4ead31-2fdd-404e-b8d6-36d804c033e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:16.032462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb4ead31-2fdd-404e-b8d6-36d804c033e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:16.032874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb4ead31-2fdd-404e-b8d6-36d804c033e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:16.163298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-eb4ead31-2fdd-404e-b8d6-36d804c033e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:16.171458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-eb4ead31-2fdd-404e-b8d6-36d804c033e6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151959 Aug 31 00:50:16.172010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1100/2261] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:16.372294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:16.372935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:16.379370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:16.379849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:16.380283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:16.381511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:16.382068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:16.382485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:16.444507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:16.453140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:16.454584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:16.455755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8219998a-c854-4cef-b38f-12e013716d79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087461 Aug 31 00:50:16.456318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1162/2262] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:16.755977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-978d11af-9ca1-4c44-9758-02243422c643 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:16.756751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-978d11af-9ca1-4c44-9758-02243422c643 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:16.763280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d11af-9ca1-4c44-9758-02243422c643 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:16.763765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d11af-9ca1-4c44-9758-02243422c643 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:16.764201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d11af-9ca1-4c44-9758-02243422c643 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:16.764886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d11af-9ca1-4c44-9758-02243422c643 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:16.765336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d11af-9ca1-4c44-9758-02243422c643 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:16.765756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-978d11af-9ca1-4c44-9758-02243422c643 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:16.827488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-978d11af-9ca1-4c44-9758-02243422c643 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:16.836147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-978d11af-9ca1-4c44-9758-02243422c643 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085118 Aug 31 00:50:16.836730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1101/2263] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:16 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:17.192250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0a158f64-b4c6-4035-9c49-5acb7babfe19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:17.193140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0a158f64-b4c6-4035-9c49-5acb7babfe19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:17.200201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a158f64-b4c6-4035-9c49-5acb7babfe19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:17.200683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a158f64-b4c6-4035-9c49-5acb7babfe19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:17.201116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a158f64-b4c6-4035-9c49-5acb7babfe19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:17.201797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a158f64-b4c6-4035-9c49-5acb7babfe19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:17.202252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a158f64-b4c6-4035-9c49-5acb7babfe19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:17.202671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a158f64-b4c6-4035-9c49-5acb7babfe19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:17.342894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0a158f64-b4c6-4035-9c49-5acb7babfe19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:17.352303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0a158f64-b4c6-4035-9c49-5acb7babfe19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.163920 Aug 31 00:50:17.352868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1163/2264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:17.478644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:17.479837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:17.485520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:17.486002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:17.486433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:17.487219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:17.487669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:17.488091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:17.550470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:17.559263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:17.560694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:17.561825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d090761c-7512-4290-a268-20630e7def0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087872 Aug 31 00:50:17.562371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1102/2265] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:17.857467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6aa7aa15-7148-40bc-9940-576d603c0e8c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:17.858067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6aa7aa15-7148-40bc-9940-576d603c0e8c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:17.864466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6aa7aa15-7148-40bc-9940-576d603c0e8c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:17.864949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6aa7aa15-7148-40bc-9940-576d603c0e8c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:17.865444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6aa7aa15-7148-40bc-9940-576d603c0e8c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:17.866219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6aa7aa15-7148-40bc-9940-576d603c0e8c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:17.866670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6aa7aa15-7148-40bc-9940-576d603c0e8c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:17.867120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6aa7aa15-7148-40bc-9940-576d603c0e8c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:17.928279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6aa7aa15-7148-40bc-9940-576d603c0e8c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:17.936347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6aa7aa15-7148-40bc-9940-576d603c0e8c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083014 Aug 31 00:50:17.936909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1164/2266] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:17 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:18.374136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0b5e7a1c-f7a9-4af7-a24b-8eb008a16532 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:18.374720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0b5e7a1c-f7a9-4af7-a24b-8eb008a16532 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:18.381164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b5e7a1c-f7a9-4af7-a24b-8eb008a16532 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:18.381701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b5e7a1c-f7a9-4af7-a24b-8eb008a16532 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:18.382067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b5e7a1c-f7a9-4af7-a24b-8eb008a16532 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:18.382771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b5e7a1c-f7a9-4af7-a24b-8eb008a16532 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:18.383242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b5e7a1c-f7a9-4af7-a24b-8eb008a16532 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:18.383655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b5e7a1c-f7a9-4af7-a24b-8eb008a16532 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:18.512173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0b5e7a1c-f7a9-4af7-a24b-8eb008a16532 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:18.514414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:18.522513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0b5e7a1c-f7a9-4af7-a24b-8eb008a16532 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151396 Aug 31 00:50:18.523092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1103/2267] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:18 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:18.584624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:18.585346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:18.591251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:18.591732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:18.592165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:18.592844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:18.593294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:18.593712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:18.657914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:18.667251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:18.668673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:18.669800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f84d6053-f1d7-4516-b7cd-c2e257d9be4d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089682 Aug 31 00:50:18.670350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1165/2268] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:18.958606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-eee33d7e-4795-4a7d-8cc9-9ccf3a0f4428 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:18.959792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eee33d7e-4795-4a7d-8cc9-9ccf3a0f4428 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:18.966377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eee33d7e-4795-4a7d-8cc9-9ccf3a0f4428 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:18.966851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eee33d7e-4795-4a7d-8cc9-9ccf3a0f4428 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:18.967381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eee33d7e-4795-4a7d-8cc9-9ccf3a0f4428 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:18.968059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eee33d7e-4795-4a7d-8cc9-9ccf3a0f4428 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:18.968501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eee33d7e-4795-4a7d-8cc9-9ccf3a0f4428 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:18.968915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eee33d7e-4795-4a7d-8cc9-9ccf3a0f4428 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:19.031006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-eee33d7e-4795-4a7d-8cc9-9ccf3a0f4428 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:19.040204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-eee33d7e-4795-4a7d-8cc9-9ccf3a0f4428 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085499 Aug 31 00:50:19.040766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1104/2269] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:18 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:19.544437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cfdb8046-2768-4661-8e92-f1b034cdb99c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:19.545040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cfdb8046-2768-4661-8e92-f1b034cdb99c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:19.551610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfdb8046-2768-4661-8e92-f1b034cdb99c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:19.552082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfdb8046-2768-4661-8e92-f1b034cdb99c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:19.552508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfdb8046-2768-4661-8e92-f1b034cdb99c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:19.553815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfdb8046-2768-4661-8e92-f1b034cdb99c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:19.554275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfdb8046-2768-4661-8e92-f1b034cdb99c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:19.554674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfdb8046-2768-4661-8e92-f1b034cdb99c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:19.681592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cfdb8046-2768-4661-8e92-f1b034cdb99c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:19.690196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cfdb8046-2768-4661-8e92-f1b034cdb99c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149637 Aug 31 00:50:19.690769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1166/2270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:19.692739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:19.693406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:19.699905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:19.700384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:19.700810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:19.701517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:19.701963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:19.702383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:19.762975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:19.772135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:19.773807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:19.774926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bb5b2027-16d2-46bc-a410-7345a91f82ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086117 Aug 31 00:50:19.775512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1105/2271] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:50:20.061996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f5878450-9ed9-452f-8d7f-a665ae85350a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:20.062606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f5878450-9ed9-452f-8d7f-a665ae85350a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:20.068738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5878450-9ed9-452f-8d7f-a665ae85350a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:20.069226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5878450-9ed9-452f-8d7f-a665ae85350a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:20.069661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5878450-9ed9-452f-8d7f-a665ae85350a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:20.070345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5878450-9ed9-452f-8d7f-a665ae85350a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:20.070801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5878450-9ed9-452f-8d7f-a665ae85350a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:20.071253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5878450-9ed9-452f-8d7f-a665ae85350a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:20.136286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f5878450-9ed9-452f-8d7f-a665ae85350a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:20.144475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f5878450-9ed9-452f-8d7f-a665ae85350a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086321 Aug 31 00:50:20.145053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1167/2272] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:20 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:20.713018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-981f618e-f87b-426b-8614-63ae6e01ee47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:20.713648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-981f618e-f87b-426b-8614-63ae6e01ee47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:20.720058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-981f618e-f87b-426b-8614-63ae6e01ee47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:20.720540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-981f618e-f87b-426b-8614-63ae6e01ee47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:20.720971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-981f618e-f87b-426b-8614-63ae6e01ee47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:20.721658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-981f618e-f87b-426b-8614-63ae6e01ee47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:20.722109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-981f618e-f87b-426b-8614-63ae6e01ee47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:20.722532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-981f618e-f87b-426b-8614-63ae6e01ee47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:20.797755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:20.798435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:20.805079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:20.805563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:20.805991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:20.806703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:20.807179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:20.807593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:20.876028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:20.879348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-981f618e-f87b-426b-8614-63ae6e01ee47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:20.885081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:20.886681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:20.887760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-981f618e-f87b-426b-8614-63ae6e01ee47 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.179540 Aug 31 00:50:20.887975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fa48a892-4711-4230-a954-324cd2a518f7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.094085 Aug 31 00:50:20.888337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1106/2273] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:20.888592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1168/2274] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:50:21.166713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3c861585-ab6e-4b5d-a052-68da025948f9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:21.167347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3c861585-ab6e-4b5d-a052-68da025948f9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:21.173209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c861585-ab6e-4b5d-a052-68da025948f9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:21.173690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c861585-ab6e-4b5d-a052-68da025948f9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:21.174124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c861585-ab6e-4b5d-a052-68da025948f9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:21.174804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c861585-ab6e-4b5d-a052-68da025948f9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:21.175350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c861585-ab6e-4b5d-a052-68da025948f9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:21.175756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c861585-ab6e-4b5d-a052-68da025948f9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:21.238423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3c861585-ab6e-4b5d-a052-68da025948f9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:21.247495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3c861585-ab6e-4b5d-a052-68da025948f9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085473 Aug 31 00:50:21.247999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1107/2275] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:21 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:21.909406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1087bcc2-53ca-4b2e-825c-91fe6b6216cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:21.910017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1087bcc2-53ca-4b2e-825c-91fe6b6216cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:21.910597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:21.911230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:21.917470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1087bcc2-53ca-4b2e-825c-91fe6b6216cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:21.917960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1087bcc2-53ca-4b2e-825c-91fe6b6216cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:21.918122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:21.918393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1087bcc2-53ca-4b2e-825c-91fe6b6216cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:21.918603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:21.919028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:21.919181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1087bcc2-53ca-4b2e-825c-91fe6b6216cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:21.919569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1087bcc2-53ca-4b2e-825c-91fe6b6216cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:21.919733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:21.919993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1087bcc2-53ca-4b2e-825c-91fe6b6216cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:21.920180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:21.920598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:21.990250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:21.999120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:22.000550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:22.001680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7e2e8f4d-a001-456a-9536-3d301a274083 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.094936 Aug 31 00:50:22.002421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1108/2276] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:50:22.073177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1087bcc2-53ca-4b2e-825c-91fe6b6216cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:22.081251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1087bcc2-53ca-4b2e-825c-91fe6b6216cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.175777 Aug 31 00:50:22.081816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1169/2277] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:21 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:22.269256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3d9bd776-c0b2-4206-a20a-45a3cdc0d635 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:22.269773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3d9bd776-c0b2-4206-a20a-45a3cdc0d635 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:22.276412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d9bd776-c0b2-4206-a20a-45a3cdc0d635 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:22.276910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d9bd776-c0b2-4206-a20a-45a3cdc0d635 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:22.277337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d9bd776-c0b2-4206-a20a-45a3cdc0d635 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:22.278008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d9bd776-c0b2-4206-a20a-45a3cdc0d635 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:22.278450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d9bd776-c0b2-4206-a20a-45a3cdc0d635 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:22.278860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d9bd776-c0b2-4206-a20a-45a3cdc0d635 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:22.339260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3d9bd776-c0b2-4206-a20a-45a3cdc0d635 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:22.347594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3d9bd776-c0b2-4206-a20a-45a3cdc0d635 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082367 Aug 31 00:50:22.348277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1109/2278] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:22 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:23.024588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:23.025227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:23.031722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:23.032203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:23.032634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:23.033315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:23.033762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:23.034176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:23.098136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:23.103957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-52139a2a-b4aa-4a6d-8caf-5c3583bdeeda tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:23.104651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-52139a2a-b4aa-4a6d-8caf-5c3583bdeeda tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:23.107721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:23.109165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:23.110299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9e236091-8486-4ac4-9aad-0822d473a155 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089962 Aug 31 00:50:23.110852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1170/2279] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:23.111011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52139a2a-b4aa-4a6d-8caf-5c3583bdeeda tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:23.111512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52139a2a-b4aa-4a6d-8caf-5c3583bdeeda tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:23.111937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52139a2a-b4aa-4a6d-8caf-5c3583bdeeda tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:23.112611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52139a2a-b4aa-4a6d-8caf-5c3583bdeeda tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:23.113056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52139a2a-b4aa-4a6d-8caf-5c3583bdeeda tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:23.113467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52139a2a-b4aa-4a6d-8caf-5c3583bdeeda tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:23.369570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fe8e869b-0aaa-45b4-b1cb-c86624479e4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:23.370246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fe8e869b-0aaa-45b4-b1cb-c86624479e4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:23.376331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe8e869b-0aaa-45b4-b1cb-c86624479e4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:23.376808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe8e869b-0aaa-45b4-b1cb-c86624479e4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:23.377233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe8e869b-0aaa-45b4-b1cb-c86624479e4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:23.377914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe8e869b-0aaa-45b4-b1cb-c86624479e4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:23.378356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe8e869b-0aaa-45b4-b1cb-c86624479e4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:23.378771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fe8e869b-0aaa-45b4-b1cb-c86624479e4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:23.448663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fe8e869b-0aaa-45b4-b1cb-c86624479e4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:23.450825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:23.458014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fe8e869b-0aaa-45b4-b1cb-c86624479e4b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.092985 Aug 31 00:50:23.458590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1171/2280] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:23 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:23.503443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-52139a2a-b4aa-4a6d-8caf-5c3583bdeeda tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:23.512336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-52139a2a-b4aa-4a6d-8caf-5c3583bdeeda tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.412919 Aug 31 00:50:23.512900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1110/2281] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:24.133564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:24.134184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:24.140613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:24.141086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:24.141511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:24.142180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:24.142622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:24.143054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:24.206392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:24.216345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:24.219739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:24.220876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-370b0943-2601-4b3f-8c7c-d4fb5ff03e06 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091422 Aug 31 00:50:24.221437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1172/2282] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:24.479843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e52bb310-9607-4c99-9603-e6d172183810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:24.480497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e52bb310-9607-4c99-9603-e6d172183810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:24.486816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e52bb310-9607-4c99-9603-e6d172183810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:24.487335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e52bb310-9607-4c99-9603-e6d172183810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:24.487758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e52bb310-9607-4c99-9603-e6d172183810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:24.488421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e52bb310-9607-4c99-9603-e6d172183810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:24.488861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e52bb310-9607-4c99-9603-e6d172183810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:24.489307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e52bb310-9607-4c99-9603-e6d172183810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:24.533480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9308d7e0-0b87-441b-99ba-76112536b571 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:24.534079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9308d7e0-0b87-441b-99ba-76112536b571 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:24.539989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308d7e0-0b87-441b-99ba-76112536b571 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:24.540458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308d7e0-0b87-441b-99ba-76112536b571 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:24.540883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308d7e0-0b87-441b-99ba-76112536b571 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:24.541591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308d7e0-0b87-441b-99ba-76112536b571 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:24.542033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308d7e0-0b87-441b-99ba-76112536b571 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:24.542449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308d7e0-0b87-441b-99ba-76112536b571 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:24.550733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e52bb310-9607-4c99-9603-e6d172183810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:24.559531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e52bb310-9607-4c99-9603-e6d172183810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084049 Aug 31 00:50:24.560109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1111/2283] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:24 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:24.671769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9308d7e0-0b87-441b-99ba-76112536b571 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:24.680123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9308d7e0-0b87-441b-99ba-76112536b571 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150447 Aug 31 00:50:24.680682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1173/2284] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:25.247917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:25.248438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:25.254389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:25.254863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:25.255321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:25.255991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:25.257018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:25.257643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:25.323809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:25.332445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:25.333881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:25.335984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a9300821-a214-4dc1-9052-b78683e82261 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092071 Aug 31 00:50:25.337302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1112/2285] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:25.586273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8fddce83-271f-4191-9aa9-d3cc1e1f5fb9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:25.586867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8fddce83-271f-4191-9aa9-d3cc1e1f5fb9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:25.593488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fddce83-271f-4191-9aa9-d3cc1e1f5fb9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:25.594341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fddce83-271f-4191-9aa9-d3cc1e1f5fb9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:25.594783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fddce83-271f-4191-9aa9-d3cc1e1f5fb9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:25.595629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fddce83-271f-4191-9aa9-d3cc1e1f5fb9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:25.596075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fddce83-271f-4191-9aa9-d3cc1e1f5fb9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:25.596525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fddce83-271f-4191-9aa9-d3cc1e1f5fb9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:25.673844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8fddce83-271f-4191-9aa9-d3cc1e1f5fb9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:25.682609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8fddce83-271f-4191-9aa9-d3cc1e1f5fb9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.103578 Aug 31 00:50:25.683271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1174/2286] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:25 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:25.701329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c3c0bb06-30c5-4920-8978-5718d76bdedf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:25.701930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c3c0bb06-30c5-4920-8978-5718d76bdedf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:25.708358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3c0bb06-30c5-4920-8978-5718d76bdedf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:25.708831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3c0bb06-30c5-4920-8978-5718d76bdedf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:25.709286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3c0bb06-30c5-4920-8978-5718d76bdedf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:25.709972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3c0bb06-30c5-4920-8978-5718d76bdedf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:25.710415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3c0bb06-30c5-4920-8978-5718d76bdedf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:25.710834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c3c0bb06-30c5-4920-8978-5718d76bdedf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:25.864212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c3c0bb06-30c5-4920-8978-5718d76bdedf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:25.873447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c3c0bb06-30c5-4920-8978-5718d76bdedf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.175863 Aug 31 00:50:25.874022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1113/2287] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:26.361810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:26.362421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:26.368720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:26.369201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:26.369632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:26.370317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:26.370764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:26.371220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:26.434458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:26.442974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:26.444470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:26.445597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a60d8c77-060c-4020-8dfe-3e3576f3517b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087765 Aug 31 00:50:26.446160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1175/2288] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:26.707442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9ec4b4c1-d575-4a71-8c13-d64e468bd177 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:26.707993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9ec4b4c1-d575-4a71-8c13-d64e468bd177 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:26.715241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ec4b4c1-d575-4a71-8c13-d64e468bd177 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:26.715717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ec4b4c1-d575-4a71-8c13-d64e468bd177 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:26.716146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ec4b4c1-d575-4a71-8c13-d64e468bd177 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:26.716826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ec4b4c1-d575-4a71-8c13-d64e468bd177 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:26.717273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ec4b4c1-d575-4a71-8c13-d64e468bd177 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:26.717689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9ec4b4c1-d575-4a71-8c13-d64e468bd177 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:26.782907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9ec4b4c1-d575-4a71-8c13-d64e468bd177 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:26.791336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9ec4b4c1-d575-4a71-8c13-d64e468bd177 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087819 Aug 31 00:50:26.791891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1114/2289] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:26 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:26.897782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-954f6aa6-f945-4cc4-81b4-01335d0342c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:26.898615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-954f6aa6-f945-4cc4-81b4-01335d0342c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:26.907320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954f6aa6-f945-4cc4-81b4-01335d0342c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:26.907806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954f6aa6-f945-4cc4-81b4-01335d0342c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:26.908239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954f6aa6-f945-4cc4-81b4-01335d0342c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:26.908936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954f6aa6-f945-4cc4-81b4-01335d0342c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:26.909389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954f6aa6-f945-4cc4-81b4-01335d0342c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:26.909806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954f6aa6-f945-4cc4-81b4-01335d0342c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:27.040474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-954f6aa6-f945-4cc4-81b4-01335d0342c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:27.048689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-954f6aa6-f945-4cc4-81b4-01335d0342c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156665 Aug 31 00:50:27.049257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1176/2290] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:26 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:27.468965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:27.469573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:27.475640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:27.476132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:27.476567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:27.477238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:27.477684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:27.478099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:27.538770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:27.547393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:27.548832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:27.550061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-31946faf-8f20-44f9-952b-fef48c5f168f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085022 Aug 31 00:50:27.550495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1115/2291] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:27.812859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d414f22a-d1d3-41ab-aaec-372b868096bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:27.813375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d414f22a-d1d3-41ab-aaec-372b868096bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:27.820342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d414f22a-d1d3-41ab-aaec-372b868096bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:27.820538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d414f22a-d1d3-41ab-aaec-372b868096bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:27.820806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d414f22a-d1d3-41ab-aaec-372b868096bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:27.821482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d414f22a-d1d3-41ab-aaec-372b868096bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:27.821926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d414f22a-d1d3-41ab-aaec-372b868096bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:27.822344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d414f22a-d1d3-41ab-aaec-372b868096bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:27.884188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d414f22a-d1d3-41ab-aaec-372b868096bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:27.892428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d414f22a-d1d3-41ab-aaec-372b868096bd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083536 Aug 31 00:50:27.892991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1177/2292] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:27 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:28.071145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5077bdf8-9939-469c-91ee-ab379b0c9d08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:28.071679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5077bdf8-9939-469c-91ee-ab379b0c9d08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:28.077981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5077bdf8-9939-469c-91ee-ab379b0c9d08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:28.078458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5077bdf8-9939-469c-91ee-ab379b0c9d08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:28.078888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5077bdf8-9939-469c-91ee-ab379b0c9d08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:28.079586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5077bdf8-9939-469c-91ee-ab379b0c9d08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:28.080040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5077bdf8-9939-469c-91ee-ab379b0c9d08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:28.080456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5077bdf8-9939-469c-91ee-ab379b0c9d08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:28.210523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5077bdf8-9939-469c-91ee-ab379b0c9d08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:28.218628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5077bdf8-9939-469c-91ee-ab379b0c9d08 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152072 Aug 31 00:50:28.219215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1116/2293] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:28.572808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:28.573430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:28.579901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:28.580382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:28.580812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:28.581495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:28.581946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:28.582368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:28.644427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:28.653436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:28.654865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:28.656025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-37786a8e-c010-4df6-a62d-ddd28974d13f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087343 Aug 31 00:50:28.656586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1178/2294] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:28.914465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f3e5772e-e23b-407b-9cc7-683a094d658e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:28.915086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f3e5772e-e23b-407b-9cc7-683a094d658e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:28.921022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3e5772e-e23b-407b-9cc7-683a094d658e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:28.921503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3e5772e-e23b-407b-9cc7-683a094d658e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:28.921931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3e5772e-e23b-407b-9cc7-683a094d658e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:28.922603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3e5772e-e23b-407b-9cc7-683a094d658e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:28.923066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3e5772e-e23b-407b-9cc7-683a094d658e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:28.923487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3e5772e-e23b-407b-9cc7-683a094d658e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:28.984140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3e5772e-e23b-407b-9cc7-683a094d658e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:28.992371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f3e5772e-e23b-407b-9cc7-683a094d658e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082472 Aug 31 00:50:28.992943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1117/2295] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:28 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:29.240910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-18548de6-3a91-4e5c-9c6b-d86d2c11f646 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:29.241543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-18548de6-3a91-4e5c-9c6b-d86d2c11f646 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:29.247438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18548de6-3a91-4e5c-9c6b-d86d2c11f646 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:29.247911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18548de6-3a91-4e5c-9c6b-d86d2c11f646 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:29.248336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18548de6-3a91-4e5c-9c6b-d86d2c11f646 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:29.249008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18548de6-3a91-4e5c-9c6b-d86d2c11f646 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:29.249469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18548de6-3a91-4e5c-9c6b-d86d2c11f646 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:29.249884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18548de6-3a91-4e5c-9c6b-d86d2c11f646 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:29.389744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-18548de6-3a91-4e5c-9c6b-d86d2c11f646 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:29.398626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-18548de6-3a91-4e5c-9c6b-d86d2c11f646 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.161615 Aug 31 00:50:29.399220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1179/2296] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:29.679155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:29.679996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:29.686109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:29.686592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:29.687026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:29.687734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:29.688180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:29.688594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:29.751775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:29.761255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:29.762688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:29.763862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e60866ef-6349-464b-8ef2-b01ac3233472 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088857 Aug 31 00:50:29.764414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1118/2297] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:30.013881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5cf0eb7a-2e1e-4c98-8e90-9226196d3762 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:30.014505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5cf0eb7a-2e1e-4c98-8e90-9226196d3762 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:30.021097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5cf0eb7a-2e1e-4c98-8e90-9226196d3762 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:30.021566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5cf0eb7a-2e1e-4c98-8e90-9226196d3762 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:30.022001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5cf0eb7a-2e1e-4c98-8e90-9226196d3762 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:30.022678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5cf0eb7a-2e1e-4c98-8e90-9226196d3762 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:30.023747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5cf0eb7a-2e1e-4c98-8e90-9226196d3762 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:30.024178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5cf0eb7a-2e1e-4c98-8e90-9226196d3762 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:30.086694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5cf0eb7a-2e1e-4c98-8e90-9226196d3762 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:30.095156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5cf0eb7a-2e1e-4c98-8e90-9226196d3762 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085059 Aug 31 00:50:30.095719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1180/2298] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:30 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:30.421386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cb92a230-1b21-4010-973b-cd2ab4cc4b6e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:30.421994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cb92a230-1b21-4010-973b-cd2ab4cc4b6e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:30.427924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb92a230-1b21-4010-973b-cd2ab4cc4b6e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:30.428403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb92a230-1b21-4010-973b-cd2ab4cc4b6e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:30.428873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb92a230-1b21-4010-973b-cd2ab4cc4b6e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:30.429610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb92a230-1b21-4010-973b-cd2ab4cc4b6e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:30.430369 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb92a230-1b21-4010-973b-cd2ab4cc4b6e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:30.430798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb92a230-1b21-4010-973b-cd2ab4cc4b6e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:30.563397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cb92a230-1b21-4010-973b-cd2ab4cc4b6e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:30.571610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cb92a230-1b21-4010-973b-cd2ab4cc4b6e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154078 Aug 31 00:50:30.572179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1119/2299] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:30.787076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:30.787595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:30.794305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:30.794785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:30.795249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:30.795936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:30.796387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:30.796807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:30.858607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:30.868019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:30.869608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:30.870746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4b668d03-088f-4c62-9973-4b0c82936927 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087744 Aug 31 00:50:30.871527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1181/2300] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:31.117172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2fabd0dd-cfa9-452e-8e6d-c4d06a6a8811 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:31.117884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2fabd0dd-cfa9-452e-8e6d-c4d06a6a8811 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:31.125493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fabd0dd-cfa9-452e-8e6d-c4d06a6a8811 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:31.125984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fabd0dd-cfa9-452e-8e6d-c4d06a6a8811 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:31.126419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fabd0dd-cfa9-452e-8e6d-c4d06a6a8811 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:31.127252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fabd0dd-cfa9-452e-8e6d-c4d06a6a8811 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:31.127708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fabd0dd-cfa9-452e-8e6d-c4d06a6a8811 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:31.128138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2fabd0dd-cfa9-452e-8e6d-c4d06a6a8811 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:31.144272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:31.192720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2fabd0dd-cfa9-452e-8e6d-c4d06a6a8811 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:31.201874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2fabd0dd-cfa9-452e-8e6d-c4d06a6a8811 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088599 Aug 31 00:50:31.202442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1120/2301] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:31 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:31.593205 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d51ac5d-8f72-42e3-8459-3b417c3b9645 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:31.593814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d51ac5d-8f72-42e3-8459-3b417c3b9645 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:31.600256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d51ac5d-8f72-42e3-8459-3b417c3b9645 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:31.600737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d51ac5d-8f72-42e3-8459-3b417c3b9645 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:31.601232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d51ac5d-8f72-42e3-8459-3b417c3b9645 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:31.602075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d51ac5d-8f72-42e3-8459-3b417c3b9645 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:31.602528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d51ac5d-8f72-42e3-8459-3b417c3b9645 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:31.602966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d51ac5d-8f72-42e3-8459-3b417c3b9645 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:31.735060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8d51ac5d-8f72-42e3-8459-3b417c3b9645 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:31.743594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d51ac5d-8f72-42e3-8459-3b417c3b9645 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154508 Aug 31 00:50:31.744180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1182/2302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:31.893274 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:31.893877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:31.900576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:31.901055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:31.901484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:31.902162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:31.902608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:31.903025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:31.963960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:31.972771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:31.974208 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:31.975375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a91a02e9-0983-4a60-b5d9-589576ca11b4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085991 Aug 31 00:50:31.975947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1121/2303] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:32.223731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3dab2435-d8ee-4c6e-a668-75ffbed41615 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:32.224256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3dab2435-d8ee-4c6e-a668-75ffbed41615 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:32.230696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3dab2435-d8ee-4c6e-a668-75ffbed41615 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:32.231231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3dab2435-d8ee-4c6e-a668-75ffbed41615 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:32.231669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3dab2435-d8ee-4c6e-a668-75ffbed41615 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:32.232354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3dab2435-d8ee-4c6e-a668-75ffbed41615 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:32.232809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3dab2435-d8ee-4c6e-a668-75ffbed41615 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:32.233232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3dab2435-d8ee-4c6e-a668-75ffbed41615 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:32.294776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3dab2435-d8ee-4c6e-a668-75ffbed41615 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:32.302970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3dab2435-d8ee-4c6e-a668-75ffbed41615 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083245 Aug 31 00:50:32.305022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1183/2304] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:32 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:32.765095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c362cddb-7fb1-466e-8173-03421c3300cf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:32.765652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c362cddb-7fb1-466e-8173-03421c3300cf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:32.772034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c362cddb-7fb1-466e-8173-03421c3300cf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:32.772532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c362cddb-7fb1-466e-8173-03421c3300cf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:32.773694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c362cddb-7fb1-466e-8173-03421c3300cf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:32.774390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c362cddb-7fb1-466e-8173-03421c3300cf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:32.774842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c362cddb-7fb1-466e-8173-03421c3300cf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:32.775291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c362cddb-7fb1-466e-8173-03421c3300cf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:32.909246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c362cddb-7fb1-466e-8173-03421c3300cf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:32.918057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c362cddb-7fb1-466e-8173-03421c3300cf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157037 Aug 31 00:50:32.918615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1122/2305] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:32.998207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:32.998817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:33.005224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:33.005709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:33.006144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:33.006835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:33.007323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:33.008325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:33.078229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:33.087542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:33.088965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:33.090088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3615fbe1-1ec0-40fd-93a2-cb3e7f4a05f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.095937 Aug 31 00:50:33.090646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1184/2306] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:33.325807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-498d4f73-48a4-4830-9e6b-e5222dc5b741 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:33.326347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-498d4f73-48a4-4830-9e6b-e5222dc5b741 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:33.333088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-498d4f73-48a4-4830-9e6b-e5222dc5b741 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:33.333603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-498d4f73-48a4-4830-9e6b-e5222dc5b741 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:33.334040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-498d4f73-48a4-4830-9e6b-e5222dc5b741 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:33.334840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-498d4f73-48a4-4830-9e6b-e5222dc5b741 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:33.335600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-498d4f73-48a4-4830-9e6b-e5222dc5b741 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:33.336860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-498d4f73-48a4-4830-9e6b-e5222dc5b741 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:33.400193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-498d4f73-48a4-4830-9e6b-e5222dc5b741 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:33.408482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-498d4f73-48a4-4830-9e6b-e5222dc5b741 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086644 Aug 31 00:50:33.409049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1123/2307] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:33 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:33.939428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f91ee4b3-4b45-4010-802f-beb6ec51c61b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:33.940038 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f91ee4b3-4b45-4010-802f-beb6ec51c61b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:33.946229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f91ee4b3-4b45-4010-802f-beb6ec51c61b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:33.946705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f91ee4b3-4b45-4010-802f-beb6ec51c61b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:33.947171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f91ee4b3-4b45-4010-802f-beb6ec51c61b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:33.947855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f91ee4b3-4b45-4010-802f-beb6ec51c61b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:33.948310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f91ee4b3-4b45-4010-802f-beb6ec51c61b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:33.948733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f91ee4b3-4b45-4010-802f-beb6ec51c61b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:34.086546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f91ee4b3-4b45-4010-802f-beb6ec51c61b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:34.094721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f91ee4b3-4b45-4010-802f-beb6ec51c61b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.159204 Aug 31 00:50:34.095317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1185/2308] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:33 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:34.112303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:34.112901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:34.120220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:34.120698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:34.121125 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:34.121796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:34.122256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:34.122653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:34.186546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:34.195214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:34.196660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:34.197839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a64a46aa-8ce7-405c-a5f9-b2e0b0f7e2af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089375 Aug 31 00:50:34.198398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1124/2309] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:34.430654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-30da2a09-85d0-4206-96ca-ce124b56151d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:34.431332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-30da2a09-85d0-4206-96ca-ce124b56151d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:34.437402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30da2a09-85d0-4206-96ca-ce124b56151d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:34.437889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30da2a09-85d0-4206-96ca-ce124b56151d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:34.438327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30da2a09-85d0-4206-96ca-ce124b56151d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:34.439019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30da2a09-85d0-4206-96ca-ce124b56151d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:34.439494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30da2a09-85d0-4206-96ca-ce124b56151d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:34.439918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30da2a09-85d0-4206-96ca-ce124b56151d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:34.501222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-30da2a09-85d0-4206-96ca-ce124b56151d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:34.509858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-30da2a09-85d0-4206-96ca-ce124b56151d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083468 Aug 31 00:50:34.510414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1186/2310] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:35.118462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3ba88f8-4af0-48b8-a7ab-73ad2e6db24e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:35.119070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3ba88f8-4af0-48b8-a7ab-73ad2e6db24e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:35.125477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ba88f8-4af0-48b8-a7ab-73ad2e6db24e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:35.125964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ba88f8-4af0-48b8-a7ab-73ad2e6db24e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:35.126399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ba88f8-4af0-48b8-a7ab-73ad2e6db24e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:35.127103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ba88f8-4af0-48b8-a7ab-73ad2e6db24e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:35.127557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ba88f8-4af0-48b8-a7ab-73ad2e6db24e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:35.127980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ba88f8-4af0-48b8-a7ab-73ad2e6db24e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:35.221323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:35.222049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:35.228754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:35.229304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:35.229802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:35.230553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:35.231091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:35.231517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:35.256272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e3ba88f8-4af0-48b8-a7ab-73ad2e6db24e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:35.265161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3ba88f8-4af0-48b8-a7ab-73ad2e6db24e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151505 Aug 31 00:50:35.265724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1125/2311] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:35.292869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:35.301415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:35.303006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:35.304923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ea08035a-a154-46ce-92a3-6e9aebe12800 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086817 Aug 31 00:50:35.305620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1187/2312] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:50:35.533017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8a004238-a1d3-4128-a1b2-3cedfd015ed7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:35.533535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8a004238-a1d3-4128-a1b2-3cedfd015ed7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:35.539919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a004238-a1d3-4128-a1b2-3cedfd015ed7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:35.540388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a004238-a1d3-4128-a1b2-3cedfd015ed7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:35.540838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a004238-a1d3-4128-a1b2-3cedfd015ed7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:35.541507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a004238-a1d3-4128-a1b2-3cedfd015ed7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:35.541948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a004238-a1d3-4128-a1b2-3cedfd015ed7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:35.542359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a004238-a1d3-4128-a1b2-3cedfd015ed7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:35.607903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8a004238-a1d3-4128-a1b2-3cedfd015ed7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:35.615998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8a004238-a1d3-4128-a1b2-3cedfd015ed7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086944 Aug 31 00:50:35.616594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1126/2313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:35 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:36.286565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-403ab4b9-2c8a-48f2-980e-15456f6d8af2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:36.287156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-403ab4b9-2c8a-48f2-980e-15456f6d8af2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:36.294286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-403ab4b9-2c8a-48f2-980e-15456f6d8af2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:36.294770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-403ab4b9-2c8a-48f2-980e-15456f6d8af2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:36.295255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-403ab4b9-2c8a-48f2-980e-15456f6d8af2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:36.295939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-403ab4b9-2c8a-48f2-980e-15456f6d8af2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:36.296394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-403ab4b9-2c8a-48f2-980e-15456f6d8af2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:36.296816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-403ab4b9-2c8a-48f2-980e-15456f6d8af2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:36.312628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:36.328128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:36.328869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:36.336062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:36.336382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:36.336827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:36.337650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:36.338104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:36.338525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:36.417449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:36.425974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:36.427437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:36.428578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-41f3ff54-9cfa-42db-9ec9-07ad1345f23b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.104295 Aug 31 00:50:36.429162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1127/2314] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:50:36.446173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-403ab4b9-2c8a-48f2-980e-15456f6d8af2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:36.454371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-403ab4b9-2c8a-48f2-980e-15456f6d8af2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.171743 Aug 31 00:50:36.454930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1188/2315] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:36.637320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-19a2d42f-4565-4c54-8faa-f4d3e584c787 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:36.637931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-19a2d42f-4565-4c54-8faa-f4d3e584c787 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:36.643874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a2d42f-4565-4c54-8faa-f4d3e584c787 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:36.644351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a2d42f-4565-4c54-8faa-f4d3e584c787 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:36.644773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a2d42f-4565-4c54-8faa-f4d3e584c787 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:36.645451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a2d42f-4565-4c54-8faa-f4d3e584c787 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:36.645902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a2d42f-4565-4c54-8faa-f4d3e584c787 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:36.646324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19a2d42f-4565-4c54-8faa-f4d3e584c787 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:36.711269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-19a2d42f-4565-4c54-8faa-f4d3e584c787 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:36.719589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-19a2d42f-4565-4c54-8faa-f4d3e584c787 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086549 Aug 31 00:50:36.720155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1128/2316] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:36 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:37.454068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:37.454662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:37.461180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:37.461653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:37.462074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:37.462751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:37.463227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:37.463642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:37.476431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f5ec0d8b-d932-4f31-aa17-24176cdca542 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:37.477033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f5ec0d8b-d932-4f31-aa17-24176cdca542 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:37.483647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ec0d8b-d932-4f31-aa17-24176cdca542 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:37.484134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ec0d8b-d932-4f31-aa17-24176cdca542 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:37.484566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ec0d8b-d932-4f31-aa17-24176cdca542 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:37.485250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ec0d8b-d932-4f31-aa17-24176cdca542 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:37.485699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ec0d8b-d932-4f31-aa17-24176cdca542 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:37.486118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5ec0d8b-d932-4f31-aa17-24176cdca542 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:37.528273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:37.537152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:37.539191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:37.540343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-843686d0-a4c9-4996-a1e6-7d00eff05870 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091940 Aug 31 00:50:37.540903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1189/2317] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:37.621336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f5ec0d8b-d932-4f31-aa17-24176cdca542 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:37.629516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f5ec0d8b-d932-4f31-aa17-24176cdca542 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157062 Aug 31 00:50:37.630076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1129/2318] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:37 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:37.742577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-398be9c6-d9d7-4771-9a9d-acd4366f451f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:37.743116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-398be9c6-d9d7-4771-9a9d-acd4366f451f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:37.749153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-398be9c6-d9d7-4771-9a9d-acd4366f451f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:37.749629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-398be9c6-d9d7-4771-9a9d-acd4366f451f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:37.750057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-398be9c6-d9d7-4771-9a9d-acd4366f451f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:37.750734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-398be9c6-d9d7-4771-9a9d-acd4366f451f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:37.751218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-398be9c6-d9d7-4771-9a9d-acd4366f451f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:37.751635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-398be9c6-d9d7-4771-9a9d-acd4366f451f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:37.812546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-398be9c6-d9d7-4771-9a9d-acd4366f451f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:37.820882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-398be9c6-d9d7-4771-9a9d-acd4366f451f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082977 Aug 31 00:50:37.821434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1190/2319] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:37 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:38.564209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:38.564826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:38.567127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=82 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:38.573018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:38.573496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:38.573922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:38.574596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:38.575059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:38.575474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:38.643270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:38.651726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9066299e-658d-4ef3-be65-9c93b94a80b6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:38.652303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9066299e-658d-4ef3-be65-9c93b94a80b6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:38.652595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:38.654030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:38.655190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bb8c2f70-311a-492a-b0a9-48c1668838b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.094844 Aug 31 00:50:38.655742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1130/2320] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:38.659005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9066299e-658d-4ef3-be65-9c93b94a80b6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:38.659514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9066299e-658d-4ef3-be65-9c93b94a80b6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:38.659940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9066299e-658d-4ef3-be65-9c93b94a80b6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:38.660620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9066299e-658d-4ef3-be65-9c93b94a80b6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:38.661063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9066299e-658d-4ef3-be65-9c93b94a80b6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:38.661479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9066299e-658d-4ef3-be65-9c93b94a80b6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:38.791480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9066299e-658d-4ef3-be65-9c93b94a80b6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:38.799734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9066299e-658d-4ef3-be65-9c93b94a80b6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152787 Aug 31 00:50:38.800304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1191/2321] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:38.842153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1681ca16-c056-421e-a77d-0c4a6e3d3ecc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:38.842749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1681ca16-c056-421e-a77d-0c4a6e3d3ecc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:38.848611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1681ca16-c056-421e-a77d-0c4a6e3d3ecc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:38.849080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1681ca16-c056-421e-a77d-0c4a6e3d3ecc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:38.849502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1681ca16-c056-421e-a77d-0c4a6e3d3ecc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:38.850173 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1681ca16-c056-421e-a77d-0c4a6e3d3ecc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:38.850611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1681ca16-c056-421e-a77d-0c4a6e3d3ecc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:38.851218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1681ca16-c056-421e-a77d-0c4a6e3d3ecc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:38.911340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1681ca16-c056-421e-a77d-0c4a6e3d3ecc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:38.919795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1681ca16-c056-421e-a77d-0c4a6e3d3ecc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.081392 Aug 31 00:50:38.920394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1131/2322] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:38 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:39.677558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:39.678205 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:39.684957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:39.685441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:39.685879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:39.686570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:39.687026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:39.687477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:39.752941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:39.762399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:39.763913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:39.765048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8764c524-78c0-45e1-acb2-b215a0a96521 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091401 Aug 31 00:50:39.765609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1192/2323] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:39.822633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3e9a7ad0-f599-4ccc-96af-3466eac41f00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:39.823225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3e9a7ad0-f599-4ccc-96af-3466eac41f00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:39.829548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e9a7ad0-f599-4ccc-96af-3466eac41f00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:39.830017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e9a7ad0-f599-4ccc-96af-3466eac41f00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:39.830442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e9a7ad0-f599-4ccc-96af-3466eac41f00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:39.831142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e9a7ad0-f599-4ccc-96af-3466eac41f00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:39.831587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e9a7ad0-f599-4ccc-96af-3466eac41f00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:39.831999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e9a7ad0-f599-4ccc-96af-3466eac41f00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:39.940594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e3afa037-eeca-4071-9a8c-1d1039e49405 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:39.941203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e3afa037-eeca-4071-9a8c-1d1039e49405 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:39.947807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3afa037-eeca-4071-9a8c-1d1039e49405 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:39.948289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3afa037-eeca-4071-9a8c-1d1039e49405 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:39.948720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3afa037-eeca-4071-9a8c-1d1039e49405 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:39.949400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3afa037-eeca-4071-9a8c-1d1039e49405 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:39.949852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3afa037-eeca-4071-9a8c-1d1039e49405 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:39.950267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3afa037-eeca-4071-9a8c-1d1039e49405 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:39.962615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e9a7ad0-f599-4ccc-96af-3466eac41f00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:39.972871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3e9a7ad0-f599-4ccc-96af-3466eac41f00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154229 Aug 31 00:50:39.987062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1132/2324] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:39 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:40.018242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e3afa037-eeca-4071-9a8c-1d1039e49405 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:40.027659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e3afa037-eeca-4071-9a8c-1d1039e49405 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090906 Aug 31 00:50:40.028225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1193/2325] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:39 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:40.789198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:40.790168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:40.796215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:40.796695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:40.797123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:40.797805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:40.798255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:40.798676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:40.859542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:40.868599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:40.870019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:40.871170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8e0aa2cd-a6d3-4917-8d75-ffd1905472f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086645 Aug 31 00:50:40.871727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1133/2326] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:40.996035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf290cdb-5b4f-4ffd-95c1-371ac6aee86c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:40.996651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf290cdb-5b4f-4ffd-95c1-371ac6aee86c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:41.003159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf290cdb-5b4f-4ffd-95c1-371ac6aee86c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:41.003645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf290cdb-5b4f-4ffd-95c1-371ac6aee86c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:41.004079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf290cdb-5b4f-4ffd-95c1-371ac6aee86c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:41.004763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf290cdb-5b4f-4ffd-95c1-371ac6aee86c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:41.005216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf290cdb-5b4f-4ffd-95c1-371ac6aee86c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:41.005638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf290cdb-5b4f-4ffd-95c1-371ac6aee86c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:41.048904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3ffc8ae-1ba2-4b50-83e0-213c899dd3e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:41.049457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3ffc8ae-1ba2-4b50-83e0-213c899dd3e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:41.055618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ffc8ae-1ba2-4b50-83e0-213c899dd3e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:41.056095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ffc8ae-1ba2-4b50-83e0-213c899dd3e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:41.056521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ffc8ae-1ba2-4b50-83e0-213c899dd3e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:41.057200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ffc8ae-1ba2-4b50-83e0-213c899dd3e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:41.057645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ffc8ae-1ba2-4b50-83e0-213c899dd3e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:41.058059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3ffc8ae-1ba2-4b50-83e0-213c899dd3e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:41.133853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e3ffc8ae-1ba2-4b50-83e0-213c899dd3e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:41.141902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3ffc8ae-1ba2-4b50-83e0-213c899dd3e9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.096840 Aug 31 00:50:41.142466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1134/2327] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:41 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:41.164233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bf290cdb-5b4f-4ffd-95c1-371ac6aee86c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:41.172351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf290cdb-5b4f-4ffd-95c1-371ac6aee86c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.180274 Aug 31 00:50:41.172904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1194/2328] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:41.895147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:41.895742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:41.902654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:41.903170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:41.903606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:41.904291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:41.904738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:41.905157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:41.967175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:41.976618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:41.978286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:41.979447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f6c7c08a-d5e2-49d0-b36c-d5170ebb3fde tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088319 Aug 31 00:50:41.980007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1135/2329] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:42.164560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ac6212a9-70ab-4d72-be23-d614315771bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:42.165118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ac6212a9-70ab-4d72-be23-d614315771bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:42.167432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=78 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:42.172608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac6212a9-70ab-4d72-be23-d614315771bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:42.173088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac6212a9-70ab-4d72-be23-d614315771bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:42.173524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac6212a9-70ab-4d72-be23-d614315771bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:42.174202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac6212a9-70ab-4d72-be23-d614315771bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:42.174653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac6212a9-70ab-4d72-be23-d614315771bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:42.175095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac6212a9-70ab-4d72-be23-d614315771bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:42.193231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f09816ac-503b-4a9d-8935-eafce6544d86 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:42.193885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f09816ac-503b-4a9d-8935-eafce6544d86 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:42.199926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f09816ac-503b-4a9d-8935-eafce6544d86 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:42.200404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f09816ac-503b-4a9d-8935-eafce6544d86 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:42.200834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f09816ac-503b-4a9d-8935-eafce6544d86 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:42.201522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f09816ac-503b-4a9d-8935-eafce6544d86 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:42.201971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f09816ac-503b-4a9d-8935-eafce6544d86 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:42.202390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f09816ac-503b-4a9d-8935-eafce6544d86 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:42.240283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ac6212a9-70ab-4d72-be23-d614315771bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:42.249135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ac6212a9-70ab-4d72-be23-d614315771bc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089068 Aug 31 00:50:42.249707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1195/2330] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:42 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:42.343070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f09816ac-503b-4a9d-8935-eafce6544d86 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:42.352007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f09816ac-503b-4a9d-8935-eafce6544d86 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.162587 Aug 31 00:50:42.352576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1136/2331] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:42 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:43.004019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:43.004660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:43.013194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:43.013680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:43.014113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:43.016988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:43.017463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:43.017905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:43.082042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:43.091698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:43.093142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:43.094271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f7c2d5b8-1270-4b96-abd5-4272d3880ad6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.095659 Aug 31 00:50:43.094834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1196/2332] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:43.270987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c29c8788-30eb-44a0-add0-22cdafa41664 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:43.271585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c29c8788-30eb-44a0-add0-22cdafa41664 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:43.278944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29c8788-30eb-44a0-add0-22cdafa41664 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:43.279488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29c8788-30eb-44a0-add0-22cdafa41664 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:43.279923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29c8788-30eb-44a0-add0-22cdafa41664 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:43.280609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29c8788-30eb-44a0-add0-22cdafa41664 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:43.281059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29c8788-30eb-44a0-add0-22cdafa41664 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:43.281481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29c8788-30eb-44a0-add0-22cdafa41664 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:43.284015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:43.348540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c29c8788-30eb-44a0-add0-22cdafa41664 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:43.361566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c29c8788-30eb-44a0-add0-22cdafa41664 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.094449 Aug 31 00:50:43.362140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1137/2333] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:43 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:43.376055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b398d543-b01e-41cb-8744-c4289edb47de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:43.376665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b398d543-b01e-41cb-8744-c4289edb47de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:43.383783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b398d543-b01e-41cb-8744-c4289edb47de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:43.384294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b398d543-b01e-41cb-8744-c4289edb47de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:43.384745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b398d543-b01e-41cb-8744-c4289edb47de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:43.385433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b398d543-b01e-41cb-8744-c4289edb47de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:43.385920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b398d543-b01e-41cb-8744-c4289edb47de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:43.386366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b398d543-b01e-41cb-8744-c4289edb47de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:43.520857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b398d543-b01e-41cb-8744-c4289edb47de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:43.529699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b398d543-b01e-41cb-8744-c4289edb47de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157474 Aug 31 00:50:43.530202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1197/2334] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:44.118793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:44.119438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:44.125529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:44.126010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:44.126441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:44.127148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:44.127600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:44.128021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:44.189531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:44.199171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:44.200611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:44.201742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c21368cc-920d-4b8b-bca7-d1bba96c86f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087745 Aug 31 00:50:44.202300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1138/2335] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:44.383624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5f824cdc-c492-4a10-bf3a-942460ba21a7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:44.384159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5f824cdc-c492-4a10-bf3a-942460ba21a7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:44.390583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f824cdc-c492-4a10-bf3a-942460ba21a7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:44.391101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f824cdc-c492-4a10-bf3a-942460ba21a7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:44.391540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f824cdc-c492-4a10-bf3a-942460ba21a7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:44.392221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f824cdc-c492-4a10-bf3a-942460ba21a7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:44.392678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f824cdc-c492-4a10-bf3a-942460ba21a7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:44.393098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f824cdc-c492-4a10-bf3a-942460ba21a7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:44.453931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f824cdc-c492-4a10-bf3a-942460ba21a7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:44.462700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5f824cdc-c492-4a10-bf3a-942460ba21a7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083668 Aug 31 00:50:44.463292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1198/2336] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:44 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:44.550427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1e9af08e-12e8-4ef5-b98f-e17c6ba2c059 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:44.551449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1e9af08e-12e8-4ef5-b98f-e17c6ba2c059 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:44.558119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e9af08e-12e8-4ef5-b98f-e17c6ba2c059 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:44.558598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e9af08e-12e8-4ef5-b98f-e17c6ba2c059 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:44.559025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e9af08e-12e8-4ef5-b98f-e17c6ba2c059 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:44.559992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e9af08e-12e8-4ef5-b98f-e17c6ba2c059 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:44.560446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e9af08e-12e8-4ef5-b98f-e17c6ba2c059 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:44.560865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1e9af08e-12e8-4ef5-b98f-e17c6ba2c059 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:44.693143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1e9af08e-12e8-4ef5-b98f-e17c6ba2c059 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:44.703006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1e9af08e-12e8-4ef5-b98f-e17c6ba2c059 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156363 Aug 31 00:50:44.703599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1139/2337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:45.224677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:45.225294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:45.232114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:45.232587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:45.233017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:45.233683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:45.234125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:45.234538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:45.297132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:45.306553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:45.308533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:45.309674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4fa5bdc4-0782-42e3-b167-7c33725b423d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089001 Aug 31 00:50:45.310230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1199/2338] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:45.484431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9e6168fc-701f-47cf-b328-a5454f6d3d8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:45.485039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9e6168fc-701f-47cf-b328-a5454f6d3d8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:45.491230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e6168fc-701f-47cf-b328-a5454f6d3d8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:45.491748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e6168fc-701f-47cf-b328-a5454f6d3d8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:45.492164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e6168fc-701f-47cf-b328-a5454f6d3d8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:45.492843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e6168fc-701f-47cf-b328-a5454f6d3d8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:45.493294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e6168fc-701f-47cf-b328-a5454f6d3d8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:45.493716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e6168fc-701f-47cf-b328-a5454f6d3d8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:45.558026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9e6168fc-701f-47cf-b328-a5454f6d3d8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:45.566390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9e6168fc-701f-47cf-b328-a5454f6d3d8f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085812 Aug 31 00:50:45.566947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1140/2339] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:45 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:45.726280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5f71ffa2-ecc5-4e16-b87b-722a5e390cd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:45.726935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5f71ffa2-ecc5-4e16-b87b-722a5e390cd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:45.733547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f71ffa2-ecc5-4e16-b87b-722a5e390cd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:45.734019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f71ffa2-ecc5-4e16-b87b-722a5e390cd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:45.734446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f71ffa2-ecc5-4e16-b87b-722a5e390cd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:45.735156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f71ffa2-ecc5-4e16-b87b-722a5e390cd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:45.735606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f71ffa2-ecc5-4e16-b87b-722a5e390cd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:45.736049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f71ffa2-ecc5-4e16-b87b-722a5e390cd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:45.872718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f71ffa2-ecc5-4e16-b87b-722a5e390cd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:45.880844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5f71ffa2-ecc5-4e16-b87b-722a5e390cd3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.159048 Aug 31 00:50:45.881408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1200/2340] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:46.332104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:46.332703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:46.338868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:46.339382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:46.339812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:46.340488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:46.340935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:46.341354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:46.403539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:46.412333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:46.414046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:46.415251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4546acca-4b8d-47cd-8d0a-1f7143688f8c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087086 Aug 31 00:50:46.415812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1141/2341] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:46.587492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0531faf3-efd5-46e9-bec6-c957ae523036 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:46.588044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0531faf3-efd5-46e9-bec6-c957ae523036 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:46.593990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0531faf3-efd5-46e9-bec6-c957ae523036 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:46.594471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0531faf3-efd5-46e9-bec6-c957ae523036 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:46.594903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0531faf3-efd5-46e9-bec6-c957ae523036 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:46.595612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0531faf3-efd5-46e9-bec6-c957ae523036 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:46.596063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0531faf3-efd5-46e9-bec6-c957ae523036 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:46.596483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0531faf3-efd5-46e9-bec6-c957ae523036 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:46.656599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0531faf3-efd5-46e9-bec6-c957ae523036 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:46.665327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0531faf3-efd5-46e9-bec6-c957ae523036 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.081908 Aug 31 00:50:46.665879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1201/2342] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:46 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:46.902992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0a71b9d8-aca0-49e9-8da5-279ad1193feb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:46.903565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0a71b9d8-aca0-49e9-8da5-279ad1193feb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:46.909993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a71b9d8-aca0-49e9-8da5-279ad1193feb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:46.910463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a71b9d8-aca0-49e9-8da5-279ad1193feb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:46.910888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a71b9d8-aca0-49e9-8da5-279ad1193feb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:46.911588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a71b9d8-aca0-49e9-8da5-279ad1193feb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:46.912029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a71b9d8-aca0-49e9-8da5-279ad1193feb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:46.912441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a71b9d8-aca0-49e9-8da5-279ad1193feb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:47.044366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0a71b9d8-aca0-49e9-8da5-279ad1193feb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:47.052513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0a71b9d8-aca0-49e9-8da5-279ad1193feb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153482 Aug 31 00:50:47.053074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1142/2343] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:46 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:47.438662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:47.439308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:47.447050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:47.447545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:47.448419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:47.449253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:47.450130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:47.450557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:47.513217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:47.521775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:47.524438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:47.525776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7b0f71c3-7fe6-46e9-a167-b6623f195e08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090884 Aug 31 00:50:47.526140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1202/2344] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:47.686362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b46fbcb1-255b-4d37-b530-0f2492d5b2e7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:47.686965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b46fbcb1-255b-4d37-b530-0f2492d5b2e7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:47.693278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b46fbcb1-255b-4d37-b530-0f2492d5b2e7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:47.693697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b46fbcb1-255b-4d37-b530-0f2492d5b2e7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:47.694883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b46fbcb1-255b-4d37-b530-0f2492d5b2e7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:47.695669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b46fbcb1-255b-4d37-b530-0f2492d5b2e7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:47.696116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b46fbcb1-255b-4d37-b530-0f2492d5b2e7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:47.696534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b46fbcb1-255b-4d37-b530-0f2492d5b2e7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:47.756229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b46fbcb1-255b-4d37-b530-0f2492d5b2e7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:47.765171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b46fbcb1-255b-4d37-b530-0f2492d5b2e7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082742 Aug 31 00:50:47.765739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1143/2345] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:47 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:48.073883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-356af740-9a84-40a8-81d4-1c4ef9c06213 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:48.074482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-356af740-9a84-40a8-81d4-1c4ef9c06213 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:48.080407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-356af740-9a84-40a8-81d4-1c4ef9c06213 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:48.080880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-356af740-9a84-40a8-81d4-1c4ef9c06213 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:48.081306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-356af740-9a84-40a8-81d4-1c4ef9c06213 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:48.081979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-356af740-9a84-40a8-81d4-1c4ef9c06213 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:48.082421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-356af740-9a84-40a8-81d4-1c4ef9c06213 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:48.082838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-356af740-9a84-40a8-81d4-1c4ef9c06213 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:48.218392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-356af740-9a84-40a8-81d4-1c4ef9c06213 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:48.226993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-356af740-9a84-40a8-81d4-1c4ef9c06213 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157022 Aug 31 00:50:48.227592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1203/2346] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:48.548812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:48.549436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:48.556518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:48.556991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:48.557413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:48.558078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:48.558512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:48.558920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:48.619842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:48.628205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:48.629622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:48.630734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-312555ed-6ef1-47ec-a4a9-693791afdcda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085877 Aug 31 00:50:48.631336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1144/2347] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:50:48.786159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d1f704fd-1408-4a5c-8613-f45b43a07baf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:48.786803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d1f704fd-1408-4a5c-8613-f45b43a07baf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:48.794216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f704fd-1408-4a5c-8613-f45b43a07baf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:48.794702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f704fd-1408-4a5c-8613-f45b43a07baf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:48.795166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f704fd-1408-4a5c-8613-f45b43a07baf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:48.795848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f704fd-1408-4a5c-8613-f45b43a07baf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:48.796301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f704fd-1408-4a5c-8613-f45b43a07baf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:48.796725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f704fd-1408-4a5c-8613-f45b43a07baf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:48.858321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d1f704fd-1408-4a5c-8613-f45b43a07baf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:48.867752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d1f704fd-1408-4a5c-8613-f45b43a07baf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085134 Aug 31 00:50:48.868344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1204/2348] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:48 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:49.249001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f34254a1-0aa3-474a-97b9-589b8d8d43ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:49.249518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f34254a1-0aa3-474a-97b9-589b8d8d43ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:49.255402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34254a1-0aa3-474a-97b9-589b8d8d43ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:49.255874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34254a1-0aa3-474a-97b9-589b8d8d43ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:49.256296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34254a1-0aa3-474a-97b9-589b8d8d43ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:49.257258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34254a1-0aa3-474a-97b9-589b8d8d43ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:49.257706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34254a1-0aa3-474a-97b9-589b8d8d43ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:49.258118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f34254a1-0aa3-474a-97b9-589b8d8d43ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:49.387851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f34254a1-0aa3-474a-97b9-589b8d8d43ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:49.396029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f34254a1-0aa3-474a-97b9-589b8d8d43ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150964 Aug 31 00:50:49.396588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1145/2349] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:49.653358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:49.653978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:49.659913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:49.660389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:49.660816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:49.661483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:49.661928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:49.662343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:49.665696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:49.723562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:49.732864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:49.734298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:49.735455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7841c3c3-7042-49a5-b419-66df5241abb0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086107 Aug 31 00:50:49.736015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1205/2350] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:49.888837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3945220c-e8aa-4631-be25-dd44bcba7c6d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:49.889447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3945220c-e8aa-4631-be25-dd44bcba7c6d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:49.895987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3945220c-e8aa-4631-be25-dd44bcba7c6d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:49.896480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3945220c-e8aa-4631-be25-dd44bcba7c6d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:49.896906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3945220c-e8aa-4631-be25-dd44bcba7c6d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:49.898156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3945220c-e8aa-4631-be25-dd44bcba7c6d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:49.898621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3945220c-e8aa-4631-be25-dd44bcba7c6d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:49.899053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3945220c-e8aa-4631-be25-dd44bcba7c6d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:49.961070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3945220c-e8aa-4631-be25-dd44bcba7c6d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:49.969421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3945220c-e8aa-4631-be25-dd44bcba7c6d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084447 Aug 31 00:50:49.969998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1146/2351] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:49 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:50.417499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e65858cd-94f9-4daa-b1c6-33f46d768332 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:50.418105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e65858cd-94f9-4daa-b1c6-33f46d768332 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:50.424551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e65858cd-94f9-4daa-b1c6-33f46d768332 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:50.425021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e65858cd-94f9-4daa-b1c6-33f46d768332 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:50.425446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e65858cd-94f9-4daa-b1c6-33f46d768332 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:50.426114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e65858cd-94f9-4daa-b1c6-33f46d768332 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:50.426556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e65858cd-94f9-4daa-b1c6-33f46d768332 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:50.426970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e65858cd-94f9-4daa-b1c6-33f46d768332 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:50.554827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e65858cd-94f9-4daa-b1c6-33f46d768332 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:50.564454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e65858cd-94f9-4daa-b1c6-33f46d768332 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150819 Aug 31 00:50:50.565022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1206/2352] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:50.758556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:50.759087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:50.764975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:50.765447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:50.765867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:50.766529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:50.766967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:50.767408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:50.830071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:50.839577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:50.841025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:50.842152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-31519e50-685a-4ccf-bd2e-2603d7463869 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088241 Aug 31 00:50:50.842708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1147/2353] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:50.992332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1acebb46-35d6-4237-beae-74e5017ce5dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:50.992947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1acebb46-35d6-4237-beae-74e5017ce5dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:50.999133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1acebb46-35d6-4237-beae-74e5017ce5dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:50.999624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1acebb46-35d6-4237-beae-74e5017ce5dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:51.000083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1acebb46-35d6-4237-beae-74e5017ce5dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:51.000774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1acebb46-35d6-4237-beae-74e5017ce5dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:51.001228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1acebb46-35d6-4237-beae-74e5017ce5dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:51.001688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1acebb46-35d6-4237-beae-74e5017ce5dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:51.065293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1acebb46-35d6-4237-beae-74e5017ce5dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:51.073413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1acebb46-35d6-4237-beae-74e5017ce5dd tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085682 Aug 31 00:50:51.073984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1207/2354] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:50 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:51.586078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d282f04c-9878-48c4-a80a-2fe7667ae064 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:51.586680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d282f04c-9878-48c4-a80a-2fe7667ae064 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:51.593177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d282f04c-9878-48c4-a80a-2fe7667ae064 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:51.593650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d282f04c-9878-48c4-a80a-2fe7667ae064 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:51.594078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d282f04c-9878-48c4-a80a-2fe7667ae064 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:51.594752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d282f04c-9878-48c4-a80a-2fe7667ae064 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:51.595231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d282f04c-9878-48c4-a80a-2fe7667ae064 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:51.595665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d282f04c-9878-48c4-a80a-2fe7667ae064 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:51.723792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d282f04c-9878-48c4-a80a-2fe7667ae064 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:51.732848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d282f04c-9878-48c4-a80a-2fe7667ae064 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151071 Aug 31 00:50:51.733403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1148/2355] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:51.864541 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:51.865142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:51.872432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:51.872905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:51.873332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:51.874004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:51.874446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:51.874860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:51.937104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:51.946024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:51.947506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:51.948642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-140bfa5b-e3dd-44be-a098-52e6774c1ca3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087950 Aug 31 00:50:51.949211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1208/2356] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:52.094420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8293a3ec-d124-4f4f-aa04-d50cd0f584b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:52.095019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8293a3ec-d124-4f4f-aa04-d50cd0f584b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:52.101665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8293a3ec-d124-4f4f-aa04-d50cd0f584b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:52.102192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8293a3ec-d124-4f4f-aa04-d50cd0f584b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:52.102877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8293a3ec-d124-4f4f-aa04-d50cd0f584b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:52.103574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8293a3ec-d124-4f4f-aa04-d50cd0f584b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:52.104020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8293a3ec-d124-4f4f-aa04-d50cd0f584b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:52.104431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8293a3ec-d124-4f4f-aa04-d50cd0f584b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:52.167765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8293a3ec-d124-4f4f-aa04-d50cd0f584b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:52.175863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8293a3ec-d124-4f4f-aa04-d50cd0f584b6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085313 Aug 31 00:50:52.176418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1149/2357] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:52 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:52.754407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a78c1ed2-7574-4ae1-9ff9-45b9f4197eb4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:52.755008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a78c1ed2-7574-4ae1-9ff9-45b9f4197eb4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:52.761507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a78c1ed2-7574-4ae1-9ff9-45b9f4197eb4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:52.761989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a78c1ed2-7574-4ae1-9ff9-45b9f4197eb4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:52.762419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a78c1ed2-7574-4ae1-9ff9-45b9f4197eb4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:52.763122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a78c1ed2-7574-4ae1-9ff9-45b9f4197eb4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:52.763573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a78c1ed2-7574-4ae1-9ff9-45b9f4197eb4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:52.763990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a78c1ed2-7574-4ae1-9ff9-45b9f4197eb4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:52.891877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a78c1ed2-7574-4ae1-9ff9-45b9f4197eb4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:52.900744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a78c1ed2-7574-4ae1-9ff9-45b9f4197eb4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150240 Aug 31 00:50:52.901309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1209/2358] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:52.971276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:52.971880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:52.979393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:52.979548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:52.979899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:52.980582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:52.981026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:52.981440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:53.045393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:53.054377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:53.055836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:53.056951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8747919e-0c5d-4c03-91a3-920f62af6d71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089660 Aug 31 00:50:53.057503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1150/2359] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:53.197909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-36e7cbd2-ccd2-4dda-b179-8d875e5873ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:53.198605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-36e7cbd2-ccd2-4dda-b179-8d875e5873ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:53.204602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36e7cbd2-ccd2-4dda-b179-8d875e5873ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:53.205080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36e7cbd2-ccd2-4dda-b179-8d875e5873ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:53.205509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36e7cbd2-ccd2-4dda-b179-8d875e5873ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:53.206186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36e7cbd2-ccd2-4dda-b179-8d875e5873ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:53.206636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36e7cbd2-ccd2-4dda-b179-8d875e5873ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:53.207072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-36e7cbd2-ccd2-4dda-b179-8d875e5873ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:53.270482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-36e7cbd2-ccd2-4dda-b179-8d875e5873ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:53.278870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-36e7cbd2-ccd2-4dda-b179-8d875e5873ad tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085640 Aug 31 00:50:53.279459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1210/2360] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:53 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:53.921432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d009cbd4-460c-47b7-b712-0044a741cb1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:53.922019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d009cbd4-460c-47b7-b712-0044a741cb1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:53.927883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d009cbd4-460c-47b7-b712-0044a741cb1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:53.928476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d009cbd4-460c-47b7-b712-0044a741cb1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:53.928903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d009cbd4-460c-47b7-b712-0044a741cb1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:53.929582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d009cbd4-460c-47b7-b712-0044a741cb1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:53.930013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d009cbd4-460c-47b7-b712-0044a741cb1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:53.930426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d009cbd4-460c-47b7-b712-0044a741cb1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:54.058356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d009cbd4-460c-47b7-b712-0044a741cb1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:54.066490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d009cbd4-460c-47b7-b712-0044a741cb1f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148890 Aug 31 00:50:54.067064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1151/2361] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:53 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:54.079192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:54.079799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:54.086271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:54.087567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:54.088085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:54.088945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:54.089447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:54.089942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:54.154040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:54.163296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:54.164656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:54.165777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9f4ee814-cfab-426b-a721-fa7dd7d15e59 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090547 Aug 31 00:50:54.166326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1211/2362] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:54.300600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f28a0999-6d58-44b5-9433-005955025d1e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:54.301210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f28a0999-6d58-44b5-9433-005955025d1e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:54.307458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f28a0999-6d58-44b5-9433-005955025d1e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:54.307874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f28a0999-6d58-44b5-9433-005955025d1e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:54.308303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f28a0999-6d58-44b5-9433-005955025d1e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:54.308980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f28a0999-6d58-44b5-9433-005955025d1e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:54.309424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f28a0999-6d58-44b5-9433-005955025d1e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:54.309840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f28a0999-6d58-44b5-9433-005955025d1e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:54.369948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f28a0999-6d58-44b5-9433-005955025d1e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:54.378071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f28a0999-6d58-44b5-9433-005955025d1e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.081384 Aug 31 00:50:54.378636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1152/2363] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:54 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:55.088424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9a6602e8-713d-45bc-8a42-58e5fab1d274 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:55.089043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9a6602e8-713d-45bc-8a42-58e5fab1d274 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:55.095516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a6602e8-713d-45bc-8a42-58e5fab1d274 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:55.095989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a6602e8-713d-45bc-8a42-58e5fab1d274 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:55.096417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a6602e8-713d-45bc-8a42-58e5fab1d274 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:55.097087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a6602e8-713d-45bc-8a42-58e5fab1d274 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:55.097530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a6602e8-713d-45bc-8a42-58e5fab1d274 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:55.097944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a6602e8-713d-45bc-8a42-58e5fab1d274 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:55.188351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:55.188959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:55.196261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:55.196741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:55.197168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:55.197850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:55.198296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:55.198711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:55.232515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9a6602e8-713d-45bc-8a42-58e5fab1d274 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:55.241523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9a6602e8-713d-45bc-8a42-58e5fab1d274 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156547 Aug 31 00:50:55.242099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1212/2364] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:55 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:55.261023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:55.263205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:50:55.270649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:55.272105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:55.273231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-77a08698-78a3-4cd0-ac24-d544a5ac5232 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088837 Aug 31 00:50:55.273785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1153/2365] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:50:55.400169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cb8acb09-21da-4d82-ac6f-cac6b7e055a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:55.400769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cb8acb09-21da-4d82-ac6f-cac6b7e055a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:55.406786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb8acb09-21da-4d82-ac6f-cac6b7e055a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:55.407297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb8acb09-21da-4d82-ac6f-cac6b7e055a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:55.407727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb8acb09-21da-4d82-ac6f-cac6b7e055a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:55.408407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb8acb09-21da-4d82-ac6f-cac6b7e055a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:55.408879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb8acb09-21da-4d82-ac6f-cac6b7e055a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:55.409270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb8acb09-21da-4d82-ac6f-cac6b7e055a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:55.471270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cb8acb09-21da-4d82-ac6f-cac6b7e055a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:55.480262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cb8acb09-21da-4d82-ac6f-cac6b7e055a5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084226 Aug 31 00:50:55.480834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1213/2366] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:55 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:56.263496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-541bccb0-f101-4923-a63b-054b61e68755 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:56.264067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-541bccb0-f101-4923-a63b-054b61e68755 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:56.270644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-541bccb0-f101-4923-a63b-054b61e68755 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:56.271179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-541bccb0-f101-4923-a63b-054b61e68755 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:56.271605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-541bccb0-f101-4923-a63b-054b61e68755 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:56.272593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-541bccb0-f101-4923-a63b-054b61e68755 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:56.273050 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-541bccb0-f101-4923-a63b-054b61e68755 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:56.273477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-541bccb0-f101-4923-a63b-054b61e68755 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:56.296786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:56.297413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:56.305084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:56.305573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:56.306008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:56.306722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:56.307181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:56.307599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:56.382219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:56.391364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:56.392812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:56.393958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ebbf074c-4e33-4ca9-9f02-932dae6882a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.101066 Aug 31 00:50:56.394514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1214/2367] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:50:56.427612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-541bccb0-f101-4923-a63b-054b61e68755 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:56.436502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-541bccb0-f101-4923-a63b-054b61e68755 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.176892 Aug 31 00:50:56.437062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1154/2368] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:56.501790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-af614272-bff9-4bf6-a36f-4c65bcc17687 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:56.502398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-af614272-bff9-4bf6-a36f-4c65bcc17687 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:56.508650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af614272-bff9-4bf6-a36f-4c65bcc17687 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:56.509130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af614272-bff9-4bf6-a36f-4c65bcc17687 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:56.509566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af614272-bff9-4bf6-a36f-4c65bcc17687 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:56.510245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af614272-bff9-4bf6-a36f-4c65bcc17687 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:56.510695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af614272-bff9-4bf6-a36f-4c65bcc17687 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:56.511142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af614272-bff9-4bf6-a36f-4c65bcc17687 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:56.574049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-af614272-bff9-4bf6-a36f-4c65bcc17687 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:56.582504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-af614272-bff9-4bf6-a36f-4c65bcc17687 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084604 Aug 31 00:50:56.583070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1215/2369] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:56 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:57.416843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:57.417478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:57.424038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:57.424514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:57.424950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:57.425630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:57.426101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:57.426520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:57.457588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ce8ea99-b1b8-42f1-ade0-a88dd5723f6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:57.458598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ce8ea99-b1b8-42f1-ade0-a88dd5723f6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:57.465391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ce8ea99-b1b8-42f1-ade0-a88dd5723f6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:57.465879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ce8ea99-b1b8-42f1-ade0-a88dd5723f6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:57.466309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ce8ea99-b1b8-42f1-ade0-a88dd5723f6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:57.467005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ce8ea99-b1b8-42f1-ade0-a88dd5723f6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:57.467494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ce8ea99-b1b8-42f1-ade0-a88dd5723f6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:57.467916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ce8ea99-b1b8-42f1-ade0-a88dd5723f6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:57.491425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:57.500097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:57.501530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:57.502645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0b18b74f-4c4f-49ba-958b-e08186405f11 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089702 Aug 31 00:50:57.503216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1155/2370] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:57.604068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bd9b640d-70b5-4dea-8d78-71549f1e6fb2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:57.605000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bd9b640d-70b5-4dea-8d78-71549f1e6fb2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:57.606967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ce8ea99-b1b8-42f1-ade0-a88dd5723f6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:57.610979 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd9b640d-70b5-4dea-8d78-71549f1e6fb2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:57.611507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd9b640d-70b5-4dea-8d78-71549f1e6fb2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:57.611941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd9b640d-70b5-4dea-8d78-71549f1e6fb2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:57.612636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd9b640d-70b5-4dea-8d78-71549f1e6fb2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:57.613086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd9b640d-70b5-4dea-8d78-71549f1e6fb2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:57.613506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd9b640d-70b5-4dea-8d78-71549f1e6fb2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:57.615272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ce8ea99-b1b8-42f1-ade0-a88dd5723f6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.161401 Aug 31 00:50:57.616376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1216/2371] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:57.675018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bd9b640d-70b5-4dea-8d78-71549f1e6fb2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:57.683840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bd9b640d-70b5-4dea-8d78-71549f1e6fb2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083966 Aug 31 00:50:57.684404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1156/2372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:57 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:58.527962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:58.528556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:58.535145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:58.535636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:58.536107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:58.536789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:58.537241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:58.537879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:58.600921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:58.609703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:58.611187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:58.612325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ebad9f95-d770-4a7f-aec8-ea613ebd7bfa tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088443 Aug 31 00:50:58.612884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1217/2373] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:58.638170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c296bc39-9f73-4455-a41d-832bb1c8b0b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:58.638780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c296bc39-9f73-4455-a41d-832bb1c8b0b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:58.645137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c296bc39-9f73-4455-a41d-832bb1c8b0b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:58.645624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c296bc39-9f73-4455-a41d-832bb1c8b0b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:58.646079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c296bc39-9f73-4455-a41d-832bb1c8b0b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:58.646829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c296bc39-9f73-4455-a41d-832bb1c8b0b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:58.648182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c296bc39-9f73-4455-a41d-832bb1c8b0b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:58.648627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c296bc39-9f73-4455-a41d-832bb1c8b0b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:58.705419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9f23d5a2-5919-423b-96ba-29067d074aed tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:58.706061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9f23d5a2-5919-423b-96ba-29067d074aed tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:58.713231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f23d5a2-5919-423b-96ba-29067d074aed tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:58.713715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f23d5a2-5919-423b-96ba-29067d074aed tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:58.714149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f23d5a2-5919-423b-96ba-29067d074aed tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:58.714848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f23d5a2-5919-423b-96ba-29067d074aed tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:58.715324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f23d5a2-5919-423b-96ba-29067d074aed tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:58.715747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f23d5a2-5919-423b-96ba-29067d074aed tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:58.785168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9f23d5a2-5919-423b-96ba-29067d074aed tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:58.794430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9f23d5a2-5919-423b-96ba-29067d074aed tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.092786 Aug 31 00:50:58.795012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1218/2374] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:58 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:58.808473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c296bc39-9f73-4455-a41d-832bb1c8b0b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:58.816766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c296bc39-9f73-4455-a41d-832bb1c8b0b1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.182407 Aug 31 00:50:58.817327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1157/2375] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:50:59.754893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:59.755754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:59.762678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:59.763193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:59.763631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:59.764314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:59.764759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:59.765176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:59.816781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a4315341-903f-4a72-8abf-eef04afada52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:59.817386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a4315341-903f-4a72-8abf-eef04afada52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:59.824858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4315341-903f-4a72-8abf-eef04afada52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:59.825109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4315341-903f-4a72-8abf-eef04afada52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:59.825543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4315341-903f-4a72-8abf-eef04afada52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:59.826228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4315341-903f-4a72-8abf-eef04afada52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:59.826679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4315341-903f-4a72-8abf-eef04afada52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:59.826863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:59.827192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4315341-903f-4a72-8abf-eef04afada52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:59.836744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:59.838188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:59.839349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-91712677-61a7-44c5-83fa-0259e07d37b0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.206653 Aug 31 00:50:59.839907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1219/2376] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:50:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:50:59.844223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-af722a0f-3d92-4b90-a86a-dfe8aafedfdf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:50:59.844820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-af722a0f-3d92-4b90-a86a-dfe8aafedfdf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:50:59.851222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af722a0f-3d92-4b90-a86a-dfe8aafedfdf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:59.851929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af722a0f-3d92-4b90-a86a-dfe8aafedfdf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:59.852654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af722a0f-3d92-4b90-a86a-dfe8aafedfdf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:59.853413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af722a0f-3d92-4b90-a86a-dfe8aafedfdf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:50:59.853791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af722a0f-3d92-4b90-a86a-dfe8aafedfdf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:50:59.854207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af722a0f-3d92-4b90-a86a-dfe8aafedfdf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:50:59.893578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a4315341-903f-4a72-8abf-eef04afada52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:59.902502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a4315341-903f-4a72-8abf-eef04afada52 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089679 Aug 31 00:50:59.903100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1158/2377] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:59 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:50:59.986065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-af722a0f-3d92-4b90-a86a-dfe8aafedfdf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:50:59.994592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-af722a0f-3d92-4b90-a86a-dfe8aafedfdf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153708 Aug 31 00:50:59.995935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1220/2378] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:50:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:00.864351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:00.864999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:00.872182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:00.872667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:00.873095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:00.873774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:00.874218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:00.874634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:00.924545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b549fc67-111e-4c49-b634-cc86d3fceba0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:00.925505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b549fc67-111e-4c49-b634-cc86d3fceba0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:00.933404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b549fc67-111e-4c49-b634-cc86d3fceba0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:00.933978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b549fc67-111e-4c49-b634-cc86d3fceba0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:00.934509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b549fc67-111e-4c49-b634-cc86d3fceba0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:00.935449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b549fc67-111e-4c49-b634-cc86d3fceba0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:00.936016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b549fc67-111e-4c49-b634-cc86d3fceba0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:00.936505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b549fc67-111e-4c49-b634-cc86d3fceba0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:00.947026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:00.955830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:00.957248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:00.958374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d5f44ab9-d624-41f8-8116-acc0a720efef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.097970 Aug 31 00:51:00.970514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1159/2379] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:01.003098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b549fc67-111e-4c49-b634-cc86d3fceba0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:01.005234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:01.012946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b549fc67-111e-4c49-b634-cc86d3fceba0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.092154 Aug 31 00:51:01.013519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1221/2380] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:01.016702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ce685230-dbec-42ac-9517-b2d627f3ff28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:01.017306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ce685230-dbec-42ac-9517-b2d627f3ff28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:01.023380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce685230-dbec-42ac-9517-b2d627f3ff28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:01.023865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce685230-dbec-42ac-9517-b2d627f3ff28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:01.024288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce685230-dbec-42ac-9517-b2d627f3ff28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:01.024963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce685230-dbec-42ac-9517-b2d627f3ff28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:01.025405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce685230-dbec-42ac-9517-b2d627f3ff28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:01.025851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce685230-dbec-42ac-9517-b2d627f3ff28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:01.163532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ce685230-dbec-42ac-9517-b2d627f3ff28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:01.172282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ce685230-dbec-42ac-9517-b2d627f3ff28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.159547 Aug 31 00:51:01.172845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1160/2381] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:01.983157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:01.983765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:01.985898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:51:01.986079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 (ip 10.222.0.67) !!! Aug 31 00:51:01.993439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:01.993916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:01.994342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:01.995024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:01.995748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:01.995895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:02.033607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a29c5852-03fa-4751-ada2-cbc11dd77c61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:02.034193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a29c5852-03fa-4751-ada2-cbc11dd77c61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:02.042076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a29c5852-03fa-4751-ada2-cbc11dd77c61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:02.042560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a29c5852-03fa-4751-ada2-cbc11dd77c61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:02.042985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a29c5852-03fa-4751-ada2-cbc11dd77c61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:02.043701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a29c5852-03fa-4751-ada2-cbc11dd77c61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:02.044142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a29c5852-03fa-4751-ada2-cbc11dd77c61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:02.044556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a29c5852-03fa-4751-ada2-cbc11dd77c61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:02.061751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:02.070417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:02.071957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:02.073029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-612d316c-c42f-4bba-98b2-c0b9aa9f8054 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.093904 Aug 31 00:51:02.073584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1222/2382] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:02.106440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a29c5852-03fa-4751-ada2-cbc11dd77c61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:02.114702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a29c5852-03fa-4751-ada2-cbc11dd77c61 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084875 Aug 31 00:51:02.115307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1161/2383] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:02 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:02.195300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-47f238e2-8040-4091-a554-7b18eeaa0e20 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:02.195899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-47f238e2-8040-4091-a554-7b18eeaa0e20 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:02.201861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47f238e2-8040-4091-a554-7b18eeaa0e20 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:02.202340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47f238e2-8040-4091-a554-7b18eeaa0e20 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:02.202765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47f238e2-8040-4091-a554-7b18eeaa0e20 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:02.203466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47f238e2-8040-4091-a554-7b18eeaa0e20 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:02.203908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47f238e2-8040-4091-a554-7b18eeaa0e20 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:02.204321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-47f238e2-8040-4091-a554-7b18eeaa0e20 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:02.337488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-47f238e2-8040-4091-a554-7b18eeaa0e20 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:02.345696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-47f238e2-8040-4091-a554-7b18eeaa0e20 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154822 Aug 31 00:51:02.346264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1223/2384] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:03.096093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:03.096691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:03.103659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:03.104143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:03.104575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:03.105285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:03.105732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:03.106153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:03.137046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d4a045bb-ce64-461e-8caa-af52a9979dde tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:03.137681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d4a045bb-ce64-461e-8caa-af52a9979dde tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:03.144178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4a045bb-ce64-461e-8caa-af52a9979dde tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:03.144657 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4a045bb-ce64-461e-8caa-af52a9979dde tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:03.145090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4a045bb-ce64-461e-8caa-af52a9979dde tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:03.145783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4a045bb-ce64-461e-8caa-af52a9979dde tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:03.146220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4a045bb-ce64-461e-8caa-af52a9979dde tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:03.146640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d4a045bb-ce64-461e-8caa-af52a9979dde tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:03.168650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:03.180925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:03.182770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:03.183564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bfee3539-843e-4d77-b676-964426748f45 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091393 Aug 31 00:51:03.184541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1162/2385] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:03.211198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d4a045bb-ce64-461e-8caa-af52a9979dde tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:03.219476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d4a045bb-ce64-461e-8caa-af52a9979dde tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086198 Aug 31 00:51:03.220044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1224/2386] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:03 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:03.369154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3a2404f2-334e-40b6-a1d0-555b4301645a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:03.369754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3a2404f2-334e-40b6-a1d0-555b4301645a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:03.375655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a2404f2-334e-40b6-a1d0-555b4301645a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:03.376123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a2404f2-334e-40b6-a1d0-555b4301645a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:03.376549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a2404f2-334e-40b6-a1d0-555b4301645a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:03.377216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a2404f2-334e-40b6-a1d0-555b4301645a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:03.377658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a2404f2-334e-40b6-a1d0-555b4301645a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:03.378069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a2404f2-334e-40b6-a1d0-555b4301645a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:03.506448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3a2404f2-334e-40b6-a1d0-555b4301645a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:03.515219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3a2404f2-334e-40b6-a1d0-555b4301645a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150626 Aug 31 00:51:03.515794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1163/2387] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:04.206116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:04.206734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:04.215015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:04.218728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:04.219213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:04.219926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:04.220387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:04.220817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:04.240709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c7b64de0-49ba-44c0-a7bf-c8985cf19d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:04.241497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c7b64de0-49ba-44c0-a7bf-c8985cf19d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:04.248149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b64de0-49ba-44c0-a7bf-c8985cf19d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:04.248552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b64de0-49ba-44c0-a7bf-c8985cf19d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:04.248994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b64de0-49ba-44c0-a7bf-c8985cf19d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:04.249678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b64de0-49ba-44c0-a7bf-c8985cf19d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:04.250133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b64de0-49ba-44c0-a7bf-c8985cf19d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:04.250555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b64de0-49ba-44c0-a7bf-c8985cf19d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:04.290246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:04.298913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:04.300417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:04.301557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8993919c-1ff4-459e-a231-3ce1efd7284e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.099638 Aug 31 00:51:04.302293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1225/2388] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:04.315813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c7b64de0-49ba-44c0-a7bf-c8985cf19d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:04.324253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c7b64de0-49ba-44c0-a7bf-c8985cf19d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087358 Aug 31 00:51:04.324818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1164/2389] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:04 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:04.537474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f9ec607a-07c1-442a-9a57-9e9a5510fc0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:04.538112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f9ec607a-07c1-442a-9a57-9e9a5510fc0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:04.544335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ec607a-07c1-442a-9a57-9e9a5510fc0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:04.544820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ec607a-07c1-442a-9a57-9e9a5510fc0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:04.545255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ec607a-07c1-442a-9a57-9e9a5510fc0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:04.546005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ec607a-07c1-442a-9a57-9e9a5510fc0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:04.546419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ec607a-07c1-442a-9a57-9e9a5510fc0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:04.546843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f9ec607a-07c1-442a-9a57-9e9a5510fc0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:04.678085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f9ec607a-07c1-442a-9a57-9e9a5510fc0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:04.686568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f9ec607a-07c1-442a-9a57-9e9a5510fc0b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153004 Aug 31 00:51:04.687153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1226/2390] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:05.324427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:05.325037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:05.331630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:05.332116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:05.332547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:05.333228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:05.333841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:05.334266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:05.345557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8e809708-582b-4514-9c64-feca9e875f3a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:05.346166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8e809708-582b-4514-9c64-feca9e875f3a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:05.353776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e809708-582b-4514-9c64-feca9e875f3a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:05.354268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e809708-582b-4514-9c64-feca9e875f3a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:05.354704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e809708-582b-4514-9c64-feca9e875f3a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:05.355436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e809708-582b-4514-9c64-feca9e875f3a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:05.355888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e809708-582b-4514-9c64-feca9e875f3a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:05.356312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e809708-582b-4514-9c64-feca9e875f3a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:05.401536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:05.410422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:05.411873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:05.413076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3c03f9b5-d56b-4615-9d51-a2166bcd92da tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092549 Aug 31 00:51:05.413643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1165/2391] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:05.427305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8e809708-582b-4514-9c64-feca9e875f3a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:05.435669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8e809708-582b-4514-9c64-feca9e875f3a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.093860 Aug 31 00:51:05.436240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1227/2392] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:05 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:05.708422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-98bcd9a3-a152-4d76-a2fd-e8847dd36ba8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:05.709059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-98bcd9a3-a152-4d76-a2fd-e8847dd36ba8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:05.715854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98bcd9a3-a152-4d76-a2fd-e8847dd36ba8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:05.716328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98bcd9a3-a152-4d76-a2fd-e8847dd36ba8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:05.716754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98bcd9a3-a152-4d76-a2fd-e8847dd36ba8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:05.717424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98bcd9a3-a152-4d76-a2fd-e8847dd36ba8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:05.717866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98bcd9a3-a152-4d76-a2fd-e8847dd36ba8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:05.718279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-98bcd9a3-a152-4d76-a2fd-e8847dd36ba8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:05.852601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-98bcd9a3-a152-4d76-a2fd-e8847dd36ba8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:05.860886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-98bcd9a3-a152-4d76-a2fd-e8847dd36ba8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156330 Aug 31 00:51:05.861451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1166/2393] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:06.436325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:06.436942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:06.443355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:06.443830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:06.444308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:06.445099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:06.445552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:06.445970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:06.457251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fa8e88b7-de67-47e7-8e97-78073819c810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:06.457855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fa8e88b7-de67-47e7-8e97-78073819c810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:06.464891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa8e88b7-de67-47e7-8e97-78073819c810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:06.465376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa8e88b7-de67-47e7-8e97-78073819c810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:06.465809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa8e88b7-de67-47e7-8e97-78073819c810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:06.466491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa8e88b7-de67-47e7-8e97-78073819c810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:06.466937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa8e88b7-de67-47e7-8e97-78073819c810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:06.467383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fa8e88b7-de67-47e7-8e97-78073819c810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:06.511956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:06.521024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:06.523109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:06.524691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5a8a5a5d-a841-4379-af31-01db9c22ef8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092277 Aug 31 00:51:06.525259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1228/2394] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:06.538795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fa8e88b7-de67-47e7-8e97-78073819c810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:06.547164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fa8e88b7-de67-47e7-8e97-78073819c810 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.093601 Aug 31 00:51:06.547727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1167/2395] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:06 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:06.881710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1e6b7643-c6ac-4b7d-b711-9633fc6ae0ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:06.882501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1e6b7643-c6ac-4b7d-b711-9633fc6ae0ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:06.888484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6b7643-c6ac-4b7d-b711-9633fc6ae0ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:06.888962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6b7643-c6ac-4b7d-b711-9633fc6ae0ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:06.889391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6b7643-c6ac-4b7d-b711-9633fc6ae0ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:06.890066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6b7643-c6ac-4b7d-b711-9633fc6ae0ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:06.890513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6b7643-c6ac-4b7d-b711-9633fc6ae0ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:06.890930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e6b7643-c6ac-4b7d-b711-9633fc6ae0ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:07.022973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1e6b7643-c6ac-4b7d-b711-9633fc6ae0ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:07.031318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1e6b7643-c6ac-4b7d-b711-9633fc6ae0ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153414 Aug 31 00:51:07.031931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1229/2396] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:07.548776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:07.549313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:07.559175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:07.559984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:07.560596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:07.561348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:07.562128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:07.562808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:07.568680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9c2853f1-96fa-4b88-8f47-10391a68bbf1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:07.569560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9c2853f1-96fa-4b88-8f47-10391a68bbf1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:07.575882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c2853f1-96fa-4b88-8f47-10391a68bbf1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:07.576371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c2853f1-96fa-4b88-8f47-10391a68bbf1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:07.576803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c2853f1-96fa-4b88-8f47-10391a68bbf1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:07.577496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c2853f1-96fa-4b88-8f47-10391a68bbf1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:07.577950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c2853f1-96fa-4b88-8f47-10391a68bbf1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:07.578370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c2853f1-96fa-4b88-8f47-10391a68bbf1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:07.626927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:07.636443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:07.637903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:07.639095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0953e4ff-49d5-4128-873b-37f9cc02717a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.094297 Aug 31 00:51:07.639704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1168/2397] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:07.655606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9c2853f1-96fa-4b88-8f47-10391a68bbf1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:07.664715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9c2853f1-96fa-4b88-8f47-10391a68bbf1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.099827 Aug 31 00:51:07.665282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1230/2398] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:07 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:08.053206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f67f7742-fa72-4479-9fd6-37c6cfb6aa52 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:08.053817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f67f7742-fa72-4479-9fd6-37c6cfb6aa52 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:08.059876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67f7742-fa72-4479-9fd6-37c6cfb6aa52 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:08.060347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67f7742-fa72-4479-9fd6-37c6cfb6aa52 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:08.060773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67f7742-fa72-4479-9fd6-37c6cfb6aa52 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:08.061440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67f7742-fa72-4479-9fd6-37c6cfb6aa52 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:08.061882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67f7742-fa72-4479-9fd6-37c6cfb6aa52 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:08.062295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67f7742-fa72-4479-9fd6-37c6cfb6aa52 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:08.189082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f67f7742-fa72-4479-9fd6-37c6cfb6aa52 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:08.197933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f67f7742-fa72-4479-9fd6-37c6cfb6aa52 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148555 Aug 31 00:51:08.198500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1169/2399] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:08.661800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:08.662399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:08.669630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:08.670107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:08.670536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:08.671274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:08.671730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:08.672151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:08.685704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-205c87c3-541c-48ac-bbce-772cabcab79a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:08.686304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-205c87c3-541c-48ac-bbce-772cabcab79a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:08.688184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=80 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:08.693400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-205c87c3-541c-48ac-bbce-772cabcab79a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:08.693883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-205c87c3-541c-48ac-bbce-772cabcab79a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:08.694331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-205c87c3-541c-48ac-bbce-772cabcab79a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:08.695009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-205c87c3-541c-48ac-bbce-772cabcab79a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:08.695470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-205c87c3-541c-48ac-bbce-772cabcab79a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:08.695883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-205c87c3-541c-48ac-bbce-772cabcab79a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:08.711611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:08.738103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:08.747368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:08.748790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:08.750028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-55a9b7b4-b433-4050-92dc-499194196c60 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092204 Aug 31 00:51:08.755201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1231/2400] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:08.764028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-205c87c3-541c-48ac-bbce-772cabcab79a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:08.772829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-205c87c3-541c-48ac-bbce-772cabcab79a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090396 Aug 31 00:51:08.773474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1170/2401] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:08 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:09.218775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-50cfd61a-3ac2-48f3-b092-0e92f641fbcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:09.219408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-50cfd61a-3ac2-48f3-b092-0e92f641fbcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:09.225544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50cfd61a-3ac2-48f3-b092-0e92f641fbcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:09.226305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50cfd61a-3ac2-48f3-b092-0e92f641fbcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:09.226750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50cfd61a-3ac2-48f3-b092-0e92f641fbcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:09.227734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50cfd61a-3ac2-48f3-b092-0e92f641fbcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:09.228191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50cfd61a-3ac2-48f3-b092-0e92f641fbcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:09.228618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50cfd61a-3ac2-48f3-b092-0e92f641fbcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:09.360651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-50cfd61a-3ac2-48f3-b092-0e92f641fbcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:09.370479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-50cfd61a-3ac2-48f3-b092-0e92f641fbcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155517 Aug 31 00:51:09.371064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1232/2402] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:09.773475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:09.774084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:09.781491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:09.782893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:09.783443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:09.784182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:09.784653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:09.785091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:09.794730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-576f8823-2ecc-4a4b-85a8-025981be8dc9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:09.795400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-576f8823-2ecc-4a4b-85a8-025981be8dc9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:09.802036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-576f8823-2ecc-4a4b-85a8-025981be8dc9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:09.802529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-576f8823-2ecc-4a4b-85a8-025981be8dc9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:09.802968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-576f8823-2ecc-4a4b-85a8-025981be8dc9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:09.806646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-576f8823-2ecc-4a4b-85a8-025981be8dc9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:09.806646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-576f8823-2ecc-4a4b-85a8-025981be8dc9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:09.806646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-576f8823-2ecc-4a4b-85a8-025981be8dc9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:09.914154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-576f8823-2ecc-4a4b-85a8-025981be8dc9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:09.915401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:09.923363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-576f8823-2ecc-4a4b-85a8-025981be8dc9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.132381 Aug 31 00:51:09.932370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1233/2403] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:09 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:09.937616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:09.939575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:09.940729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-65e688e9-db69-4ec6-b02d-2431c70052b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.171377 Aug 31 00:51:09.950571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1171/2404] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:10.391813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-82b9889a-8f5d-4471-b449-c536551ccc8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:10.393549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-82b9889a-8f5d-4471-b449-c536551ccc8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:10.400316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82b9889a-8f5d-4471-b449-c536551ccc8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:10.400799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82b9889a-8f5d-4471-b449-c536551ccc8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:10.401237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82b9889a-8f5d-4471-b449-c536551ccc8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:10.401920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82b9889a-8f5d-4471-b449-c536551ccc8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:10.402373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82b9889a-8f5d-4471-b449-c536551ccc8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:10.402794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82b9889a-8f5d-4471-b449-c536551ccc8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:10.532443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-82b9889a-8f5d-4471-b449-c536551ccc8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:10.541440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-82b9889a-8f5d-4471-b449-c536551ccc8e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153516 Aug 31 00:51:10.542003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1234/2405] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:10.945498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-90d8329d-6661-4190-8bcf-9178a3ccbc2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:10.946092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-90d8329d-6661-4190-8bcf-9178a3ccbc2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:10.952457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90d8329d-6661-4190-8bcf-9178a3ccbc2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:10.952927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90d8329d-6661-4190-8bcf-9178a3ccbc2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:10.953354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90d8329d-6661-4190-8bcf-9178a3ccbc2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:10.954021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90d8329d-6661-4190-8bcf-9178a3ccbc2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:10.954463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90d8329d-6661-4190-8bcf-9178a3ccbc2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:10.954877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90d8329d-6661-4190-8bcf-9178a3ccbc2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:10.964395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:10.964986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:10.971506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:10.971987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:10.972410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:10.973089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:10.973956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:10.973956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:11.018812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-90d8329d-6661-4190-8bcf-9178a3ccbc2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:11.027932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-90d8329d-6661-4190-8bcf-9178a3ccbc2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086306 Aug 31 00:51:11.028519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1172/2406] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:10 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:11.045203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:11.054367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:11.055835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:11.056961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9277a33c-5e83-44f3-9a40-82baf16b04c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.096361 Aug 31 00:51:11.057518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1235/2407] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:11.563655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c486f2fc-954e-4e9b-bd9e-43fb40b70763 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:11.564181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c486f2fc-954e-4e9b-bd9e-43fb40b70763 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:11.573143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c486f2fc-954e-4e9b-bd9e-43fb40b70763 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:11.573774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c486f2fc-954e-4e9b-bd9e-43fb40b70763 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:11.575177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c486f2fc-954e-4e9b-bd9e-43fb40b70763 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:11.575892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c486f2fc-954e-4e9b-bd9e-43fb40b70763 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:11.576351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c486f2fc-954e-4e9b-bd9e-43fb40b70763 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:11.576775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c486f2fc-954e-4e9b-bd9e-43fb40b70763 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:11.712110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c486f2fc-954e-4e9b-bd9e-43fb40b70763 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:11.720305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c486f2fc-954e-4e9b-bd9e-43fb40b70763 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.160558 Aug 31 00:51:11.720868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1173/2408] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:12.049838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-abcf29cd-4f7c-4d7f-a57e-ae100bfb7f66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:12.050445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-abcf29cd-4f7c-4d7f-a57e-ae100bfb7f66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:12.057064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abcf29cd-4f7c-4d7f-a57e-ae100bfb7f66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:12.057552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abcf29cd-4f7c-4d7f-a57e-ae100bfb7f66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:12.057991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abcf29cd-4f7c-4d7f-a57e-ae100bfb7f66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:12.058698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abcf29cd-4f7c-4d7f-a57e-ae100bfb7f66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:12.059159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abcf29cd-4f7c-4d7f-a57e-ae100bfb7f66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:12.059583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abcf29cd-4f7c-4d7f-a57e-ae100bfb7f66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:12.080086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:12.080691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:12.088306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:12.088788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:12.089222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:12.089913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:12.090370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:12.090791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:12.123212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-abcf29cd-4f7c-4d7f-a57e-ae100bfb7f66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:12.132799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-abcf29cd-4f7c-4d7f-a57e-ae100bfb7f66 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086528 Aug 31 00:51:12.133388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1236/2409] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:12 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:12.154139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:12.162667 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:12.164240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:12.165354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6dc6a0fa-1901-4fd9-b79a-a60413ee9b66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089170 Aug 31 00:51:12.165905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1174/2410] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:12.741644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e6e2ecec-cd03-4c78-842b-988157888b46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:12.742239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e6e2ecec-cd03-4c78-842b-988157888b46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:12.744111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=84 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:12.749240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6e2ecec-cd03-4c78-842b-988157888b46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:12.749713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6e2ecec-cd03-4c78-842b-988157888b46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:12.750138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6e2ecec-cd03-4c78-842b-988157888b46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:12.750813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6e2ecec-cd03-4c78-842b-988157888b46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:12.751300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6e2ecec-cd03-4c78-842b-988157888b46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:12.751718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6e2ecec-cd03-4c78-842b-988157888b46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:12.885074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e6e2ecec-cd03-4c78-842b-988157888b46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:12.893164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e6e2ecec-cd03-4c78-842b-988157888b46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155361 Aug 31 00:51:12.893714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1237/2411] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:13.153979 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b1fd4ee6-af19-4cce-85aa-3ea6191dff9b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:13.154525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b1fd4ee6-af19-4cce-85aa-3ea6191dff9b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:13.160894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1fd4ee6-af19-4cce-85aa-3ea6191dff9b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:13.161371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1fd4ee6-af19-4cce-85aa-3ea6191dff9b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:13.161804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1fd4ee6-af19-4cce-85aa-3ea6191dff9b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:13.162569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1fd4ee6-af19-4cce-85aa-3ea6191dff9b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:13.163759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1fd4ee6-af19-4cce-85aa-3ea6191dff9b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:13.164317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1fd4ee6-af19-4cce-85aa-3ea6191dff9b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:13.187685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:13.188269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:13.195012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:13.195523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:13.195953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:13.196641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:13.197090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:13.197510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:13.213344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:13.225626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b1fd4ee6-af19-4cce-85aa-3ea6191dff9b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:13.234283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b1fd4ee6-af19-4cce-85aa-3ea6191dff9b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084236 Aug 31 00:51:13.234862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1175/2412] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:13 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:13.262126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:13.270627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:13.272200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:13.273324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-032d053e-85c0-44a3-a83b-181b6163bc26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089465 Aug 31 00:51:13.273867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1238/2413] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:13.914761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e71f517e-3608-44df-9adc-e53103ee6821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:13.915394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e71f517e-3608-44df-9adc-e53103ee6821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:13.921376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e71f517e-3608-44df-9adc-e53103ee6821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:13.921854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e71f517e-3608-44df-9adc-e53103ee6821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:13.922289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e71f517e-3608-44df-9adc-e53103ee6821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:13.922970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e71f517e-3608-44df-9adc-e53103ee6821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:13.923449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e71f517e-3608-44df-9adc-e53103ee6821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:13.923872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e71f517e-3608-44df-9adc-e53103ee6821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:14.051371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e71f517e-3608-44df-9adc-e53103ee6821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:14.059669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e71f517e-3608-44df-9adc-e53103ee6821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149414 Aug 31 00:51:14.060236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1176/2414] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:14.256217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-537b8b34-35c0-456c-90d1-71485baacf34 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:14.256929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-537b8b34-35c0-456c-90d1-71485baacf34 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:14.263825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537b8b34-35c0-456c-90d1-71485baacf34 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:14.264300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537b8b34-35c0-456c-90d1-71485baacf34 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:14.264724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537b8b34-35c0-456c-90d1-71485baacf34 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:14.265399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537b8b34-35c0-456c-90d1-71485baacf34 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:14.265842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537b8b34-35c0-456c-90d1-71485baacf34 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:14.266256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537b8b34-35c0-456c-90d1-71485baacf34 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:14.295806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:14.296530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:14.303855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:14.304727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:14.305302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:14.306071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:14.306604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:14.307053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:14.329397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-537b8b34-35c0-456c-90d1-71485baacf34 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:14.337863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-537b8b34-35c0-456c-90d1-71485baacf34 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085546 Aug 31 00:51:14.338430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1239/2415] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:14 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:14.369573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:14.378122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:14.379592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:14.380725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cfdd8cd0-81c4-4448-bf5d-86e1a3305181 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088806 Aug 31 00:51:14.381831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1177/2416] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:15.081212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-befcf38b-7229-44fc-a8ac-3d4356172091 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:15.081809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-befcf38b-7229-44fc-a8ac-3d4356172091 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:15.087785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-befcf38b-7229-44fc-a8ac-3d4356172091 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:15.088259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-befcf38b-7229-44fc-a8ac-3d4356172091 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:15.088691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-befcf38b-7229-44fc-a8ac-3d4356172091 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:15.089359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-befcf38b-7229-44fc-a8ac-3d4356172091 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:15.089820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-befcf38b-7229-44fc-a8ac-3d4356172091 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:15.090216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-befcf38b-7229-44fc-a8ac-3d4356172091 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:15.218490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-befcf38b-7229-44fc-a8ac-3d4356172091 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:15.227559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-befcf38b-7229-44fc-a8ac-3d4356172091 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150151 Aug 31 00:51:15.228118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1240/2417] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:15.358742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-836d0ea2-d5a5-43c6-89cc-b152a860fb6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:15.359373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-836d0ea2-d5a5-43c6-89cc-b152a860fb6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:15.366192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-836d0ea2-d5a5-43c6-89cc-b152a860fb6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:15.366659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-836d0ea2-d5a5-43c6-89cc-b152a860fb6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:15.367117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-836d0ea2-d5a5-43c6-89cc-b152a860fb6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:15.367786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-836d0ea2-d5a5-43c6-89cc-b152a860fb6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:15.368227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-836d0ea2-d5a5-43c6-89cc-b152a860fb6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:15.368638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-836d0ea2-d5a5-43c6-89cc-b152a860fb6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:15.405530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:15.406135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:15.413420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:15.413976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:15.414409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:15.415121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:15.415572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:15.415985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:15.431579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-836d0ea2-d5a5-43c6-89cc-b152a860fb6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:15.439659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-836d0ea2-d5a5-43c6-89cc-b152a860fb6f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084693 Aug 31 00:51:15.440199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1178/2418] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:15 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:15.481077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:15.489725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:15.491835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:15.492964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d25b7a52-3cd3-4840-9c0e-91ff8e55f7eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091272 Aug 31 00:51:15.493513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1241/2419] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:16.249910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0eb5f4c1-9682-49f3-8ce9-5488d3e8eb94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:16.250434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0eb5f4c1-9682-49f3-8ce9-5488d3e8eb94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:16.257100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0eb5f4c1-9682-49f3-8ce9-5488d3e8eb94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:16.257578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0eb5f4c1-9682-49f3-8ce9-5488d3e8eb94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:16.258009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0eb5f4c1-9682-49f3-8ce9-5488d3e8eb94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:16.258694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0eb5f4c1-9682-49f3-8ce9-5488d3e8eb94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:16.259166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0eb5f4c1-9682-49f3-8ce9-5488d3e8eb94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:16.259589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0eb5f4c1-9682-49f3-8ce9-5488d3e8eb94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:16.385222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0eb5f4c1-9682-49f3-8ce9-5488d3e8eb94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:16.393328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0eb5f4c1-9682-49f3-8ce9-5488d3e8eb94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.147422 Aug 31 00:51:16.393885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1179/2420] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:16.462123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1579a6d3-7fa6-4827-a024-22dd8bae98e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:16.462732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1579a6d3-7fa6-4827-a024-22dd8bae98e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:16.469161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1579a6d3-7fa6-4827-a024-22dd8bae98e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:16.469648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1579a6d3-7fa6-4827-a024-22dd8bae98e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:16.470102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1579a6d3-7fa6-4827-a024-22dd8bae98e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:16.470767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1579a6d3-7fa6-4827-a024-22dd8bae98e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:16.471254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1579a6d3-7fa6-4827-a024-22dd8bae98e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:16.471699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1579a6d3-7fa6-4827-a024-22dd8bae98e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:16.516042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:16.516566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:16.522826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:16.523343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:16.523778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:16.524466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:16.524915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:16.525335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:16.533577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1579a6d3-7fa6-4827-a024-22dd8bae98e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:16.543275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1579a6d3-7fa6-4827-a024-22dd8bae98e8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085339 Aug 31 00:51:16.543857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1242/2421] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:16 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:16.590649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:16.599421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:16.601405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:16.602791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5e0ae502-d1d0-4992-931f-6bb3b95c47a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090729 Aug 31 00:51:16.603377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1180/2422] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:17.417326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9b4284d0-761f-40cc-a517-bb31923494ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:17.417915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9b4284d0-761f-40cc-a517-bb31923494ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:17.423872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4284d0-761f-40cc-a517-bb31923494ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:17.424348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4284d0-761f-40cc-a517-bb31923494ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:17.424777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4284d0-761f-40cc-a517-bb31923494ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:17.425444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4284d0-761f-40cc-a517-bb31923494ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:17.425890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4284d0-761f-40cc-a517-bb31923494ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:17.426461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b4284d0-761f-40cc-a517-bb31923494ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:17.556868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9b4284d0-761f-40cc-a517-bb31923494ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:17.564654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c6803c0-5365-4e9c-987f-af8712bddf53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:17.565251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c6803c0-5365-4e9c-987f-af8712bddf53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:17.565370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9b4284d0-761f-40cc-a517-bb31923494ee tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152855 Aug 31 00:51:17.565945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1243/2423] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:17.572631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6803c0-5365-4e9c-987f-af8712bddf53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:17.573115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6803c0-5365-4e9c-987f-af8712bddf53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:17.573542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6803c0-5365-4e9c-987f-af8712bddf53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:17.574229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6803c0-5365-4e9c-987f-af8712bddf53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:17.574671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6803c0-5365-4e9c-987f-af8712bddf53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:17.575110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6803c0-5365-4e9c-987f-af8712bddf53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:17.625719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:17.626329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:17.632426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:17.632904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:17.633337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:17.634022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:17.634480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:17.634899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:17.640647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0c6803c0-5365-4e9c-987f-af8712bddf53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:17.649878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c6803c0-5365-4e9c-987f-af8712bddf53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088952 Aug 31 00:51:17.650462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1181/2424] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:17 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:17.696375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:17.705032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:17.706475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:17.707637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c895a435-7e1c-4f8a-92a0-f45771165b25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085810 Aug 31 00:51:17.708228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1244/2425] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:18.585704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a1cc975a-5a33-4a48-a0b6-324bd864f681 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:18.586299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a1cc975a-5a33-4a48-a0b6-324bd864f681 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:18.592743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1cc975a-5a33-4a48-a0b6-324bd864f681 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:18.593217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1cc975a-5a33-4a48-a0b6-324bd864f681 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:18.593641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1cc975a-5a33-4a48-a0b6-324bd864f681 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:18.594310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1cc975a-5a33-4a48-a0b6-324bd864f681 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:18.594956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1cc975a-5a33-4a48-a0b6-324bd864f681 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:18.595399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1cc975a-5a33-4a48-a0b6-324bd864f681 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:18.671868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-24f6b1ad-3b19-4d7b-9241-1139d62fe81e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:18.672435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-24f6b1ad-3b19-4d7b-9241-1139d62fe81e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:18.680006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24f6b1ad-3b19-4d7b-9241-1139d62fe81e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:18.680503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24f6b1ad-3b19-4d7b-9241-1139d62fe81e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:18.680941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24f6b1ad-3b19-4d7b-9241-1139d62fe81e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:18.681652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24f6b1ad-3b19-4d7b-9241-1139d62fe81e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:18.682105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24f6b1ad-3b19-4d7b-9241-1139d62fe81e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:18.682529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24f6b1ad-3b19-4d7b-9241-1139d62fe81e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:18.930341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-24f6b1ad-3b19-4d7b-9241-1139d62fe81e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:18.938526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-24f6b1ad-3b19-4d7b-9241-1139d62fe81e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.270626 Aug 31 00:51:18.939116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1245/2426] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:18 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:18.943973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:18.944673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:18.950510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:18.950997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:18.951463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:18.952160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:18.952612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:18.953035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:18.988960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a1cc975a-5a33-4a48-a0b6-324bd864f681 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:18.998221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a1cc975a-5a33-4a48-a0b6-324bd864f681 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.416314 Aug 31 00:51:18.998802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1182/2427] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:18 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:19.017384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:19.026679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:19.028151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:19.029278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8b7037b0-65a7-4aec-ab7a-d2b7aac9d6a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089260 Aug 31 00:51:19.029829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1246/2428] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:19.960312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a8a41475-cfb7-4611-9bba-03d52ab6573d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:19.960910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a8a41475-cfb7-4611-9bba-03d52ab6573d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:19.967354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8a41475-cfb7-4611-9bba-03d52ab6573d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:19.967836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8a41475-cfb7-4611-9bba-03d52ab6573d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:19.968263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8a41475-cfb7-4611-9bba-03d52ab6573d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:19.968945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8a41475-cfb7-4611-9bba-03d52ab6573d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:19.969392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8a41475-cfb7-4611-9bba-03d52ab6573d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:19.969809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8a41475-cfb7-4611-9bba-03d52ab6573d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:20.020000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cb3e3a5e-909f-459a-a269-069121dd52ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:20.020604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cb3e3a5e-909f-459a-a269-069121dd52ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:20.027667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb3e3a5e-909f-459a-a269-069121dd52ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:20.028179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb3e3a5e-909f-459a-a269-069121dd52ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:20.028692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb3e3a5e-909f-459a-a269-069121dd52ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:20.029385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb3e3a5e-909f-459a-a269-069121dd52ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:20.029838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb3e3a5e-909f-459a-a269-069121dd52ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:20.030262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb3e3a5e-909f-459a-a269-069121dd52ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:20.034589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a8a41475-cfb7-4611-9bba-03d52ab6573d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:20.043481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a8a41475-cfb7-4611-9bba-03d52ab6573d tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087007 Aug 31 00:51:20.044054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1183/2429] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:19 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:20.052772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:20.053546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:20.059368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:20.059841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:20.060272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:20.060945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:20.061383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:20.061797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:20.128998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:20.137962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:20.139430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:20.140553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f422ddbd-55b3-4d93-8b1b-79b03f10f3dc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091508 Aug 31 00:51:20.141131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1184/2430] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:20.187630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cb3e3a5e-909f-459a-a269-069121dd52ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:20.196012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cb3e3a5e-909f-459a-a269-069121dd52ac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.179991 Aug 31 00:51:20.196575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1247/2431] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:21.065266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-044dc618-85f5-4514-b5c6-9d5e74b5b08c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:21.065969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-044dc618-85f5-4514-b5c6-9d5e74b5b08c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:21.072847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044dc618-85f5-4514-b5c6-9d5e74b5b08c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:21.073327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044dc618-85f5-4514-b5c6-9d5e74b5b08c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:21.073754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044dc618-85f5-4514-b5c6-9d5e74b5b08c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:21.074425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044dc618-85f5-4514-b5c6-9d5e74b5b08c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:21.074868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044dc618-85f5-4514-b5c6-9d5e74b5b08c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:21.075313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-044dc618-85f5-4514-b5c6-9d5e74b5b08c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:21.138776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-044dc618-85f5-4514-b5c6-9d5e74b5b08c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:21.147969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-044dc618-85f5-4514-b5c6-9d5e74b5b08c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085679 Aug 31 00:51:21.148239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1185/2432] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:21 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:21.165743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:21.166505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:21.172682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:21.173163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:21.173590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:21.174267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:21.174715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:21.175168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:21.219020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2e14de2e-3e81-4d1b-9c9e-54ab47a0e3f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:21.220020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2e14de2e-3e81-4d1b-9c9e-54ab47a0e3f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:21.227677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e14de2e-3e81-4d1b-9c9e-54ab47a0e3f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:21.228209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e14de2e-3e81-4d1b-9c9e-54ab47a0e3f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:21.228646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e14de2e-3e81-4d1b-9c9e-54ab47a0e3f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:21.229488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e14de2e-3e81-4d1b-9c9e-54ab47a0e3f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:21.230190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e14de2e-3e81-4d1b-9c9e-54ab47a0e3f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:21.230624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e14de2e-3e81-4d1b-9c9e-54ab47a0e3f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:21.238434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:21.248290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:21.249663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:21.250798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7bb32d77-0410-4b93-97d6-80efaa11a328 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089615 Aug 31 00:51:21.251393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1248/2433] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:21.358595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2e14de2e-3e81-4d1b-9c9e-54ab47a0e3f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:21.367355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2e14de2e-3e81-4d1b-9c9e-54ab47a0e3f4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153475 Aug 31 00:51:21.367913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1186/2434] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:21 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:22.169900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-163781ed-8d7f-4ed7-8ae0-03aeefe09ff0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:22.170513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-163781ed-8d7f-4ed7-8ae0-03aeefe09ff0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:22.176966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-163781ed-8d7f-4ed7-8ae0-03aeefe09ff0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:22.177454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-163781ed-8d7f-4ed7-8ae0-03aeefe09ff0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:22.178065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-163781ed-8d7f-4ed7-8ae0-03aeefe09ff0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:22.179022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-163781ed-8d7f-4ed7-8ae0-03aeefe09ff0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:22.179502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-163781ed-8d7f-4ed7-8ae0-03aeefe09ff0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:22.179933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-163781ed-8d7f-4ed7-8ae0-03aeefe09ff0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:22.247760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-163781ed-8d7f-4ed7-8ae0-03aeefe09ff0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:22.256765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-163781ed-8d7f-4ed7-8ae0-03aeefe09ff0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089964 Aug 31 00:51:22.257413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1249/2435] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:22 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:22.273774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:22.274385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:22.280888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:22.281374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:22.281808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:22.282497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:22.282962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:22.283394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:22.287372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:22.350392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:22.359296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:22.360714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:22.361834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4f7d108f-d9a0-4fbc-a7f6-51773dbb6f31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092209 Aug 31 00:51:22.362383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1187/2436] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:22.388456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-688d85db-4053-4b05-a551-66a2785c4bf7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:22.389056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-688d85db-4053-4b05-a551-66a2785c4bf7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:22.394915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-688d85db-4053-4b05-a551-66a2785c4bf7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:22.395445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-688d85db-4053-4b05-a551-66a2785c4bf7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:22.395859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-688d85db-4053-4b05-a551-66a2785c4bf7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:22.397079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-688d85db-4053-4b05-a551-66a2785c4bf7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:22.397680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-688d85db-4053-4b05-a551-66a2785c4bf7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:22.398103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-688d85db-4053-4b05-a551-66a2785c4bf7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:22.532697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-688d85db-4053-4b05-a551-66a2785c4bf7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:22.541958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-688d85db-4053-4b05-a551-66a2785c4bf7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157351 Aug 31 00:51:22.542524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1250/2437] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:22 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:23.278680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-96ef94a4-f305-45f0-aed3-b9e41dcfb4af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:23.279245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-96ef94a4-f305-45f0-aed3-b9e41dcfb4af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:23.285744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96ef94a4-f305-45f0-aed3-b9e41dcfb4af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:23.286221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96ef94a4-f305-45f0-aed3-b9e41dcfb4af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:23.286648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96ef94a4-f305-45f0-aed3-b9e41dcfb4af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:23.287379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96ef94a4-f305-45f0-aed3-b9e41dcfb4af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:23.287825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96ef94a4-f305-45f0-aed3-b9e41dcfb4af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:23.288236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96ef94a4-f305-45f0-aed3-b9e41dcfb4af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:23.349464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-96ef94a4-f305-45f0-aed3-b9e41dcfb4af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:23.358273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-96ef94a4-f305-45f0-aed3-b9e41dcfb4af tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083471 Aug 31 00:51:23.358829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1188/2438] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:23 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:23.385104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:23.385743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:23.392533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:23.393017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:23.393453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:23.394142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:23.394595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:23.395019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:23.462408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:23.470923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:23.472367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:23.473482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6f9760d0-42e1-4063-9f03-c62094cdf0c2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.093204 Aug 31 00:51:23.474044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1251/2439] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:23.563750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-825a4181-371b-44b9-9262-6b0609d87d31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:23.564304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-825a4181-371b-44b9-9262-6b0609d87d31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:23.570765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-825a4181-371b-44b9-9262-6b0609d87d31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:23.571278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-825a4181-371b-44b9-9262-6b0609d87d31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:23.571708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-825a4181-371b-44b9-9262-6b0609d87d31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:23.572390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-825a4181-371b-44b9-9262-6b0609d87d31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:23.572838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-825a4181-371b-44b9-9262-6b0609d87d31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:23.573260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-825a4181-371b-44b9-9262-6b0609d87d31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:23.702253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-825a4181-371b-44b9-9262-6b0609d87d31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:23.711199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-825a4181-371b-44b9-9262-6b0609d87d31 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151380 Aug 31 00:51:23.711753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1189/2440] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:24.378856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-61cce5ef-1ba7-4eec-a6e6-271836b1862e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:24.379486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-61cce5ef-1ba7-4eec-a6e6-271836b1862e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:24.385719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61cce5ef-1ba7-4eec-a6e6-271836b1862e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:24.386370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61cce5ef-1ba7-4eec-a6e6-271836b1862e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:24.386615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61cce5ef-1ba7-4eec-a6e6-271836b1862e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:24.387331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61cce5ef-1ba7-4eec-a6e6-271836b1862e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:24.387781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61cce5ef-1ba7-4eec-a6e6-271836b1862e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:24.388200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61cce5ef-1ba7-4eec-a6e6-271836b1862e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:24.449041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-61cce5ef-1ba7-4eec-a6e6-271836b1862e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:24.457224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-61cce5ef-1ba7-4eec-a6e6-271836b1862e tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082204 Aug 31 00:51:24.457779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1252/2441] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:24 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:24.496569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:24.497172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:24.504389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:24.504893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:24.505276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:24.505960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:24.506442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:24.506842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:24.568470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:24.576957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:24.578395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:24.579556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-602b927f-21a7-4ae7-9198-b684549810f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086909 Aug 31 00:51:24.580117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1190/2442] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:24.733109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bb0aade1-4990-463e-9064-973cf26efc30 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:24.733665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bb0aade1-4990-463e-9064-973cf26efc30 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:24.739701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb0aade1-4990-463e-9064-973cf26efc30 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:24.740883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb0aade1-4990-463e-9064-973cf26efc30 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:24.741323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb0aade1-4990-463e-9064-973cf26efc30 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:24.742012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb0aade1-4990-463e-9064-973cf26efc30 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:24.742469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb0aade1-4990-463e-9064-973cf26efc30 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:24.742896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb0aade1-4990-463e-9064-973cf26efc30 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:24.875215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bb0aade1-4990-463e-9064-973cf26efc30 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:24.883758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bb0aade1-4990-463e-9064-973cf26efc30 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154559 Aug 31 00:51:24.884311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1253/2443] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:25.479859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2cab4c5d-58cb-4fe0-8644-e8f278c4aee6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:25.480466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2cab4c5d-58cb-4fe0-8644-e8f278c4aee6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:25.487286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cab4c5d-58cb-4fe0-8644-e8f278c4aee6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:25.487773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cab4c5d-58cb-4fe0-8644-e8f278c4aee6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:25.489020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cab4c5d-58cb-4fe0-8644-e8f278c4aee6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:25.489020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cab4c5d-58cb-4fe0-8644-e8f278c4aee6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:25.489329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cab4c5d-58cb-4fe0-8644-e8f278c4aee6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:25.489751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cab4c5d-58cb-4fe0-8644-e8f278c4aee6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:25.563130 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2cab4c5d-58cb-4fe0-8644-e8f278c4aee6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:25.574472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2cab4c5d-58cb-4fe0-8644-e8f278c4aee6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.099742 Aug 31 00:51:25.575144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1191/2444] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:25 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:25.603373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:25.604009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:25.611203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:25.611687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:25.612119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:25.613240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:25.613698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:25.614304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:25.686853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:25.699387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:25.701413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:25.702594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-42a197a9-9300-4c42-a792-07e73c69d475 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.104101 Aug 31 00:51:25.703296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1254/2445] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:25.906106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-da989b3b-4c0b-45ce-a688-cca540649441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:25.906712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-da989b3b-4c0b-45ce-a688-cca540649441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:25.913073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da989b3b-4c0b-45ce-a688-cca540649441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:25.913553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da989b3b-4c0b-45ce-a688-cca540649441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:25.913993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da989b3b-4c0b-45ce-a688-cca540649441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:25.914684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da989b3b-4c0b-45ce-a688-cca540649441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:25.917067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da989b3b-4c0b-45ce-a688-cca540649441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:25.917515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da989b3b-4c0b-45ce-a688-cca540649441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:26.061732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-da989b3b-4c0b-45ce-a688-cca540649441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:26.070787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-da989b3b-4c0b-45ce-a688-cca540649441 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.168634 Aug 31 00:51:26.071391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1192/2446] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:26.598561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dda85e77-7894-4ad5-8781-9fff340987ff tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:26.599204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dda85e77-7894-4ad5-8781-9fff340987ff tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:26.606284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dda85e77-7894-4ad5-8781-9fff340987ff tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:26.606925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dda85e77-7894-4ad5-8781-9fff340987ff tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:26.607235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dda85e77-7894-4ad5-8781-9fff340987ff tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:26.607927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dda85e77-7894-4ad5-8781-9fff340987ff tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:26.608382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dda85e77-7894-4ad5-8781-9fff340987ff tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:26.608804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dda85e77-7894-4ad5-8781-9fff340987ff tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:26.613293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:26.670997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dda85e77-7894-4ad5-8781-9fff340987ff tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:26.679315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dda85e77-7894-4ad5-8781-9fff340987ff tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084398 Aug 31 00:51:26.679876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1255/2447] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:26 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:26.726209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:26.727088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:26.733491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:26.733956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:26.734389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:26.735091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:26.735545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:26.735970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:26.798308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:26.807246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:26.808750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:26.809895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-18f9e65d-db6b-4d05-9da1-f74c56ff5c98 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088193 Aug 31 00:51:26.810449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1193/2448] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:27.091836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0be00c11-cea2-44c2-938e-50095ccfe78e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:27.092451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0be00c11-cea2-44c2-938e-50095ccfe78e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:27.098399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0be00c11-cea2-44c2-938e-50095ccfe78e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:27.098890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0be00c11-cea2-44c2-938e-50095ccfe78e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:27.099513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0be00c11-cea2-44c2-938e-50095ccfe78e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:27.100486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0be00c11-cea2-44c2-938e-50095ccfe78e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:27.100945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0be00c11-cea2-44c2-938e-50095ccfe78e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:27.101639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0be00c11-cea2-44c2-938e-50095ccfe78e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:27.238327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0be00c11-cea2-44c2-938e-50095ccfe78e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:27.246800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0be00c11-cea2-44c2-938e-50095ccfe78e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.158735 Aug 31 00:51:27.247337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1256/2449] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:27 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:27.701456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-69d4a378-80cd-4204-a669-ab2d3f78701a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:27.702063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-69d4a378-80cd-4204-a669-ab2d3f78701a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:27.708225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69d4a378-80cd-4204-a669-ab2d3f78701a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:27.709196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69d4a378-80cd-4204-a669-ab2d3f78701a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:27.709954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69d4a378-80cd-4204-a669-ab2d3f78701a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:27.710656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69d4a378-80cd-4204-a669-ab2d3f78701a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:27.711140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69d4a378-80cd-4204-a669-ab2d3f78701a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:27.711567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69d4a378-80cd-4204-a669-ab2d3f78701a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:27.774093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-69d4a378-80cd-4204-a669-ab2d3f78701a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:27.782250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-69d4a378-80cd-4204-a669-ab2d3f78701a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084629 Aug 31 00:51:27.782810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1194/2450] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:27 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:27.832973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:27.833640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:27.840871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:27.841355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:27.841787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:27.842471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:27.842924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:27.843371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:27.906201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:27.914887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:27.916362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:27.917493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c0b976b4-af3b-4a47-a594-e1a944d5a6de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088501 Aug 31 00:51:27.918045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1257/2451] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:28.268538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f917c62f-6a5f-49e5-99d1-1b6b11c414be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:28.269069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f917c62f-6a5f-49e5-99d1-1b6b11c414be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:28.275865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f917c62f-6a5f-49e5-99d1-1b6b11c414be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:28.276362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f917c62f-6a5f-49e5-99d1-1b6b11c414be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:28.276780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f917c62f-6a5f-49e5-99d1-1b6b11c414be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:28.277463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f917c62f-6a5f-49e5-99d1-1b6b11c414be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:28.277918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f917c62f-6a5f-49e5-99d1-1b6b11c414be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:28.278338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f917c62f-6a5f-49e5-99d1-1b6b11c414be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:28.413443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f917c62f-6a5f-49e5-99d1-1b6b11c414be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:28.422312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f917c62f-6a5f-49e5-99d1-1b6b11c414be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157525 Aug 31 00:51:28.423059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1195/2452] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:28.804622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d729be8d-b1fa-4967-81f8-738bcb040ffa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:28.805252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d729be8d-b1fa-4967-81f8-738bcb040ffa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:28.811246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d729be8d-b1fa-4967-81f8-738bcb040ffa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:28.811726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d729be8d-b1fa-4967-81f8-738bcb040ffa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:28.812154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d729be8d-b1fa-4967-81f8-738bcb040ffa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:28.812828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d729be8d-b1fa-4967-81f8-738bcb040ffa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:28.813300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d729be8d-b1fa-4967-81f8-738bcb040ffa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:28.813715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d729be8d-b1fa-4967-81f8-738bcb040ffa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:28.878880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d729be8d-b1fa-4967-81f8-738bcb040ffa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:28.888682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d729be8d-b1fa-4967-81f8-738bcb040ffa tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088746 Aug 31 00:51:28.889268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1258/2453] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:28 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:28.940767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:28.941390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:28.948089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:28.948558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:28.948985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:28.949660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:28.950110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:28.950519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:29.012688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:29.022529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:29.023770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:29.024907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9c941f15-43c2-46ab-b107-11fda5248b26 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088110 Aug 31 00:51:29.025460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1196/2454] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:29.444273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-94913678-872c-44e7-86c6-8a643f16412b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:29.444788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-94913678-872c-44e7-86c6-8a643f16412b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:29.450780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94913678-872c-44e7-86c6-8a643f16412b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:29.451299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94913678-872c-44e7-86c6-8a643f16412b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:29.451733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94913678-872c-44e7-86c6-8a643f16412b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:29.452409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94913678-872c-44e7-86c6-8a643f16412b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:29.452859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94913678-872c-44e7-86c6-8a643f16412b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:29.453276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94913678-872c-44e7-86c6-8a643f16412b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:29.593680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-94913678-872c-44e7-86c6-8a643f16412b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:29.603062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-94913678-872c-44e7-86c6-8a643f16412b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.162848 Aug 31 00:51:29.603647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1259/2455] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:29.910819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6677820d-24c2-49ca-b388-c2561cc7e3c9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:29.911458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6677820d-24c2-49ca-b388-c2561cc7e3c9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:29.920334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6677820d-24c2-49ca-b388-c2561cc7e3c9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:29.920813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6677820d-24c2-49ca-b388-c2561cc7e3c9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:29.921241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6677820d-24c2-49ca-b388-c2561cc7e3c9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:29.922459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6677820d-24c2-49ca-b388-c2561cc7e3c9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:29.923243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6677820d-24c2-49ca-b388-c2561cc7e3c9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:29.923880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6677820d-24c2-49ca-b388-c2561cc7e3c9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:29.987657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6677820d-24c2-49ca-b388-c2561cc7e3c9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:29.996747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6677820d-24c2-49ca-b388-c2561cc7e3c9 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.090621 Aug 31 00:51:29.997320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1197/2456] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:29 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:30.047954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:30.048566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:30.055948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:30.056434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:30.056871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:30.057594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:30.058045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:30.058465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:30.121066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:30.129586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:30.131300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:30.132436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3d4fff1d-6864-4396-bc00-a87b31c02a5a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088388 Aug 31 00:51:30.132994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1260/2457] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:30.625216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0582f06a-9268-42e9-8c30-9d130bcb08c0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:30.625852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0582f06a-9268-42e9-8c30-9d130bcb08c0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:30.632442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0582f06a-9268-42e9-8c30-9d130bcb08c0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:30.632918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0582f06a-9268-42e9-8c30-9d130bcb08c0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:30.633350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0582f06a-9268-42e9-8c30-9d130bcb08c0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:30.634031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0582f06a-9268-42e9-8c30-9d130bcb08c0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:30.634475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0582f06a-9268-42e9-8c30-9d130bcb08c0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:30.634894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0582f06a-9268-42e9-8c30-9d130bcb08c0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:30.761386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0582f06a-9268-42e9-8c30-9d130bcb08c0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:30.769584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0582f06a-9268-42e9-8c30-9d130bcb08c0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148263 Aug 31 00:51:30.770303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1198/2458] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:31.017725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-37d002ab-6b5a-466b-a69a-4521adf16e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:31.018357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-37d002ab-6b5a-466b-a69a-4521adf16e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:31.024326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d002ab-6b5a-466b-a69a-4521adf16e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:31.024806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d002ab-6b5a-466b-a69a-4521adf16e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:31.025237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d002ab-6b5a-466b-a69a-4521adf16e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:31.025912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d002ab-6b5a-466b-a69a-4521adf16e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:31.026363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d002ab-6b5a-466b-a69a-4521adf16e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:31.026787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d002ab-6b5a-466b-a69a-4521adf16e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:31.092497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37d002ab-6b5a-466b-a69a-4521adf16e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:31.101976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-37d002ab-6b5a-466b-a69a-4521adf16e96 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088054 Aug 31 00:51:31.102545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1261/2459] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:31 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:31.155008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:31.155692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:31.162761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:31.163264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:31.163690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:31.164362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:31.164803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:31.165217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:31.225596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:31.234380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:31.235845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:31.236971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4b98fd74-c0b1-486c-95ca-94c9727ddaa0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085846 Aug 31 00:51:31.237524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1199/2460] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:31.791761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9686d6aa-ad24-4632-990a-332835e5b53c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:31.792279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9686d6aa-ad24-4632-990a-332835e5b53c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:31.798301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9686d6aa-ad24-4632-990a-332835e5b53c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:31.798783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9686d6aa-ad24-4632-990a-332835e5b53c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:31.799249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9686d6aa-ad24-4632-990a-332835e5b53c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:31.799931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9686d6aa-ad24-4632-990a-332835e5b53c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:31.800391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9686d6aa-ad24-4632-990a-332835e5b53c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:31.800814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9686d6aa-ad24-4632-990a-332835e5b53c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:31.929879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9686d6aa-ad24-4632-990a-332835e5b53c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:31.938118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9686d6aa-ad24-4632-990a-332835e5b53c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150271 Aug 31 00:51:31.938687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1262/2461] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:32.124014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-73e348fa-a1c5-4e6c-a872-2bd70c0c7565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:32.124622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-73e348fa-a1c5-4e6c-a872-2bd70c0c7565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:32.130880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73e348fa-a1c5-4e6c-a872-2bd70c0c7565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:32.131541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73e348fa-a1c5-4e6c-a872-2bd70c0c7565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:32.131982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73e348fa-a1c5-4e6c-a872-2bd70c0c7565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:32.132669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73e348fa-a1c5-4e6c-a872-2bd70c0c7565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:32.133122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73e348fa-a1c5-4e6c-a872-2bd70c0c7565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:32.133544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73e348fa-a1c5-4e6c-a872-2bd70c0c7565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:32.198876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-73e348fa-a1c5-4e6c-a872-2bd70c0c7565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:32.207084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-73e348fa-a1c5-4e6c-a872-2bd70c0c7565 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086872 Aug 31 00:51:32.207647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1200/2462] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:32 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:32.260970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:32.261570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:32.267924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:32.268400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:32.268831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:32.269502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:32.269948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:32.270361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:32.341376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:32.350450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:32.352163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:32.353289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-61402e88-b97c-4730-b8ae-22cf70745b56 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.096220 Aug 31 00:51:32.353844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1263/2463] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:32.960137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-936e923f-222e-4afe-9e9e-c23f09a11d68 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:32.960654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-936e923f-222e-4afe-9e9e-c23f09a11d68 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:32.966549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-936e923f-222e-4afe-9e9e-c23f09a11d68 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:32.967022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-936e923f-222e-4afe-9e9e-c23f09a11d68 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:32.967487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-936e923f-222e-4afe-9e9e-c23f09a11d68 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:32.968167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-936e923f-222e-4afe-9e9e-c23f09a11d68 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:32.968608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-936e923f-222e-4afe-9e9e-c23f09a11d68 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:32.969017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-936e923f-222e-4afe-9e9e-c23f09a11d68 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:33.097869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-936e923f-222e-4afe-9e9e-c23f09a11d68 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:33.107404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-936e923f-222e-4afe-9e9e-c23f09a11d68 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151235 Aug 31 00:51:33.107979 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1201/2464] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:33.228676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6341cc4b-8056-4a6c-8753-7b7a507757a2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:33.229195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6341cc4b-8056-4a6c-8753-7b7a507757a2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:33.235176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6341cc4b-8056-4a6c-8753-7b7a507757a2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:33.235653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6341cc4b-8056-4a6c-8753-7b7a507757a2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:33.236081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6341cc4b-8056-4a6c-8753-7b7a507757a2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:33.236750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6341cc4b-8056-4a6c-8753-7b7a507757a2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:33.237203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6341cc4b-8056-4a6c-8753-7b7a507757a2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:33.237615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6341cc4b-8056-4a6c-8753-7b7a507757a2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:33.298795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6341cc4b-8056-4a6c-8753-7b7a507757a2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:33.307860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6341cc4b-8056-4a6c-8753-7b7a507757a2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083905 Aug 31 00:51:33.308420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1264/2465] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:33 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:33.376528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:33.377144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:33.384012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:33.384496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:33.384935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:33.385618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:33.386065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:33.386485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:33.451664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:33.461379 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:33.462829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:33.464009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b741e663-aa2c-4fd1-a32f-ecb887d39f3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091426 Aug 31 00:51:33.464566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1202/2466] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:33 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:34.129770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4581733-c6b4-4947-9e3b-3dadd307d8be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:34.131054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4581733-c6b4-4947-9e3b-3dadd307d8be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:34.137054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4581733-c6b4-4947-9e3b-3dadd307d8be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:34.137530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4581733-c6b4-4947-9e3b-3dadd307d8be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:34.137957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4581733-c6b4-4947-9e3b-3dadd307d8be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:34.138629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4581733-c6b4-4947-9e3b-3dadd307d8be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:34.139091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4581733-c6b4-4947-9e3b-3dadd307d8be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:34.139509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4581733-c6b4-4947-9e3b-3dadd307d8be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:34.268789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f4581733-c6b4-4947-9e3b-3dadd307d8be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:34.277573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4581733-c6b4-4947-9e3b-3dadd307d8be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151602 Aug 31 00:51:34.278171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1265/2467] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:34 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:34.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a2bb3bf8-8e75-4b40-a877-84030d4f1a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:34.329564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a2bb3bf8-8e75-4b40-a877-84030d4f1a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:34.335739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2bb3bf8-8e75-4b40-a877-84030d4f1a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:34.336224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2bb3bf8-8e75-4b40-a877-84030d4f1a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:34.336658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2bb3bf8-8e75-4b40-a877-84030d4f1a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:34.337380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2bb3bf8-8e75-4b40-a877-84030d4f1a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:34.337827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2bb3bf8-8e75-4b40-a877-84030d4f1a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:34.338248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a2bb3bf8-8e75-4b40-a877-84030d4f1a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:34.398938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a2bb3bf8-8e75-4b40-a877-84030d4f1a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:34.401126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:34.408306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a2bb3bf8-8e75-4b40-a877-84030d4f1a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083260 Aug 31 00:51:34.408874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1203/2468] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:34.487852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:34.488533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:34.494905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:34.495397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:34.495830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:34.496510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:34.496962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:34.497379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:34.558630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:34.567199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:34.568730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:34.569865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-46cb0c82-2218-4a71-a56f-c7e1c04db0f6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085903 Aug 31 00:51:34.570425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1266/2469] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:35.298771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d7e69274-8884-49f0-9719-1b3626dafc37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:35.299523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d7e69274-8884-49f0-9719-1b3626dafc37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:35.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e69274-8884-49f0-9719-1b3626dafc37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:35.307093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e69274-8884-49f0-9719-1b3626dafc37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:35.307535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e69274-8884-49f0-9719-1b3626dafc37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:35.308225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e69274-8884-49f0-9719-1b3626dafc37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:35.308677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e69274-8884-49f0-9719-1b3626dafc37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:35.309101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d7e69274-8884-49f0-9719-1b3626dafc37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:35.429168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-71af7b14-ff0d-4ab2-b075-b4f50ee7e8dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:35.429806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-71af7b14-ff0d-4ab2-b075-b4f50ee7e8dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:35.436314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71af7b14-ff0d-4ab2-b075-b4f50ee7e8dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:35.436806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71af7b14-ff0d-4ab2-b075-b4f50ee7e8dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:35.437240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71af7b14-ff0d-4ab2-b075-b4f50ee7e8dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:35.437933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71af7b14-ff0d-4ab2-b075-b4f50ee7e8dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:35.438389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71af7b14-ff0d-4ab2-b075-b4f50ee7e8dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:35.438814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71af7b14-ff0d-4ab2-b075-b4f50ee7e8dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:35.442036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d7e69274-8884-49f0-9719-1b3626dafc37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:35.451353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d7e69274-8884-49f0-9719-1b3626dafc37 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156451 Aug 31 00:51:35.451927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1204/2470] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:35.502608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-71af7b14-ff0d-4ab2-b075-b4f50ee7e8dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:35.510907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-71af7b14-ff0d-4ab2-b075-b4f50ee7e8dc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086447 Aug 31 00:51:35.511513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1267/2471] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:35 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:35.594961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:35.595626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:35.602814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:35.603324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:35.603754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:35.604425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:35.604865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:35.605275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:35.667086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:35.675643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:35.677161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:35.678439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-be846c2b-cebe-4af5-8b1c-e25feae1471f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087384 Aug 31 00:51:35.678993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1205/2472] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:36.475818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bc36dbbd-86e6-4f0c-9c35-9267d6f97e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:36.476713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bc36dbbd-86e6-4f0c-9c35-9267d6f97e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:36.483325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc36dbbd-86e6-4f0c-9c35-9267d6f97e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:36.483812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc36dbbd-86e6-4f0c-9c35-9267d6f97e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:36.484271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc36dbbd-86e6-4f0c-9c35-9267d6f97e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:36.484958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc36dbbd-86e6-4f0c-9c35-9267d6f97e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:36.485411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc36dbbd-86e6-4f0c-9c35-9267d6f97e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:36.485834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc36dbbd-86e6-4f0c-9c35-9267d6f97e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:36.532371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-36533745-47a0-4aad-a359-a1d97a6459c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:36.532988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-36533745-47a0-4aad-a359-a1d97a6459c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:36.540047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36533745-47a0-4aad-a359-a1d97a6459c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:36.540532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36533745-47a0-4aad-a359-a1d97a6459c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:36.540966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36533745-47a0-4aad-a359-a1d97a6459c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:36.541656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36533745-47a0-4aad-a359-a1d97a6459c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:36.542106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36533745-47a0-4aad-a359-a1d97a6459c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:36.542531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36533745-47a0-4aad-a359-a1d97a6459c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:36.615752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-36533745-47a0-4aad-a359-a1d97a6459c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:36.623886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-36533745-47a0-4aad-a359-a1d97a6459c2 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.095419 Aug 31 00:51:36.624685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1206/2473] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:36 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:36.651061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bc36dbbd-86e6-4f0c-9c35-9267d6f97e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:36.659477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bc36dbbd-86e6-4f0c-9c35-9267d6f97e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.188272 Aug 31 00:51:36.660069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1268/2474] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:36.701470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:36.702047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:36.707997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:36.708507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:36.708935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:36.709606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:36.710044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:36.710457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:36.771911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:36.780446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:36.781869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:36.782985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-18e2d3ba-a1fe-4754-b63b-2207493c378f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085419 Aug 31 00:51:36.783572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1207/2475] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:37.645683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0a411ead-d5e7-46ca-8880-a15070fef3d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:37.646290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0a411ead-d5e7-46ca-8880-a15070fef3d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:37.652736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a411ead-d5e7-46ca-8880-a15070fef3d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:37.653303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a411ead-d5e7-46ca-8880-a15070fef3d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:37.653623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a411ead-d5e7-46ca-8880-a15070fef3d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:37.654293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a411ead-d5e7-46ca-8880-a15070fef3d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:37.654737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a411ead-d5e7-46ca-8880-a15070fef3d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:37.655177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a411ead-d5e7-46ca-8880-a15070fef3d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:37.682150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a07c128e-afbf-4164-bd54-48f8ef2a4ef6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:37.682807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a07c128e-afbf-4164-bd54-48f8ef2a4ef6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:37.689484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a07c128e-afbf-4164-bd54-48f8ef2a4ef6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:37.690054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a07c128e-afbf-4164-bd54-48f8ef2a4ef6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:37.690596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a07c128e-afbf-4164-bd54-48f8ef2a4ef6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:37.691438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a07c128e-afbf-4164-bd54-48f8ef2a4ef6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:37.691955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a07c128e-afbf-4164-bd54-48f8ef2a4ef6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:37.692548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a07c128e-afbf-4164-bd54-48f8ef2a4ef6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:37.717694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0a411ead-d5e7-46ca-8880-a15070fef3d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:37.726791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0a411ead-d5e7-46ca-8880-a15070fef3d5 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084953 Aug 31 00:51:37.727586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1269/2476] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:37 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:37.806709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:37.807333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:37.813510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:37.813987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:37.814413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:37.815111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:37.815556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:37.815968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:37.835096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a07c128e-afbf-4164-bd54-48f8ef2a4ef6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:37.843307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a07c128e-afbf-4164-bd54-48f8ef2a4ef6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.165863 Aug 31 00:51:37.843876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1208/2477] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:37 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:37.878424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:37.891610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:37.894715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:37.895922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1d969b07-4414-419d-b75a-fa427d4ba892 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.093277 Aug 31 00:51:37.896481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1270/2478] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:38.748768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d82c1099-284d-4bf9-bcbe-0f5ed15fe86b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:38.749412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d82c1099-284d-4bf9-bcbe-0f5ed15fe86b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:38.751343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=78 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:38.757336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d82c1099-284d-4bf9-bcbe-0f5ed15fe86b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:38.757817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d82c1099-284d-4bf9-bcbe-0f5ed15fe86b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:38.758249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d82c1099-284d-4bf9-bcbe-0f5ed15fe86b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:38.758938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d82c1099-284d-4bf9-bcbe-0f5ed15fe86b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:38.759414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d82c1099-284d-4bf9-bcbe-0f5ed15fe86b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:38.759836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d82c1099-284d-4bf9-bcbe-0f5ed15fe86b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:38.820355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d82c1099-284d-4bf9-bcbe-0f5ed15fe86b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:38.828522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d82c1099-284d-4bf9-bcbe-0f5ed15fe86b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083854 Aug 31 00:51:38.829080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1209/2479] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:38 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:38.866038 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3af9fc73-9b63-43c9-ba24-bf47aac0a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:38.866630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3af9fc73-9b63-43c9-ba24-bf47aac0a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:38.873008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3af9fc73-9b63-43c9-ba24-bf47aac0a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:38.873478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3af9fc73-9b63-43c9-ba24-bf47aac0a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:38.873903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3af9fc73-9b63-43c9-ba24-bf47aac0a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:38.874577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3af9fc73-9b63-43c9-ba24-bf47aac0a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:38.875016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3af9fc73-9b63-43c9-ba24-bf47aac0a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:38.875450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3af9fc73-9b63-43c9-ba24-bf47aac0a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:38.917682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:38.918285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:38.924402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:38.924978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:38.925482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:38.926241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:38.926765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:38.927878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:39.000687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:39.009713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:39.011160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:39.012283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-156e0383-d97e-4d31-ba7d-f43cea550867 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.098494 Aug 31 00:51:39.012837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1210/2480] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:39.031938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3af9fc73-9b63-43c9-ba24-bf47aac0a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:39.034157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:39.041460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3af9fc73-9b63-43c9-ba24-bf47aac0a619 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.179760 Aug 31 00:51:39.042018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1271/2481] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:39.850486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6a415e6a-43fa-4d4f-ad6c-d66cbeb5fc3b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:39.851325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6a415e6a-43fa-4d4f-ad6c-d66cbeb5fc3b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:39.857929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a415e6a-43fa-4d4f-ad6c-d66cbeb5fc3b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:39.858408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a415e6a-43fa-4d4f-ad6c-d66cbeb5fc3b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:39.858870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a415e6a-43fa-4d4f-ad6c-d66cbeb5fc3b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:39.859608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a415e6a-43fa-4d4f-ad6c-d66cbeb5fc3b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:39.860087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a415e6a-43fa-4d4f-ad6c-d66cbeb5fc3b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:39.860505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6a415e6a-43fa-4d4f-ad6c-d66cbeb5fc3b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:39.923497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6a415e6a-43fa-4d4f-ad6c-d66cbeb5fc3b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:39.932297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6a415e6a-43fa-4d4f-ad6c-d66cbeb5fc3b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086220 Aug 31 00:51:39.934978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1211/2482] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:39 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:40.035745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:40.036455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:40.042985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:40.043496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:40.043929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:40.044604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:40.045049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:40.045466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:40.062454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c224fee-522c-497c-bb1c-89f2061e900c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:40.063641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c224fee-522c-497c-bb1c-89f2061e900c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:40.069768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c224fee-522c-497c-bb1c-89f2061e900c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:40.070252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c224fee-522c-497c-bb1c-89f2061e900c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:40.070688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c224fee-522c-497c-bb1c-89f2061e900c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:40.071413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c224fee-522c-497c-bb1c-89f2061e900c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:40.071866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c224fee-522c-497c-bb1c-89f2061e900c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:40.072285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c224fee-522c-497c-bb1c-89f2061e900c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:40.109391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:40.118897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:40.120355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:40.121494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fc0d43d3-f30a-4540-998a-22db4931fea2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089669 Aug 31 00:51:40.122059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1272/2483] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:40.205247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0c224fee-522c-497c-bb1c-89f2061e900c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:40.215758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c224fee-522c-497c-bb1c-89f2061e900c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157022 Aug 31 00:51:40.216726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1212/2484] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:40.954587 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3be2a039-9ca7-45f7-92d8-de3af4ecf846 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:40.955233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3be2a039-9ca7-45f7-92d8-de3af4ecf846 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:40.961561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3be2a039-9ca7-45f7-92d8-de3af4ecf846 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:40.962054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3be2a039-9ca7-45f7-92d8-de3af4ecf846 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:40.962489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3be2a039-9ca7-45f7-92d8-de3af4ecf846 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:40.963226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3be2a039-9ca7-45f7-92d8-de3af4ecf846 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:40.963710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3be2a039-9ca7-45f7-92d8-de3af4ecf846 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:40.964135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3be2a039-9ca7-45f7-92d8-de3af4ecf846 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:41.025415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3be2a039-9ca7-45f7-92d8-de3af4ecf846 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:41.033563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3be2a039-9ca7-45f7-92d8-de3af4ecf846 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083003 Aug 31 00:51:41.034122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1273/2485] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:40 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:41.144907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:41.146071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:41.152966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:41.153437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:41.153866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:41.154539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:41.154984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:41.155440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:41.217231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:41.226983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:41.228456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:41.229607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-623e5e13-db9f-4b88-886f-cbbec12b2da2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088589 Aug 31 00:51:41.230166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1213/2486] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:41.237424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d2286d8f-f508-4dc0-8f1f-d262b9b01b66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:41.238056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d2286d8f-f508-4dc0-8f1f-d262b9b01b66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:41.244548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2286d8f-f508-4dc0-8f1f-d262b9b01b66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:41.245020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2286d8f-f508-4dc0-8f1f-d262b9b01b66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:41.245449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2286d8f-f508-4dc0-8f1f-d262b9b01b66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:41.246126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2286d8f-f508-4dc0-8f1f-d262b9b01b66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:41.246568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2286d8f-f508-4dc0-8f1f-d262b9b01b66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:41.246984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2286d8f-f508-4dc0-8f1f-d262b9b01b66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:41.378793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d2286d8f-f508-4dc0-8f1f-d262b9b01b66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:41.388099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d2286d8f-f508-4dc0-8f1f-d262b9b01b66 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154427 Aug 31 00:51:41.388676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1274/2487] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:41 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:42.054818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f02f0e35-cc90-4eed-9030-d13c9af8fc74 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:42.055456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f02f0e35-cc90-4eed-9030-d13c9af8fc74 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:42.061386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f02f0e35-cc90-4eed-9030-d13c9af8fc74 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:42.061872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f02f0e35-cc90-4eed-9030-d13c9af8fc74 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:42.062305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f02f0e35-cc90-4eed-9030-d13c9af8fc74 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:42.062983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f02f0e35-cc90-4eed-9030-d13c9af8fc74 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:42.063459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f02f0e35-cc90-4eed-9030-d13c9af8fc74 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:42.063879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f02f0e35-cc90-4eed-9030-d13c9af8fc74 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:42.124275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f02f0e35-cc90-4eed-9030-d13c9af8fc74 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:42.133296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f02f0e35-cc90-4eed-9030-d13c9af8fc74 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083010 Aug 31 00:51:42.133859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1214/2488] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:42 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:42.252317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:42.252883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:42.260132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:42.260599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:42.261037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:42.261719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:42.262170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:42.262592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:42.323710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:42.333745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:42.335402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:42.336619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1b73e5d9-98a4-4b42-9d0e-393024b62dfb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088344 Aug 31 00:51:42.337239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1275/2489] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:42.409395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5e35f48e-9b5f-4d50-a160-fe3063966576 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:42.410097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5e35f48e-9b5f-4d50-a160-fe3063966576 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:42.417113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e35f48e-9b5f-4d50-a160-fe3063966576 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:42.417582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e35f48e-9b5f-4d50-a160-fe3063966576 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:42.418007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e35f48e-9b5f-4d50-a160-fe3063966576 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:42.418675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e35f48e-9b5f-4d50-a160-fe3063966576 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:42.419145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e35f48e-9b5f-4d50-a160-fe3063966576 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:42.419562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5e35f48e-9b5f-4d50-a160-fe3063966576 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:42.551229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5e35f48e-9b5f-4d50-a160-fe3063966576 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:42.559508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5e35f48e-9b5f-4d50-a160-fe3063966576 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153908 Aug 31 00:51:42.560550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1215/2490] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:42 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:43.155152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a0426bc0-8acb-49d4-8eb0-6d00eb4823d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:43.155748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a0426bc0-8acb-49d4-8eb0-6d00eb4823d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:43.157574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=78 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:43.163317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0426bc0-8acb-49d4-8eb0-6d00eb4823d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:43.163795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0426bc0-8acb-49d4-8eb0-6d00eb4823d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:43.164221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0426bc0-8acb-49d4-8eb0-6d00eb4823d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:43.164896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0426bc0-8acb-49d4-8eb0-6d00eb4823d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:43.165336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0426bc0-8acb-49d4-8eb0-6d00eb4823d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:43.165747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a0426bc0-8acb-49d4-8eb0-6d00eb4823d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:43.227207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a0426bc0-8acb-49d4-8eb0-6d00eb4823d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:43.235430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a0426bc0-8acb-49d4-8eb0-6d00eb4823d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084133 Aug 31 00:51:43.235992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1276/2491] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:43 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:43.359330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:43.359968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:43.366750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:43.367288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:43.367723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:43.368428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:43.368876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:43.369296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:43.430815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:43.439363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:43.440787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:43.441912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-01192c6f-6f9d-4427-a39b-ac207d336e90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086511 Aug 31 00:51:43.443132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1216/2492] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:43.581398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-661758f3-8116-45d3-bec7-2baf52a5459f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:43.582024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-661758f3-8116-45d3-bec7-2baf52a5459f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:43.589057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-661758f3-8116-45d3-bec7-2baf52a5459f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:43.589532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-661758f3-8116-45d3-bec7-2baf52a5459f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:43.589964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-661758f3-8116-45d3-bec7-2baf52a5459f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:43.590689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-661758f3-8116-45d3-bec7-2baf52a5459f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:43.591107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-661758f3-8116-45d3-bec7-2baf52a5459f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:43.591523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-661758f3-8116-45d3-bec7-2baf52a5459f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:43.721113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-661758f3-8116-45d3-bec7-2baf52a5459f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:43.729858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-661758f3-8116-45d3-bec7-2baf52a5459f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152284 Aug 31 00:51:43.730425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1277/2493] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:44.258604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f7e097dc-54dd-4733-9eaf-1d2c561cde69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:44.259149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f7e097dc-54dd-4733-9eaf-1d2c561cde69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:44.265364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7e097dc-54dd-4733-9eaf-1d2c561cde69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:44.265840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7e097dc-54dd-4733-9eaf-1d2c561cde69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:44.266283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7e097dc-54dd-4733-9eaf-1d2c561cde69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:44.266991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7e097dc-54dd-4733-9eaf-1d2c561cde69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:44.267473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7e097dc-54dd-4733-9eaf-1d2c561cde69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:44.267899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7e097dc-54dd-4733-9eaf-1d2c561cde69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:44.331996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f7e097dc-54dd-4733-9eaf-1d2c561cde69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:44.340959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f7e097dc-54dd-4733-9eaf-1d2c561cde69 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087417 Aug 31 00:51:44.341528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1217/2494] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:44 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:44.466261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:44.466893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:44.472932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:44.473415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:44.473848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:44.474664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:44.475339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:44.476017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:44.537821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:44.546411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:44.547881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:44.549016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-561d39f6-42a0-4af7-8bd6-b429b875e4c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086704 Aug 31 00:51:44.549575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1278/2495] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:44.751519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ae4bf0b4-4cde-4b55-b1e7-638487c62ee8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:44.752149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ae4bf0b4-4cde-4b55-b1e7-638487c62ee8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:44.759135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0b4-4cde-4b55-b1e7-638487c62ee8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:44.759624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0b4-4cde-4b55-b1e7-638487c62ee8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:44.760061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0b4-4cde-4b55-b1e7-638487c62ee8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:44.760743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0b4-4cde-4b55-b1e7-638487c62ee8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:44.761197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0b4-4cde-4b55-b1e7-638487c62ee8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:44.761622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0b4-4cde-4b55-b1e7-638487c62ee8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:44.894062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ae4bf0b4-4cde-4b55-b1e7-638487c62ee8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:44.902327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ae4bf0b4-4cde-4b55-b1e7-638487c62ee8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154655 Aug 31 00:51:44.902886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1218/2496] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:45.364839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-981eb2fc-8dbb-4512-bbb2-316d32b77957 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:45.366100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-981eb2fc-8dbb-4512-bbb2-316d32b77957 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:45.372563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-981eb2fc-8dbb-4512-bbb2-316d32b77957 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:45.373001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-981eb2fc-8dbb-4512-bbb2-316d32b77957 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:45.373432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-981eb2fc-8dbb-4512-bbb2-316d32b77957 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:45.374113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-981eb2fc-8dbb-4512-bbb2-316d32b77957 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:45.374562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-981eb2fc-8dbb-4512-bbb2-316d32b77957 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:45.374980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-981eb2fc-8dbb-4512-bbb2-316d32b77957 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:45.436420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-981eb2fc-8dbb-4512-bbb2-316d32b77957 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:45.445071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-981eb2fc-8dbb-4512-bbb2-316d32b77957 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086178 Aug 31 00:51:45.445633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1279/2497] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:45 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:45.572088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:45.572695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:45.578593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:45.579194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:45.579636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:45.580311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:45.581299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:45.581299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:45.648885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:45.660188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:45.661651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:45.663754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f1f785d3-411d-446b-a94b-3ad05de6d8cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.095826 Aug 31 00:51:45.664313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1219/2498] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:45.924586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4a53a28f-49b4-48d2-a463-53544303ee0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:45.925110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4a53a28f-49b4-48d2-a463-53544303ee0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:45.931306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a53a28f-49b4-48d2-a463-53544303ee0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:45.931786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a53a28f-49b4-48d2-a463-53544303ee0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:45.932210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a53a28f-49b4-48d2-a463-53544303ee0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:45.932924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a53a28f-49b4-48d2-a463-53544303ee0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:45.933368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a53a28f-49b4-48d2-a463-53544303ee0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:45.933784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a53a28f-49b4-48d2-a463-53544303ee0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:46.064525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4a53a28f-49b4-48d2-a463-53544303ee0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:46.073271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4a53a28f-49b4-48d2-a463-53544303ee0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152765 Aug 31 00:51:46.073835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1280/2499] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:46.466060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-77ff1487-4f60-4068-a915-60520205dbbe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:46.466683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-77ff1487-4f60-4068-a915-60520205dbbe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:46.473046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77ff1487-4f60-4068-a915-60520205dbbe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:46.473521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77ff1487-4f60-4068-a915-60520205dbbe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:46.473947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77ff1487-4f60-4068-a915-60520205dbbe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:46.475510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77ff1487-4f60-4068-a915-60520205dbbe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:46.476302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77ff1487-4f60-4068-a915-60520205dbbe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:46.476724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77ff1487-4f60-4068-a915-60520205dbbe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:46.491862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:46.538992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-77ff1487-4f60-4068-a915-60520205dbbe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:46.547226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-77ff1487-4f60-4068-a915-60520205dbbe tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085001 Aug 31 00:51:46.547786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1220/2500] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:46 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:46.686457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:46.687082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:46.693967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:46.694448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:46.694876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:46.695580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:46.696031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:46.696456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:46.760661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:46.769325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:46.770771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:46.771971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b83f466e-876f-4678-bb11-5e0749c3c39d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089451 Aug 31 00:51:46.772525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1281/2501] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:47.095545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-10ea712a-5090-4083-8c92-f78646dd467d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:47.096146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-10ea712a-5090-4083-8c92-f78646dd467d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:47.103298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10ea712a-5090-4083-8c92-f78646dd467d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:47.103770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10ea712a-5090-4083-8c92-f78646dd467d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:47.104196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10ea712a-5090-4083-8c92-f78646dd467d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:47.104861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10ea712a-5090-4083-8c92-f78646dd467d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:47.105305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10ea712a-5090-4083-8c92-f78646dd467d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:47.105713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10ea712a-5090-4083-8c92-f78646dd467d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:47.254632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-10ea712a-5090-4083-8c92-f78646dd467d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:47.263869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-10ea712a-5090-4083-8c92-f78646dd467d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.172183 Aug 31 00:51:47.264438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1221/2502] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:47 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:47.568396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1c137451-bc00-4645-abf8-796068e3e89b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:47.569027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1c137451-bc00-4645-abf8-796068e3e89b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:47.574979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c137451-bc00-4645-abf8-796068e3e89b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:47.575491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c137451-bc00-4645-abf8-796068e3e89b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:47.575924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c137451-bc00-4645-abf8-796068e3e89b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:47.576605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c137451-bc00-4645-abf8-796068e3e89b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:47.577054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c137451-bc00-4645-abf8-796068e3e89b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:47.577472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c137451-bc00-4645-abf8-796068e3e89b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:47.641934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1c137451-bc00-4645-abf8-796068e3e89b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:47.651324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1c137451-bc00-4645-abf8-796068e3e89b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.087192 Aug 31 00:51:47.651886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1282/2503] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:47 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:47.795623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:47.796211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:47.803501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:47.804062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:47.804612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:47.805536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:47.806312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:47.807117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:47.872707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:47.882371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:47.883849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:47.884996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-20af330f-ebaa-4e8a-a2b1-a179b1d02fea tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.093328 Aug 31 00:51:47.885554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1222/2504] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:48.285838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-34c7fecb-293c-4367-9e01-fd405fc13d15 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:48.286401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-34c7fecb-293c-4367-9e01-fd405fc13d15 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:48.294364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34c7fecb-293c-4367-9e01-fd405fc13d15 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:48.294913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34c7fecb-293c-4367-9e01-fd405fc13d15 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:48.295378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34c7fecb-293c-4367-9e01-fd405fc13d15 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:48.296102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34c7fecb-293c-4367-9e01-fd405fc13d15 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:48.296553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34c7fecb-293c-4367-9e01-fd405fc13d15 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:48.296971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34c7fecb-293c-4367-9e01-fd405fc13d15 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:48.436398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34c7fecb-293c-4367-9e01-fd405fc13d15 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:48.444848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-34c7fecb-293c-4367-9e01-fd405fc13d15 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.162870 Aug 31 00:51:48.445423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1283/2505] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:48.672794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-180ba029-f399-4814-8220-edc65070599b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:48.673397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-180ba029-f399-4814-8220-edc65070599b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:48.679627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-180ba029-f399-4814-8220-edc65070599b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:48.680107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-180ba029-f399-4814-8220-edc65070599b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:48.680533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-180ba029-f399-4814-8220-edc65070599b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:48.681207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-180ba029-f399-4814-8220-edc65070599b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:48.681654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-180ba029-f399-4814-8220-edc65070599b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:48.682073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-180ba029-f399-4814-8220-edc65070599b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:48.744116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-180ba029-f399-4814-8220-edc65070599b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:48.752255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-180ba029-f399-4814-8220-edc65070599b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.083307 Aug 31 00:51:48.752884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1223/2506] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:48 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:48.908283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:48.908875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:48.914970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:48.915550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:48.915979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:48.916651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:48.917095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:48.917511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:48.982624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:48.991897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:48.993440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:48.994586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0e5c4d9-1258-4b99-b4a0-a2d2e987a209 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090288 Aug 31 00:51:48.995159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1284/2507] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:49.466022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-73937973-ab2a-465e-b131-f11d1ac68d50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:49.466653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-73937973-ab2a-465e-b131-f11d1ac68d50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:49.473046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73937973-ab2a-465e-b131-f11d1ac68d50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:49.473522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73937973-ab2a-465e-b131-f11d1ac68d50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:49.473953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73937973-ab2a-465e-b131-f11d1ac68d50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:49.475898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73937973-ab2a-465e-b131-f11d1ac68d50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:49.476362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73937973-ab2a-465e-b131-f11d1ac68d50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:49.476788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73937973-ab2a-465e-b131-f11d1ac68d50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:49.608725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-73937973-ab2a-465e-b131-f11d1ac68d50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:49.617072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-73937973-ab2a-465e-b131-f11d1ac68d50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154902 Aug 31 00:51:49.617635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1224/2508] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:49.774503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a222f8ea-7f12-4849-8e6e-f8cda29fced1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:49.775023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a222f8ea-7f12-4849-8e6e-f8cda29fced1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:49.781464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a222f8ea-7f12-4849-8e6e-f8cda29fced1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:49.781948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a222f8ea-7f12-4849-8e6e-f8cda29fced1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:49.782381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a222f8ea-7f12-4849-8e6e-f8cda29fced1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:49.783080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a222f8ea-7f12-4849-8e6e-f8cda29fced1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:49.783536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a222f8ea-7f12-4849-8e6e-f8cda29fced1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:49.783956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a222f8ea-7f12-4849-8e6e-f8cda29fced1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:49.849058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a222f8ea-7f12-4849-8e6e-f8cda29fced1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:49.858083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a222f8ea-7f12-4849-8e6e-f8cda29fced1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088042 Aug 31 00:51:49.858652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1285/2509] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:49 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:50.017800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:50.018447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:50.024445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:50.024972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:50.025350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:50.026034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:50.026485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:50.026902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:50.091149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:50.100920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:50.102392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:50.103644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-72b29510-57cd-4e88-b91a-2f01bf828f0d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089779 Aug 31 00:51:50.104204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1225/2510] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:50.638932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6fadc6f7-326d-49da-a87c-6d084abead60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:50.639617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6fadc6f7-326d-49da-a87c-6d084abead60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:50.645794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fadc6f7-326d-49da-a87c-6d084abead60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:50.646548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fadc6f7-326d-49da-a87c-6d084abead60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:50.647177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fadc6f7-326d-49da-a87c-6d084abead60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:50.647879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fadc6f7-326d-49da-a87c-6d084abead60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:50.648338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fadc6f7-326d-49da-a87c-6d084abead60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:50.648763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fadc6f7-326d-49da-a87c-6d084abead60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:50.779280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6fadc6f7-326d-49da-a87c-6d084abead60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:50.787501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6fadc6f7-326d-49da-a87c-6d084abead60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152427 Aug 31 00:51:50.788066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1286/2511] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:50.880166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-36dea8e0-04d6-43e7-a4ed-1a5242579bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:50.880972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-36dea8e0-04d6-43e7-a4ed-1a5242579bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:50.887390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36dea8e0-04d6-43e7-a4ed-1a5242579bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:50.887867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36dea8e0-04d6-43e7-a4ed-1a5242579bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:50.888296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36dea8e0-04d6-43e7-a4ed-1a5242579bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:50.889019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36dea8e0-04d6-43e7-a4ed-1a5242579bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:50.889420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36dea8e0-04d6-43e7-a4ed-1a5242579bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:50.889839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36dea8e0-04d6-43e7-a4ed-1a5242579bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:50.951475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-36dea8e0-04d6-43e7-a4ed-1a5242579bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:50.960364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-36dea8e0-04d6-43e7-a4ed-1a5242579bf4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084090 Aug 31 00:51:50.960924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1226/2512] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:50 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:51.126856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:51.127482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:51.133905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:51.134530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:51.134961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:51.135664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:51.136109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:51.136527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:51.197310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:51.205758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:51.207222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:51.208341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e9b08b2d-30a8-4eb3-9d2f-9b4fe8b59739 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085501 Aug 31 00:51:51.209573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1287/2513] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:51.809272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ad95d676-8806-4c5a-8c9a-6f0d3b420cff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:51.809880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ad95d676-8806-4c5a-8c9a-6f0d3b420cff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:51.815936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad95d676-8806-4c5a-8c9a-6f0d3b420cff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:51.816422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad95d676-8806-4c5a-8c9a-6f0d3b420cff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:51.816858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad95d676-8806-4c5a-8c9a-6f0d3b420cff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:51.817540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad95d676-8806-4c5a-8c9a-6f0d3b420cff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:51.818229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad95d676-8806-4c5a-8c9a-6f0d3b420cff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:51.818897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad95d676-8806-4c5a-8c9a-6f0d3b420cff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:51.950724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad95d676-8806-4c5a-8c9a-6f0d3b420cff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:51.958940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ad95d676-8806-4c5a-8c9a-6f0d3b420cff tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153576 Aug 31 00:51:51.959525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1227/2514] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:51.981636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3990000b-4234-48b8-9663-8828237cccce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:51.982248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3990000b-4234-48b8-9663-8828237cccce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:51.992593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3990000b-4234-48b8-9663-8828237cccce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:51.992593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3990000b-4234-48b8-9663-8828237cccce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:51.992593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3990000b-4234-48b8-9663-8828237cccce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:51.994056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3990000b-4234-48b8-9663-8828237cccce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:51.994564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3990000b-4234-48b8-9663-8828237cccce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:51.995368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3990000b-4234-48b8-9663-8828237cccce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:52.011624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:52.058813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3990000b-4234-48b8-9663-8828237cccce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:52.066935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3990000b-4234-48b8-9663-8828237cccce tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.089173 Aug 31 00:51:52.067517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1288/2515] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:51 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:52.232538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:52.233066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:52.239408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:52.240386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:52.240825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:52.241501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:52.241969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:52.242380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:52.306394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:52.315061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:52.316493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:52.317627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c1280a0c-362c-4a81-950c-fa7622dbb396 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089073 Aug 31 00:51:52.318845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1228/2516] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:52.981050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7bd241fb-b6df-4968-abb5-fd8909915202 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:52.981658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7bd241fb-b6df-4968-abb5-fd8909915202 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:52.987919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bd241fb-b6df-4968-abb5-fd8909915202 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:52.988482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bd241fb-b6df-4968-abb5-fd8909915202 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:52.988835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bd241fb-b6df-4968-abb5-fd8909915202 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:52.989529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bd241fb-b6df-4968-abb5-fd8909915202 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:52.990034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bd241fb-b6df-4968-abb5-fd8909915202 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:52.990659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bd241fb-b6df-4968-abb5-fd8909915202 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:53.088720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d25457f7-f67a-4fa7-836c-a07228c142d1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:53.089353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d25457f7-f67a-4fa7-836c-a07228c142d1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:53.095573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d25457f7-f67a-4fa7-836c-a07228c142d1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:53.096053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d25457f7-f67a-4fa7-836c-a07228c142d1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:53.096484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d25457f7-f67a-4fa7-836c-a07228c142d1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:53.097169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d25457f7-f67a-4fa7-836c-a07228c142d1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:53.097614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d25457f7-f67a-4fa7-836c-a07228c142d1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:53.098048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d25457f7-f67a-4fa7-836c-a07228c142d1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:53.124589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7bd241fb-b6df-4968-abb5-fd8909915202 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:53.133679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7bd241fb-b6df-4968-abb5-fd8909915202 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156577 Aug 31 00:51:53.141292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1289/2517] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:53.165034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d25457f7-f67a-4fa7-836c-a07228c142d1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:53.173291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d25457f7-f67a-4fa7-836c-a07228c142d1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088365 Aug 31 00:51:53.173848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1229/2518] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:53 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:53.341429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:53.342109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:53.348246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:53.348747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:53.349418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:53.350301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:53.351018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:53.351462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:53.413544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:53.422210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:53.423702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:53.424832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c1fba7dd-57b3-442c-a712-c391a4c53b80 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088174 Aug 31 00:51:53.425393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1290/2519] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:53 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:54.154763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3f003db1-1e11-4d14-a151-f99e947518bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:54.155396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3f003db1-1e11-4d14-a151-f99e947518bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:54.162266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f003db1-1e11-4d14-a151-f99e947518bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:54.162733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f003db1-1e11-4d14-a151-f99e947518bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:54.163190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f003db1-1e11-4d14-a151-f99e947518bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:54.163863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f003db1-1e11-4d14-a151-f99e947518bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:54.164304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f003db1-1e11-4d14-a151-f99e947518bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:54.164717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f003db1-1e11-4d14-a151-f99e947518bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:54.195788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-46fb38b6-a77f-487a-95b4-a9b04e6b1c98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:54.196398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-46fb38b6-a77f-487a-95b4-a9b04e6b1c98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:54.202873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fb38b6-a77f-487a-95b4-a9b04e6b1c98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:54.203393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fb38b6-a77f-487a-95b4-a9b04e6b1c98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:54.203826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fb38b6-a77f-487a-95b4-a9b04e6b1c98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:54.204529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fb38b6-a77f-487a-95b4-a9b04e6b1c98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:54.204959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fb38b6-a77f-487a-95b4-a9b04e6b1c98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:54.205379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-46fb38b6-a77f-487a-95b4-a9b04e6b1c98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:54.278875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-46fb38b6-a77f-487a-95b4-a9b04e6b1c98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:54.287082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-46fb38b6-a77f-487a-95b4-a9b04e6b1c98 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.095674 Aug 31 00:51:54.287661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1291/2520] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:54 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:54.320434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3f003db1-1e11-4d14-a151-f99e947518bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:54.328794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3f003db1-1e11-4d14-a151-f99e947518bd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.177910 Aug 31 00:51:54.329364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1230/2521] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:54 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:54.447954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:54.448476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:54.454439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:54.454918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:54.455384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:54.456156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:54.456605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:54.457026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:54.668863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:54.677386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:54.679494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:54.680621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-672dcbdf-94a1-4f7b-afae-9cd6b37b25f9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.237283 Aug 31 00:51:54.681177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1292/2522] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:55.309191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ac3c016b-079b-4d2b-be49-f725e77d02a3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:55.309752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ac3c016b-079b-4d2b-be49-f725e77d02a3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:55.316221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3c016b-079b-4d2b-be49-f725e77d02a3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:55.316696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3c016b-079b-4d2b-be49-f725e77d02a3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:55.317122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3c016b-079b-4d2b-be49-f725e77d02a3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:55.317792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3c016b-079b-4d2b-be49-f725e77d02a3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:55.318233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3c016b-079b-4d2b-be49-f725e77d02a3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:55.318645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3c016b-079b-4d2b-be49-f725e77d02a3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:55.351931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-34675951-da0c-451e-bcc4-2cae9da8f22e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:55.352636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-34675951-da0c-451e-bcc4-2cae9da8f22e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:55.359181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34675951-da0c-451e-bcc4-2cae9da8f22e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:55.359663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34675951-da0c-451e-bcc4-2cae9da8f22e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:55.360127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34675951-da0c-451e-bcc4-2cae9da8f22e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:55.360816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34675951-da0c-451e-bcc4-2cae9da8f22e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:55.361264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34675951-da0c-451e-bcc4-2cae9da8f22e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:55.361731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34675951-da0c-451e-bcc4-2cae9da8f22e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:55.381839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ac3c016b-079b-4d2b-be49-f725e77d02a3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:55.391167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ac3c016b-079b-4d2b-be49-f725e77d02a3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.085854 Aug 31 00:51:55.391773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1231/2523] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:55 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:55.500803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34675951-da0c-451e-bcc4-2cae9da8f22e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:55.509109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-34675951-da0c-451e-bcc4-2cae9da8f22e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.161363 Aug 31 00:51:55.509672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1293/2524] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:55 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:55.704018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:55.704618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:55.710961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:55.711479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:55.711910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:55.712622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:55.713072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:55.713492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:55.777053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:55.785960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:55.787435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:55.789663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4633bcf3-57ef-4bc6-8195-7361816107a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088977 Aug 31 00:51:55.790801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1232/2525] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:56.414061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ae06e345-ae5b-429a-8326-2e2c746423e3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:56.414696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ae06e345-ae5b-429a-8326-2e2c746423e3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:56.421087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae06e345-ae5b-429a-8326-2e2c746423e3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:56.421563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae06e345-ae5b-429a-8326-2e2c746423e3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:56.422027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae06e345-ae5b-429a-8326-2e2c746423e3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:56.422700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae06e345-ae5b-429a-8326-2e2c746423e3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:56.423177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae06e345-ae5b-429a-8326-2e2c746423e3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:56.423594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae06e345-ae5b-429a-8326-2e2c746423e3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:56.485147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ae06e345-ae5b-429a-8326-2e2c746423e3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:56.494266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ae06e345-ae5b-429a-8326-2e2c746423e3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.084631 Aug 31 00:51:56.494821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1294/2526] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:56 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:56.529502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cf8af908-23ea-4cdd-a769-70fee9b556e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:56.530101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cf8af908-23ea-4cdd-a769-70fee9b556e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:56.536399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf8af908-23ea-4cdd-a769-70fee9b556e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:56.536870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf8af908-23ea-4cdd-a769-70fee9b556e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:56.537297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf8af908-23ea-4cdd-a769-70fee9b556e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:56.538504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf8af908-23ea-4cdd-a769-70fee9b556e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:56.539127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf8af908-23ea-4cdd-a769-70fee9b556e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:56.539546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf8af908-23ea-4cdd-a769-70fee9b556e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:56.670091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cf8af908-23ea-4cdd-a769-70fee9b556e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:56.678337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cf8af908-23ea-4cdd-a769-70fee9b556e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152586 Aug 31 00:51:56.678898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1233/2527] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:56.814288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:56.814917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:56.821718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:56.822201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:56.822655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:56.823365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:56.823812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:56.824230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:56.886574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:56.895202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:56.896641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:56.898578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a6eca255-fc61-4f5b-8a05-5ac0c8270b31 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088215 Aug 31 00:51:56.899669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1295/2528] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:57.515278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c6b3eafe-f591-4995-b555-a82c1f8d0a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:57.515886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c6b3eafe-f591-4995-b555-a82c1f8d0a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:57.521821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6b3eafe-f591-4995-b555-a82c1f8d0a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:57.522340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6b3eafe-f591-4995-b555-a82c1f8d0a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:57.522767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6b3eafe-f591-4995-b555-a82c1f8d0a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:57.523540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6b3eafe-f591-4995-b555-a82c1f8d0a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:57.524019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6b3eafe-f591-4995-b555-a82c1f8d0a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:57.524437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c6b3eafe-f591-4995-b555-a82c1f8d0a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:57.584645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c6b3eafe-f591-4995-b555-a82c1f8d0a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:57.592762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c6b3eafe-f591-4995-b555-a82c1f8d0a54 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.081408 Aug 31 00:51:57.593319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1234/2529] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:57 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:57.700219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5bca4498-c5ed-42e1-9973-3887f46272eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:57.700803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5bca4498-c5ed-42e1-9973-3887f46272eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:57.707458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bca4498-c5ed-42e1-9973-3887f46272eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:57.707932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bca4498-c5ed-42e1-9973-3887f46272eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:57.708360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bca4498-c5ed-42e1-9973-3887f46272eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:57.709034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bca4498-c5ed-42e1-9973-3887f46272eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:57.709484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bca4498-c5ed-42e1-9973-3887f46272eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:57.710108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5bca4498-c5ed-42e1-9973-3887f46272eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:57.841606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5bca4498-c5ed-42e1-9973-3887f46272eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:57.850014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5bca4498-c5ed-42e1-9973-3887f46272eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153630 Aug 31 00:51:57.851085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1296/2530] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:57.921691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:57.922295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:57.928594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:57.929042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:57.929473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:57.930149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:57.930594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:57.931011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:57.991376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:57.999916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:58.001349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:58.002473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2f303ea9-773c-4c08-a617-581626123d19 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.084693 Aug 31 00:51:58.003022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1235/2531] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:51:58.614006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a33cff64-700c-412a-bd3b-df11f7c2fefb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:58.614633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a33cff64-700c-412a-bd3b-df11f7c2fefb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:58.621564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a33cff64-700c-412a-bd3b-df11f7c2fefb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:58.622039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a33cff64-700c-412a-bd3b-df11f7c2fefb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:58.622468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a33cff64-700c-412a-bd3b-df11f7c2fefb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:58.623171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a33cff64-700c-412a-bd3b-df11f7c2fefb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:58.623612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a33cff64-700c-412a-bd3b-df11f7c2fefb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:58.624024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a33cff64-700c-412a-bd3b-df11f7c2fefb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:58.687926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a33cff64-700c-412a-bd3b-df11f7c2fefb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:58.696248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a33cff64-700c-412a-bd3b-df11f7c2fefb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.086158 Aug 31 00:51:58.696806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1297/2532] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:58 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:51:58.872446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f0c139c0-54e7-455b-be4e-5d85a55ada1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:58.872976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f0c139c0-54e7-455b-be4e-5d85a55ada1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:58.879439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c139c0-54e7-455b-be4e-5d85a55ada1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:58.879918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c139c0-54e7-455b-be4e-5d85a55ada1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:58.880349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c139c0-54e7-455b-be4e-5d85a55ada1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:58.881026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c139c0-54e7-455b-be4e-5d85a55ada1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:58.881476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c139c0-54e7-455b-be4e-5d85a55ada1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:58.881893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c139c0-54e7-455b-be4e-5d85a55ada1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:59.012675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f0c139c0-54e7-455b-be4e-5d85a55ada1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:59.020907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f0c139c0-54e7-455b-be4e-5d85a55ada1e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152462 Aug 31 00:51:59.021474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1236/2533] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:51:59.025883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:59.026479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:59.032989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:59.033466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:59.033892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:59.034583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:59.035011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:59.035451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:59.097912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:59.106807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:59.108251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:59.109368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-70bd51bd-00f0-412b-9a1c-00d6c0c8f1bf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087448 Aug 31 00:51:59.109923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1298/2534] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:51:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:51:59.720636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c07833cd-3806-4590-aa18-631890cd2154 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:51:59.721255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c07833cd-3806-4590-aa18-631890cd2154 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:51:59.727883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c07833cd-3806-4590-aa18-631890cd2154 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:59.728355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c07833cd-3806-4590-aa18-631890cd2154 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:59.728786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c07833cd-3806-4590-aa18-631890cd2154 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:59.729481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c07833cd-3806-4590-aa18-631890cd2154 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:51:59.729936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c07833cd-3806-4590-aa18-631890cd2154 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:51:59.730358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c07833cd-3806-4590-aa18-631890cd2154 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:51:59.733637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:51:59.793017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c07833cd-3806-4590-aa18-631890cd2154 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:51:59.801185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c07833cd-3806-4590-aa18-631890cd2154 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.088285 Aug 31 00:51:59.801745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1237/2535] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:51:59 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:00.042521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3c1b7242-9f98-456c-9c93-0f535f3f17cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:00.043237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3c1b7242-9f98-456c-9c93-0f535f3f17cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:00.049349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c1b7242-9f98-456c-9c93-0f535f3f17cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:00.049821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c1b7242-9f98-456c-9c93-0f535f3f17cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:00.050247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c1b7242-9f98-456c-9c93-0f535f3f17cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:00.050931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c1b7242-9f98-456c-9c93-0f535f3f17cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:00.051467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c1b7242-9f98-456c-9c93-0f535f3f17cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:00.051880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c1b7242-9f98-456c-9c93-0f535f3f17cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:00.133688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:00.134194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:00.140614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:00.141100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:00.141534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:00.142227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:00.142678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:00.143127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:00.195659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3c1b7242-9f98-456c-9c93-0f535f3f17cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:00.203866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3c1b7242-9f98-456c-9c93-0f535f3f17cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.165777 Aug 31 00:52:00.204656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1299/2536] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:00.212463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:00.221247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:00.222749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:00.224006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-db1837c0-c983-4421-9786-836848becbe8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.095256 Aug 31 00:52:00.224558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1238/2537] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:00.822612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5c35ec07-f6ff-4320-9230-37382a57c3bf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:00.823239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5c35ec07-f6ff-4320-9230-37382a57c3bf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:00.829214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c35ec07-f6ff-4320-9230-37382a57c3bf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:00.829691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c35ec07-f6ff-4320-9230-37382a57c3bf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:00.830122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c35ec07-f6ff-4320-9230-37382a57c3bf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:00.830808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c35ec07-f6ff-4320-9230-37382a57c3bf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:00.831284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c35ec07-f6ff-4320-9230-37382a57c3bf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:00.831702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c35ec07-f6ff-4320-9230-37382a57c3bf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:00.892398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5c35ec07-f6ff-4320-9230-37382a57c3bf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:00.900755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5c35ec07-f6ff-4320-9230-37382a57c3bf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 200 len: 1367 microversion: 2.1 time: 0.082248 Aug 31 00:52:00.901316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1300/2538] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:00 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:00.922608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-946e54dc-410e-41ee-ab55-3c9146351107 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '.version_select at 0x7fa7f7531e50>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:00.946192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-946e54dc-410e-41ee-ab55-3c9146351107 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-371279552" status: 202 len: 0 microversion: 2.1 time: 0.027281 Aug 31 00:52:00.946756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1239/2539] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 31 00:52:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-371279552 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:52:01.225965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a20fcc64-7ac0-4f79-80da-9c9ce1bc1d5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:01.226611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a20fcc64-7ac0-4f79-80da-9c9ce1bc1d5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:01.233665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a20fcc64-7ac0-4f79-80da-9c9ce1bc1d5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:01.234230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a20fcc64-7ac0-4f79-80da-9c9ce1bc1d5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:01.234717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a20fcc64-7ac0-4f79-80da-9c9ce1bc1d5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:01.235557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a20fcc64-7ac0-4f79-80da-9c9ce1bc1d5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:01.236110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a20fcc64-7ac0-4f79-80da-9c9ce1bc1d5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:01.236699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a20fcc64-7ac0-4f79-80da-9c9ce1bc1d5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:01.251344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:01.251968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:01.264923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:01.265413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:01.270029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:01.270759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:01.271383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:01.271969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:01.405881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:01.421305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:01.422994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:01.424976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c5d3c0d9-9889-4eaf-a76e-bba9e68439d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.179090 Aug 31 00:52:01.426250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1240/2540] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:01.446623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a20fcc64-7ac0-4f79-80da-9c9ce1bc1d5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:01.457363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a20fcc64-7ac0-4f79-80da-9c9ce1bc1d5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.234018 Aug 31 00:52:01.458676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1301/2541] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:01.818055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-72f85e9d-495f-4b52-95ca-df827637e2b8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Action: 'create', calling method: .version_select at 0x7fa7f76f7e50>, body: {"keypair": {"name": "tempest-keypair-945975288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImaw3R6PgZx5ySVhY6lcFbVbquETu4aQut4njbtQVu6x+03NNFZRBuaXkdduW8lkKSoFl+rokCfQJmSPoWatnL8ebFg8NV6zMn6jpJ76ZzG6AkE1HDA9BRXcvEV/UoenA=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:52:01.833707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-72f85e9d-495f-4b52-95ca-df827637e2b8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Getting quotas for project 885b952a63b34e1ba97215831cffc58e. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:52:01.838586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-72f85e9d-495f-4b52-95ca-df827637e2b8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Getting quotas for user 6d1a15d59d5d476ca6e0ab5176d310cd and project 885b952a63b34e1ba97215831cffc58e. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:52:01.861813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-72f85e9d-495f-4b52-95ca-df827637e2b8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047722 Aug 31 00:52:01.862337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1241/2542] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 31 00:52:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:52:02.453326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:02.453918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:02.461000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:02.461493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:02.461932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:02.462632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:02.463105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:02.463530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:02.480826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2c2e7151-55ab-4e81-80a6-eab139cbedcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:02.482107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2c2e7151-55ab-4e81-80a6-eab139cbedcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:02.489682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c2e7151-55ab-4e81-80a6-eab139cbedcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:02.490444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c2e7151-55ab-4e81-80a6-eab139cbedcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:02.491864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c2e7151-55ab-4e81-80a6-eab139cbedcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:02.492967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c2e7151-55ab-4e81-80a6-eab139cbedcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:02.493645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c2e7151-55ab-4e81-80a6-eab139cbedcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:02.494247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c2e7151-55ab-4e81-80a6-eab139cbedcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:02.548076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:02.558711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:02.560467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:02.561683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4b6a873e-e336-4694-a595-35ea88b81dbf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.112172 Aug 31 00:52:02.562562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1302/2543] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:02.635934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c2e7151-55ab-4e81-80a6-eab139cbedcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:02.644995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2c2e7151-55ab-4e81-80a6-eab139cbedcc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.168477 Aug 31 00:52:02.645569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1242/2544] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:03.154133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-461591387", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27ead1ec-406a-4401-90a4-a64803333a3a"}], "security_groups": [{"name": "tempest-securitygroup--1736883586"}], "key_name": "tempest-keypair-945975288", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:52:03.258489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] validate_networks() for [('27ead1ec-406a-4401-90a4-a64803333a3a', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:52:03.585508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:03.586147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:03.592591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:03.593082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:03.593519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:03.594215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:03.594665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:03.595108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:03.687573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:03.696814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:03.698240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:03.699399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f9b64c05-3a3f-4053-9abe-59ffe049afee tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.118852 Aug 31 00:52:03.699952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1243/2545] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:03.705085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-47d4fdff-b501-429b-a8b0-3af356328149 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:03.705617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-47d4fdff-b501-429b-a8b0-3af356328149 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:03.712219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-47d4fdff-b501-429b-a8b0-3af356328149 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:03.712704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-47d4fdff-b501-429b-a8b0-3af356328149 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:03.713136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-47d4fdff-b501-429b-a8b0-3af356328149 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:03.713816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-47d4fdff-b501-429b-a8b0-3af356328149 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:03.714439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-47d4fdff-b501-429b-a8b0-3af356328149 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:03.714865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-47d4fdff-b501-429b-a8b0-3af356328149 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:03.728027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:52:03.728562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:52:03.728897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:52:03.729298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:52:03.729724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:52:03.738855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:03.739364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:03.739795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:03.740511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:03.741678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:03.742187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:03.760672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Getting quotas for project 885b952a63b34e1ba97215831cffc58e. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:52:03.764977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Getting quotas for user 6d1a15d59d5d476ca6e0ab5176d310cd and project 885b952a63b34e1ba97215831cffc58e. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:52:03.775838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:52:03.778110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:52:03.835009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b29bb2c3-51da-4038-967e-d5318fe34048 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.684422 Aug 31 00:52:03.841734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1303/2546] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:52:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:52:03.846830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-403c38a3-d5e8-425f-ad9c-f81ed01e1af6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:03.847733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-403c38a3-d5e8-425f-ad9c-f81ed01e1af6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:03.851062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-47d4fdff-b501-429b-a8b0-3af356328149 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:03.859836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-47d4fdff-b501-429b-a8b0-3af356328149 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.158909 Aug 31 00:52:03.860433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1244/2547] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:03.908668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-403c38a3-d5e8-425f-ad9c-f81ed01e1af6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:03.915728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-403c38a3-d5e8-425f-ad9c-f81ed01e1af6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1236 microversion: 2.1 time: 0.072808 Aug 31 00:52:03.916280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1304/2548] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:03 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:52:04.722756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:04.723408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:04.730619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:04.731137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:04.731576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:04.732258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:04.732718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:04.733128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:04.798729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:04.807447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:04.808874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:04.809990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c9a0bd99-bf63-46e4-b80c-4a62dadf3e89 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091480 Aug 31 00:52:04.810544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1245/2549] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:04.882025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-116f06a2-c619-4f71-9561-44c74251f1dd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:04.883650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-116f06a2-c619-4f71-9561-44c74251f1dd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:04.890023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-116f06a2-c619-4f71-9561-44c74251f1dd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:04.890504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-116f06a2-c619-4f71-9561-44c74251f1dd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:04.890935 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-116f06a2-c619-4f71-9561-44c74251f1dd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:04.891644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-116f06a2-c619-4f71-9561-44c74251f1dd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:04.892089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-116f06a2-c619-4f71-9561-44c74251f1dd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:04.892502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-116f06a2-c619-4f71-9561-44c74251f1dd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:04.937147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a9bdf6fc-4e84-4741-bcd9-f9dee9293b28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:04.937799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a9bdf6fc-4e84-4741-bcd9-f9dee9293b28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:04.997208 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a9bdf6fc-4e84-4741-bcd9-f9dee9293b28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:05.004664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a9bdf6fc-4e84-4741-bcd9-f9dee9293b28 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1236 microversion: 2.1 time: 0.071479 Aug 31 00:52:05.005360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1246/2550] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:04 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:52:05.059864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-116f06a2-c619-4f71-9561-44c74251f1dd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:05.068141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-116f06a2-c619-4f71-9561-44c74251f1dd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.190490 Aug 31 00:52:05.068702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1305/2551] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:05.833648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:05.834255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:05.840863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:05.841281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:05.841714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:05.842396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:05.842843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:05.843289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:05.907148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:05.916627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:05.918055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:05.919216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7e65906d-8226-4298-b851-873b8efc5168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089767 Aug 31 00:52:05.919768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1247/2552] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:06.031300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9303c2d8-8784-4e0d-b892-089341f7a563 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:06.031971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9303c2d8-8784-4e0d-b892-089341f7a563 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:06.089890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b94ff1e7-d917-4357-8dfc-dbef96eee900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:06.090649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b94ff1e7-d917-4357-8dfc-dbef96eee900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:06.096981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b94ff1e7-d917-4357-8dfc-dbef96eee900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:06.097423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9303c2d8-8784-4e0d-b892-089341f7a563 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:06.097587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b94ff1e7-d917-4357-8dfc-dbef96eee900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:06.097882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b94ff1e7-d917-4357-8dfc-dbef96eee900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:06.098573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b94ff1e7-d917-4357-8dfc-dbef96eee900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:06.099021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b94ff1e7-d917-4357-8dfc-dbef96eee900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:06.099470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b94ff1e7-d917-4357-8dfc-dbef96eee900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:06.106203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9303c2d8-8784-4e0d-b892-089341f7a563 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1236 microversion: 2.1 time: 0.082839 Aug 31 00:52:06.106972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1306/2553] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:06 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:06.235585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b94ff1e7-d917-4357-8dfc-dbef96eee900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:06.243786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b94ff1e7-d917-4357-8dfc-dbef96eee900 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157707 Aug 31 00:52:06.244351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1248/2554] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:06.942724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:06.943351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:06.949507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:06.949983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:06.950406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:06.951099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:06.951543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:06.951955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:07.018621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:07.021242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:07.029809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:07.031299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:07.032443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cdb2863f-46b6-431c-8a89-274c67605197 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.093586 Aug 31 00:52:07.033154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1307/2555] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:07.128197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d7da37b5-ab45-4f86-996b-9f01e7c1fe8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:07.128801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d7da37b5-ab45-4f86-996b-9f01e7c1fe8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:07.183271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d7da37b5-ab45-4f86-996b-9f01e7c1fe8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:07.190160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d7da37b5-ab45-4f86-996b-9f01e7c1fe8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1236 microversion: 2.1 time: 0.065771 Aug 31 00:52:07.190727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1249/2556] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:07 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:07.266370 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d8d86cbc-85b5-4846-aa3e-75b2a00614f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:07.266975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d8d86cbc-85b5-4846-aa3e-75b2a00614f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:07.273901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d86cbc-85b5-4846-aa3e-75b2a00614f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:07.274385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d86cbc-85b5-4846-aa3e-75b2a00614f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:07.274821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d86cbc-85b5-4846-aa3e-75b2a00614f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:07.275534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d86cbc-85b5-4846-aa3e-75b2a00614f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:07.275984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d86cbc-85b5-4846-aa3e-75b2a00614f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:07.276410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d86cbc-85b5-4846-aa3e-75b2a00614f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:07.412373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d8d86cbc-85b5-4846-aa3e-75b2a00614f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:07.421063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d8d86cbc-85b5-4846-aa3e-75b2a00614f5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.158704 Aug 31 00:52:07.421624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1308/2557] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:08.056184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:08.056946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:08.062958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:08.063469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:08.063898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:08.064578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:08.065024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:08.065445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:08.127448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:08.137028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:08.138491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:08.139650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ce9f6061-10a3-4545-9f46-06a66453f156 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087662 Aug 31 00:52:08.140207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1250/2558] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:08.211609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d30f1222-880a-4433-bbf0-97bc303c0711 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:08.213033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d30f1222-880a-4433-bbf0-97bc303c0711 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:08.219079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d30f1222-880a-4433-bbf0-97bc303c0711 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:08.219561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d30f1222-880a-4433-bbf0-97bc303c0711 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:08.219988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d30f1222-880a-4433-bbf0-97bc303c0711 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:08.220667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d30f1222-880a-4433-bbf0-97bc303c0711 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:08.221114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d30f1222-880a-4433-bbf0-97bc303c0711 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:08.221530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d30f1222-880a-4433-bbf0-97bc303c0711 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:08.281327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d30f1222-880a-4433-bbf0-97bc303c0711 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:08.289078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d30f1222-880a-4433-bbf0-97bc303c0711 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1240 microversion: 2.1 time: 0.081271 Aug 31 00:52:08.289632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1309/2559] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:08 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:08.442197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2a96fc90-b5fe-4710-8fb2-c1aa69f21f16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:08.442802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2a96fc90-b5fe-4710-8fb2-c1aa69f21f16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:08.444681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:08.451183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a96fc90-b5fe-4710-8fb2-c1aa69f21f16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:08.451719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a96fc90-b5fe-4710-8fb2-c1aa69f21f16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:08.452181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a96fc90-b5fe-4710-8fb2-c1aa69f21f16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:08.452867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a96fc90-b5fe-4710-8fb2-c1aa69f21f16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:08.453314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a96fc90-b5fe-4710-8fb2-c1aa69f21f16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:08.453734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a96fc90-b5fe-4710-8fb2-c1aa69f21f16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:08.589863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2a96fc90-b5fe-4710-8fb2-c1aa69f21f16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:08.598330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2a96fc90-b5fe-4710-8fb2-c1aa69f21f16 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.159972 Aug 31 00:52:08.598941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1251/2560] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:09.162531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:09.163537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:09.170699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:09.171422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:09.171801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:09.172715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:09.173109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:09.173595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:09.311094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-879bb67e-a7fe-4cee-9194-e2adcb197a9f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:09.312324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-879bb67e-a7fe-4cee-9194-e2adcb197a9f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:09.319608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879bb67e-a7fe-4cee-9194-e2adcb197a9f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:09.320099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879bb67e-a7fe-4cee-9194-e2adcb197a9f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:09.320534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879bb67e-a7fe-4cee-9194-e2adcb197a9f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:09.321237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879bb67e-a7fe-4cee-9194-e2adcb197a9f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:09.321825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879bb67e-a7fe-4cee-9194-e2adcb197a9f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:09.322937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879bb67e-a7fe-4cee-9194-e2adcb197a9f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:09.500023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:09.508539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:09.510576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:09.511737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9bfa9c2c-aef7-4a64-aea0-3698220b383c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.353112 Aug 31 00:52:09.514359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1310/2561] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:09.534610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-879bb67e-a7fe-4cee-9194-e2adcb197a9f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:09.542407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-879bb67e-a7fe-4cee-9194-e2adcb197a9f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1294 microversion: 2.1 time: 0.236532 Aug 31 00:52:09.542982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1252/2562] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:09 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1294 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:52:09.621424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e7c85149-4641-46a1-a77d-5a929d4bd43d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:09.622057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e7c85149-4641-46a1-a77d-5a929d4bd43d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:09.627966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7c85149-4641-46a1-a77d-5a929d4bd43d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:09.628448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7c85149-4641-46a1-a77d-5a929d4bd43d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:09.629004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7c85149-4641-46a1-a77d-5a929d4bd43d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:09.629721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7c85149-4641-46a1-a77d-5a929d4bd43d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:09.630170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7c85149-4641-46a1-a77d-5a929d4bd43d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:09.630593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7c85149-4641-46a1-a77d-5a929d4bd43d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:09.824278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e7c85149-4641-46a1-a77d-5a929d4bd43d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:09.832746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e7c85149-4641-46a1-a77d-5a929d4bd43d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.215736 Aug 31 00:52:09.833317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1311/2563] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:10.533983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:10.534593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:10.541783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:10.542334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:10.542764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:10.543544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:10.543993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:10.544413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:10.564388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7bc92ed3-5ffb-48b7-af3b-66ed6acbf907 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:10.565225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7bc92ed3-5ffb-48b7-af3b-66ed6acbf907 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:10.574107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc92ed3-5ffb-48b7-af3b-66ed6acbf907 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:10.574726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc92ed3-5ffb-48b7-af3b-66ed6acbf907 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:10.575257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc92ed3-5ffb-48b7-af3b-66ed6acbf907 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:10.575940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc92ed3-5ffb-48b7-af3b-66ed6acbf907 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:10.576389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc92ed3-5ffb-48b7-af3b-66ed6acbf907 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:10.576799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bc92ed3-5ffb-48b7-af3b-66ed6acbf907 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:10.612776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:10.622097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:10.623642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:10.624785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-92070672-a12f-482a-afe5-cf7946784c91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.094722 Aug 31 00:52:10.625352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1253/2564] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:10.785510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7bc92ed3-5ffb-48b7-af3b-66ed6acbf907 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:10.795248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7bc92ed3-5ffb-48b7-af3b-66ed6acbf907 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1362 microversion: 2.1 time: 0.234589 Aug 31 00:52:10.795961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1312/2565] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:10 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:10.856347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-738c4650-f1ba-4533-8d9e-33e0375ad586 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:10.857136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-738c4650-f1ba-4533-8d9e-33e0375ad586 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:10.879282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-738c4650-f1ba-4533-8d9e-33e0375ad586 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:10.879774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-738c4650-f1ba-4533-8d9e-33e0375ad586 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:10.880211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-738c4650-f1ba-4533-8d9e-33e0375ad586 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:10.880905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-738c4650-f1ba-4533-8d9e-33e0375ad586 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:10.881352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-738c4650-f1ba-4533-8d9e-33e0375ad586 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:10.881769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-738c4650-f1ba-4533-8d9e-33e0375ad586 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:11.065309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-738c4650-f1ba-4533-8d9e-33e0375ad586 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:11.075092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-738c4650-f1ba-4533-8d9e-33e0375ad586 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.223304 Aug 31 00:52:11.075962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1254/2566] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:11.195283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-35b13f22-187e-46b3-bc16-cf2ac9dff025 req-f7484407-3cf0-4534-ab08-22452c1d7330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b03f73-ff98-42f0-afb1-547a36f8ed55", "tag": "024e5992-1376-4fb8-89fd-344e227c9100"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:52:11.207189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-35b13f22-187e-46b3-bc16-cf2ac9dff025 req-f7484407-3cf0-4534-ab08-22452c1d7330 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:11.208227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-35b13f22-187e-46b3-bc16-cf2ac9dff025 req-f7484407-3cf0-4534-ab08-22452c1d7330 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:11.208889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-35b13f22-187e-46b3-bc16-cf2ac9dff025 req-f7484407-3cf0-4534-ab08-22452c1d7330 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:11.221503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-35b13f22-187e-46b3-bc16-cf2ac9dff025 req-f7484407-3cf0-4534-ab08-22452c1d7330 service nova] Creating event network-changed:024e5992-1376-4fb8-89fd-344e227c9100 for instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 on hv-cinder-85506 Aug 31 00:52:11.227299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-35b13f22-187e-46b3-bc16-cf2ac9dff025 req-f7484407-3cf0-4534-ab08-22452c1d7330 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091473 Aug 31 00:52:11.228455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1313/2567] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:52:11.647802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:11.648412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:11.655449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:11.655931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:11.656366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:11.657046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:11.657498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:11.657920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:11.721142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:11.730357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:11.731814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:11.732933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7b30bf24-1c78-4686-bb43-e507ecfc6f72 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089085 Aug 31 00:52:11.733483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1255/2568] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:11.818456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3a646b13-d22a-4fa1-b535-1c3ce593ca48 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:11.819209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3a646b13-d22a-4fa1-b535-1c3ce593ca48 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:11.826874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a646b13-d22a-4fa1-b535-1c3ce593ca48 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:11.827408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a646b13-d22a-4fa1-b535-1c3ce593ca48 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:11.827842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a646b13-d22a-4fa1-b535-1c3ce593ca48 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:11.828548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a646b13-d22a-4fa1-b535-1c3ce593ca48 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:11.829004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a646b13-d22a-4fa1-b535-1c3ce593ca48 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:11.829426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3a646b13-d22a-4fa1-b535-1c3ce593ca48 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:11.974906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3a646b13-d22a-4fa1-b535-1c3ce593ca48 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:11.983677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3a646b13-d22a-4fa1-b535-1c3ce593ca48 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1362 microversion: 2.1 time: 0.170040 Aug 31 00:52:11.984237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1314/2569] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:11 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:12.097666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6c7bb891-f4c6-440d-b9e2-6a38ae3df349 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:12.098302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6c7bb891-f4c6-440d-b9e2-6a38ae3df349 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:12.104639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c7bb891-f4c6-440d-b9e2-6a38ae3df349 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:12.105121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c7bb891-f4c6-440d-b9e2-6a38ae3df349 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:12.105554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c7bb891-f4c6-440d-b9e2-6a38ae3df349 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:12.106237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c7bb891-f4c6-440d-b9e2-6a38ae3df349 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:12.106691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c7bb891-f4c6-440d-b9e2-6a38ae3df349 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:12.107143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6c7bb891-f4c6-440d-b9e2-6a38ae3df349 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:12.236129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6c7bb891-f4c6-440d-b9e2-6a38ae3df349 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:12.244913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6c7bb891-f4c6-440d-b9e2-6a38ae3df349 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151050 Aug 31 00:52:12.245511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1256/2570] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:12.756242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:12.756848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:12.763030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:12.763537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:12.763966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:12.764640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:12.765090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:12.765507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:12.827955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:12.836483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:12.838294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:12.839459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8e4c64f2-db6b-4db6-9852-0c72a16bd44f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087181 Aug 31 00:52:12.840024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1315/2571] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:13.005140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b4e51e8a-97ab-43e1-9291-a429a6bff1bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:13.005893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b4e51e8a-97ab-43e1-9291-a429a6bff1bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:13.012515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4e51e8a-97ab-43e1-9291-a429a6bff1bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:13.012934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4e51e8a-97ab-43e1-9291-a429a6bff1bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:13.013370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4e51e8a-97ab-43e1-9291-a429a6bff1bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:13.014047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4e51e8a-97ab-43e1-9291-a429a6bff1bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:13.014494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4e51e8a-97ab-43e1-9291-a429a6bff1bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:13.014911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4e51e8a-97ab-43e1-9291-a429a6bff1bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:13.151348 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b4e51e8a-97ab-43e1-9291-a429a6bff1bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:13.153516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:13.159986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b4e51e8a-97ab-43e1-9291-a429a6bff1bb tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1362 microversion: 2.1 time: 0.158704 Aug 31 00:52:13.160554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1257/2572] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:13 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:13.265815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-afba0a2e-7798-4e50-ad11-43fc8d5f5ea9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:13.266382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-afba0a2e-7798-4e50-ad11-43fc8d5f5ea9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:13.268394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:13.273949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afba0a2e-7798-4e50-ad11-43fc8d5f5ea9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:13.275244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afba0a2e-7798-4e50-ad11-43fc8d5f5ea9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:13.275963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afba0a2e-7798-4e50-ad11-43fc8d5f5ea9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:13.276665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afba0a2e-7798-4e50-ad11-43fc8d5f5ea9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:13.277120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afba0a2e-7798-4e50-ad11-43fc8d5f5ea9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:13.277545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afba0a2e-7798-4e50-ad11-43fc8d5f5ea9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:13.410224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-afba0a2e-7798-4e50-ad11-43fc8d5f5ea9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:13.418380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-afba0a2e-7798-4e50-ad11-43fc8d5f5ea9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156553 Aug 31 00:52:13.418938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1316/2573] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:13.863158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:13.863688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:13.870420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:13.870883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:13.871332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:13.871997 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:13.872440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:13.872930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:13.946044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:13.955885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:13.957351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:13.958480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f8ff43e8-147d-4daa-84ee-09d007a9692b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.099345 Aug 31 00:52:13.959026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1258/2574] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:13 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:14.181250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e348961d-4b79-4e0a-8709-7aab9d8e9354 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:14.182177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e348961d-4b79-4e0a-8709-7aab9d8e9354 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:14.184166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:14.190034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e348961d-4b79-4e0a-8709-7aab9d8e9354 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:14.190519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e348961d-4b79-4e0a-8709-7aab9d8e9354 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:14.191103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e348961d-4b79-4e0a-8709-7aab9d8e9354 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:14.191669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e348961d-4b79-4e0a-8709-7aab9d8e9354 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:14.192114 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e348961d-4b79-4e0a-8709-7aab9d8e9354 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:14.192531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e348961d-4b79-4e0a-8709-7aab9d8e9354 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:14.429525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e348961d-4b79-4e0a-8709-7aab9d8e9354 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:14.437247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e348961d-4b79-4e0a-8709-7aab9d8e9354 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1362 microversion: 2.1 time: 0.259767 Aug 31 00:52:14.438369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1317/2575] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:14 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:14.440781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-092ef1b5-0e95-47ed-8c38-421cdf2ba0be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:14.442019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-092ef1b5-0e95-47ed-8c38-421cdf2ba0be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:14.449216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-092ef1b5-0e95-47ed-8c38-421cdf2ba0be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:14.449709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-092ef1b5-0e95-47ed-8c38-421cdf2ba0be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:14.450145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-092ef1b5-0e95-47ed-8c38-421cdf2ba0be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:14.451004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-092ef1b5-0e95-47ed-8c38-421cdf2ba0be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:14.451829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-092ef1b5-0e95-47ed-8c38-421cdf2ba0be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:14.451980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-092ef1b5-0e95-47ed-8c38-421cdf2ba0be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:14.580959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-092ef1b5-0e95-47ed-8c38-421cdf2ba0be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:14.589365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-092ef1b5-0e95-47ed-8c38-421cdf2ba0be tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153196 Aug 31 00:52:14.589919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1259/2576] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:14.983125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:14.983782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:14.990607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:14.991111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:14.991550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:14.992235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:14.992683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:14.993097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:15.058731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:15.067602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:15.069060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:15.070189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b56c662d-bc1d-4bb0-9a0d-4a05e5eae6ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091065 Aug 31 00:52:15.070774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1318/2577] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:15.459611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-234c24a1-8ca8-4c4a-bb73-557309e40126 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:15.460207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-234c24a1-8ca8-4c4a-bb73-557309e40126 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:15.466878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-234c24a1-8ca8-4c4a-bb73-557309e40126 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:15.467383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-234c24a1-8ca8-4c4a-bb73-557309e40126 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:15.467818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-234c24a1-8ca8-4c4a-bb73-557309e40126 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:15.468491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-234c24a1-8ca8-4c4a-bb73-557309e40126 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:15.468942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-234c24a1-8ca8-4c4a-bb73-557309e40126 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:15.469360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-234c24a1-8ca8-4c4a-bb73-557309e40126 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:15.601590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-234c24a1-8ca8-4c4a-bb73-557309e40126 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:15.610602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-234c24a1-8ca8-4c4a-bb73-557309e40126 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1362 microversion: 2.1 time: 0.154740 Aug 31 00:52:15.611140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-db8dbf89-a868-4b08-ab50-16deb18c8949 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:15.611732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1260/2578] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:15 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:15.611865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-db8dbf89-a868-4b08-ab50-16deb18c8949 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:15.618213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db8dbf89-a868-4b08-ab50-16deb18c8949 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:15.618684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db8dbf89-a868-4b08-ab50-16deb18c8949 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:15.619768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db8dbf89-a868-4b08-ab50-16deb18c8949 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:15.620453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db8dbf89-a868-4b08-ab50-16deb18c8949 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:15.620905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db8dbf89-a868-4b08-ab50-16deb18c8949 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:15.621325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db8dbf89-a868-4b08-ab50-16deb18c8949 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:15.754554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-db8dbf89-a868-4b08-ab50-16deb18c8949 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:15.764985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-db8dbf89-a868-4b08-ab50-16deb18c8949 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157793 Aug 31 00:52:15.765562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1319/2579] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:52:16.094867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:16.095522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:16.104423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:16.104904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:16.105345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:16.106035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:16.106491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:16.106915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:16.175890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:16.185350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:16.187002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:16.188220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2d55b353-1a20-4746-a703-efa40788e3a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.097223 Aug 31 00:52:16.188775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1261/2580] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:16.632820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-103c48ca-c3cb-494d-b598-9476592998a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:16.633417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-103c48ca-c3cb-494d-b598-9476592998a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:16.635813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=10 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:16.641342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-103c48ca-c3cb-494d-b598-9476592998a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:16.641812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-103c48ca-c3cb-494d-b598-9476592998a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:16.642240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-103c48ca-c3cb-494d-b598-9476592998a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:16.642914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-103c48ca-c3cb-494d-b598-9476592998a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:16.643384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-103c48ca-c3cb-494d-b598-9476592998a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:16.643799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-103c48ca-c3cb-494d-b598-9476592998a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:16.774742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-103c48ca-c3cb-494d-b598-9476592998a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:16.782598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-103c48ca-c3cb-494d-b598-9476592998a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1362 microversion: 2.1 time: 0.153514 Aug 31 00:52:16.783358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1320/2581] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:16 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:16.788330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-891a69b3-9afb-4132-a3ec-54c655f380ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:16.788945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-891a69b3-9afb-4132-a3ec-54c655f380ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:16.795910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891a69b3-9afb-4132-a3ec-54c655f380ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:16.796394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891a69b3-9afb-4132-a3ec-54c655f380ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:16.796832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891a69b3-9afb-4132-a3ec-54c655f380ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:16.797519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891a69b3-9afb-4132-a3ec-54c655f380ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:16.797972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891a69b3-9afb-4132-a3ec-54c655f380ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:16.798402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891a69b3-9afb-4132-a3ec-54c655f380ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:16.929404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-891a69b3-9afb-4132-a3ec-54c655f380ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:16.938224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-891a69b3-9afb-4132-a3ec-54c655f380ea tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153840 Aug 31 00:52:16.938796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1262/2582] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:52:17.209920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:17.210543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:17.216547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:17.217028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:17.217459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:17.218135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:17.218586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:17.219046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:17.287674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:17.296975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:17.298419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:17.299592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f048a04f-1717-4440-81eb-58834d1e608e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.093733 Aug 31 00:52:17.300167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1321/2583] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:17.804151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3f00de6f-ce2e-471e-b0d5-cdf68966f469 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:17.804756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3f00de6f-ce2e-471e-b0d5-cdf68966f469 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:17.806825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=8 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:17.812939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f00de6f-ce2e-471e-b0d5-cdf68966f469 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:17.813417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f00de6f-ce2e-471e-b0d5-cdf68966f469 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:17.813846 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f00de6f-ce2e-471e-b0d5-cdf68966f469 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:17.814530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f00de6f-ce2e-471e-b0d5-cdf68966f469 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:17.814978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f00de6f-ce2e-471e-b0d5-cdf68966f469 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:17.815422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f00de6f-ce2e-471e-b0d5-cdf68966f469 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:17.949587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3f00de6f-ce2e-471e-b0d5-cdf68966f469 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:17.957285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3f00de6f-ce2e-471e-b0d5-cdf68966f469 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1362 microversion: 2.1 time: 0.157057 Aug 31 00:52:17.957851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1263/2584] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:17 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:17.958927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9ab63456-8bdb-49a1-a066-8b1bf840349c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:17.959566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9ab63456-8bdb-49a1-a066-8b1bf840349c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:17.966578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab63456-8bdb-49a1-a066-8b1bf840349c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:17.967086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab63456-8bdb-49a1-a066-8b1bf840349c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:17.967526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab63456-8bdb-49a1-a066-8b1bf840349c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:17.968226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab63456-8bdb-49a1-a066-8b1bf840349c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:17.968677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab63456-8bdb-49a1-a066-8b1bf840349c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:17.969294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ab63456-8bdb-49a1-a066-8b1bf840349c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:18.099168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9ab63456-8bdb-49a1-a066-8b1bf840349c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:18.107785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9ab63456-8bdb-49a1-a066-8b1bf840349c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152610 Aug 31 00:52:18.108361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1322/2585] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:52:18.323533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:18.324048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:18.331837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:18.332318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:18.332749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:18.333439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:18.333885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:18.334303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:18.404735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:18.413577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:18.415028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:18.416546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-228c3ae9-59f4-4142-9005-8b4d053aa983 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.097435 Aug 31 00:52:18.416967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1264/2586] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:18.547173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-3bd5ff84-2ac4-4459-af62-21c556c5f8fe req-bafd04b0-08a9-49db-937a-257e949ba922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b03f73-ff98-42f0-afb1-547a36f8ed55", "name": "network-vif-plugged", "status": "completed", "tag": "024e5992-1376-4fb8-89fd-344e227c9100"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:52:18.557499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-3bd5ff84-2ac4-4459-af62-21c556c5f8fe req-bafd04b0-08a9-49db-937a-257e949ba922 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:18.558168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-3bd5ff84-2ac4-4459-af62-21c556c5f8fe req-bafd04b0-08a9-49db-937a-257e949ba922 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:18.558747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-3bd5ff84-2ac4-4459-af62-21c556c5f8fe req-bafd04b0-08a9-49db-937a-257e949ba922 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:18.571324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-3bd5ff84-2ac4-4459-af62-21c556c5f8fe req-bafd04b0-08a9-49db-937a-257e949ba922 service nova] Creating event network-vif-plugged:024e5992-1376-4fb8-89fd-344e227c9100 for instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 on hv-cinder-85506 Aug 31 00:52:18.576872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-3bd5ff84-2ac4-4459-af62-21c556c5f8fe req-bafd04b0-08a9-49db-937a-257e949ba922 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091927 Aug 31 00:52:18.577458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1323/2587] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:52:18.980787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-28194d37-543b-4ea0-8e91-41115d5122c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:18.981383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-28194d37-543b-4ea0-8e91-41115d5122c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:18.987829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28194d37-543b-4ea0-8e91-41115d5122c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:18.988307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28194d37-543b-4ea0-8e91-41115d5122c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:18.988761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28194d37-543b-4ea0-8e91-41115d5122c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:18.989437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28194d37-543b-4ea0-8e91-41115d5122c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:18.989876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28194d37-543b-4ea0-8e91-41115d5122c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:18.990289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28194d37-543b-4ea0-8e91-41115d5122c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:19.116841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-28194d37-543b-4ea0-8e91-41115d5122c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:19.124364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-28194d37-543b-4ea0-8e91-41115d5122c3 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1362 microversion: 2.1 time: 0.148246 Aug 31 00:52:19.124923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1265/2588] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:18 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:19.130607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf1c79fe-3edc-494f-9782-040f1b066411 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:19.131360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf1c79fe-3edc-494f-9782-040f1b066411 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:19.137620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c79fe-3edc-494f-9782-040f1b066411 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:19.138097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c79fe-3edc-494f-9782-040f1b066411 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:19.138530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c79fe-3edc-494f-9782-040f1b066411 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:19.139258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c79fe-3edc-494f-9782-040f1b066411 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:19.139708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c79fe-3edc-494f-9782-040f1b066411 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:19.140125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf1c79fe-3edc-494f-9782-040f1b066411 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:19.273054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bf1c79fe-3edc-494f-9782-040f1b066411 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:19.281265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf1c79fe-3edc-494f-9782-040f1b066411 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155463 Aug 31 00:52:19.281825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1324/2589] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:19.439560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:19.440029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:19.445894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:19.446372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:19.446951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:19.447641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:19.448088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:19.448504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:19.509850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:19.518579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:19.520021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:19.521143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8dd72200-f67a-4eed-ac92-09157ce045f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085579 Aug 31 00:52:19.521684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1266/2590] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:20.144826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eff2958f-5ddd-4125-96ce-b1ee5928d77b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:20.145413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eff2958f-5ddd-4125-96ce-b1ee5928d77b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:20.152407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eff2958f-5ddd-4125-96ce-b1ee5928d77b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:20.152894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eff2958f-5ddd-4125-96ce-b1ee5928d77b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:20.153332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eff2958f-5ddd-4125-96ce-b1ee5928d77b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:20.154025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eff2958f-5ddd-4125-96ce-b1ee5928d77b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:20.154481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eff2958f-5ddd-4125-96ce-b1ee5928d77b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:20.154905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eff2958f-5ddd-4125-96ce-b1ee5928d77b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:20.292861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eff2958f-5ddd-4125-96ce-b1ee5928d77b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:20.297208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:20.302396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eff2958f-5ddd-4125-96ce-b1ee5928d77b tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1362 microversion: 2.1 time: 0.161435 Aug 31 00:52:20.302965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1325/2591] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:20 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:20.303150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ca9a7ece-adbb-4184-b9ef-8793bc722dfa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:20.304003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ca9a7ece-adbb-4184-b9ef-8793bc722dfa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:20.311773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9a7ece-adbb-4184-b9ef-8793bc722dfa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:20.312247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9a7ece-adbb-4184-b9ef-8793bc722dfa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:20.312674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9a7ece-adbb-4184-b9ef-8793bc722dfa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:20.313358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9a7ece-adbb-4184-b9ef-8793bc722dfa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:20.313795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9a7ece-adbb-4184-b9ef-8793bc722dfa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:20.314211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca9a7ece-adbb-4184-b9ef-8793bc722dfa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:20.447148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca9a7ece-adbb-4184-b9ef-8793bc722dfa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:20.455692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ca9a7ece-adbb-4184-b9ef-8793bc722dfa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157626 Aug 31 00:52:20.456256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1267/2592] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:52:20.545179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:20.545705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:20.552385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:20.552901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:20.553337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:20.554022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:20.554475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:20.554894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:20.618857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:20.627691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:20.629122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:20.630245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-206b95ba-fad7-4b30-b962-9d389c47e700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090014 Aug 31 00:52:20.630802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1326/2593] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:21.324163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-68d7f4b3-e5a8-4a17-8a61-6a0e6eb691de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:21.324723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-68d7f4b3-e5a8-4a17-8a61-6a0e6eb691de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:21.331210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d7f4b3-e5a8-4a17-8a61-6a0e6eb691de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:21.331688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d7f4b3-e5a8-4a17-8a61-6a0e6eb691de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:21.332119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d7f4b3-e5a8-4a17-8a61-6a0e6eb691de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:21.332790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d7f4b3-e5a8-4a17-8a61-6a0e6eb691de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:21.333239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d7f4b3-e5a8-4a17-8a61-6a0e6eb691de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:21.333655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d7f4b3-e5a8-4a17-8a61-6a0e6eb691de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:21.468318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-68d7f4b3-e5a8-4a17-8a61-6a0e6eb691de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:21.476411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-68d7f4b3-e5a8-4a17-8a61-6a0e6eb691de tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1549 microversion: 2.1 time: 0.156121 Aug 31 00:52:21.476994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1268/2594] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:21 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:21.479102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a66e69a5-f67d-4ddb-a671-c58b95cb2b76 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:21.479719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a66e69a5-f67d-4ddb-a671-c58b95cb2b76 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:21.488883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a66e69a5-f67d-4ddb-a671-c58b95cb2b76 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:21.489626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a66e69a5-f67d-4ddb-a671-c58b95cb2b76 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:21.490055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a66e69a5-f67d-4ddb-a671-c58b95cb2b76 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:21.490740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a66e69a5-f67d-4ddb-a671-c58b95cb2b76 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:21.491229 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a66e69a5-f67d-4ddb-a671-c58b95cb2b76 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:21.491645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a66e69a5-f67d-4ddb-a671-c58b95cb2b76 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:21.499783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cab7306a-20d6-4560-a5b3-c8b5d47ed202 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:21.500287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cab7306a-20d6-4560-a5b3-c8b5d47ed202 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:21.506318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab7306a-20d6-4560-a5b3-c8b5d47ed202 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:21.506803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab7306a-20d6-4560-a5b3-c8b5d47ed202 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:21.507277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab7306a-20d6-4560-a5b3-c8b5d47ed202 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:21.507966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab7306a-20d6-4560-a5b3-c8b5d47ed202 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:21.508418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab7306a-20d6-4560-a5b3-c8b5d47ed202 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:21.508840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cab7306a-20d6-4560-a5b3-c8b5d47ed202 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:21.621661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cab7306a-20d6-4560-a5b3-c8b5d47ed202 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126924 Aug 31 00:52:21.622286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1269/2595] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 31 00:52:21 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:52:21.653466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:21.654080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:21.660118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:21.660607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:21.661039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:21.661726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:21.662004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a66e69a5-f67d-4ddb-a671-c58b95cb2b76 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:21.662170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:21.662885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:21.671217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a66e69a5-f67d-4ddb-a671-c58b95cb2b76 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.197441 Aug 31 00:52:21.675075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1327/2596] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:21 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:52:21.729390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:21.738272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:21.739773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:21.740966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-73a67e14-369d-4632-a606-98cff327d9a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092245 Aug 31 00:52:21.741526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1270/2597] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:22.692842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-812f1382-af89-46d2-aff2-a0ae1d98908c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:22.693388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-812f1382-af89-46d2-aff2-a0ae1d98908c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:22.700071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-812f1382-af89-46d2-aff2-a0ae1d98908c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:22.700537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-812f1382-af89-46d2-aff2-a0ae1d98908c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:22.700962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-812f1382-af89-46d2-aff2-a0ae1d98908c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:22.701639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-812f1382-af89-46d2-aff2-a0ae1d98908c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:22.702085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-812f1382-af89-46d2-aff2-a0ae1d98908c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:22.702500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-812f1382-af89-46d2-aff2-a0ae1d98908c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:22.765603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:22.766216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:22.780417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:22.783679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:22.784206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:22.785028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:22.785638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:22.786135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:22.858016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:22.867015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:22.869435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:22.870807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b2faf269-e62c-4336-bdea-507f72991787 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.109844 Aug 31 00:52:22.871532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1271/2598] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:22.890499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-812f1382-af89-46d2-aff2-a0ae1d98908c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:22.900085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-812f1382-af89-46d2-aff2-a0ae1d98908c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.210974 Aug 31 00:52:22.900684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1328/2599] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:22 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:22.937875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-89d19b1b-f66b-4732-a093-1603de38afe5 req-8a94f89d-af95-4c2a-9077-382f5a8213d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b03f73-ff98-42f0-afb1-547a36f8ed55", "tag": "024e5992-1376-4fb8-89fd-344e227c9100"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:52:22.948823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-89d19b1b-f66b-4732-a093-1603de38afe5 req-8a94f89d-af95-4c2a-9077-382f5a8213d4 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:22.949301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-89d19b1b-f66b-4732-a093-1603de38afe5 req-8a94f89d-af95-4c2a-9077-382f5a8213d4 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:22.949797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-89d19b1b-f66b-4732-a093-1603de38afe5 req-8a94f89d-af95-4c2a-9077-382f5a8213d4 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:22.960928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-89d19b1b-f66b-4732-a093-1603de38afe5 req-8a94f89d-af95-4c2a-9077-382f5a8213d4 service nova] Creating event network-changed:024e5992-1376-4fb8-89fd-344e227c9100 for instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 on hv-cinder-85506 Aug 31 00:52:22.964832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR oslo.messaging._drivers.impl_rabbit [req-89d19b1b-f66b-4732-a093-1603de38afe5 req-8a94f89d-af95-4c2a-9077-382f5a8213d4 service nova] [b4ee8f2c-9eee-4554-808d-2989f39a701b] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 00:52:23.894346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:23.894958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:23.902016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:23.902500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:23.902932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:23.903650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:23.904101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:23.904521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:23.970848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:23.978655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [req-89d19b1b-f66b-4732-a093-1603de38afe5 req-8a94f89d-af95-4c2a-9077-382f5a8213d4 service nova] [b4ee8f2c-9eee-4554-808d-2989f39a701b] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 39664. Aug 31 00:52:23.983147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:23.983885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-89d19b1b-f66b-4732-a093-1603de38afe5 req-8a94f89d-af95-4c2a-9077-382f5a8213d4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.110563 Aug 31 00:52:23.984614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1272/2600] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:52:23.985372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:23.987578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ea22d3f8-8954-440d-ae3c-dc78a72925de tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.097436 Aug 31 00:52:23.988469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1329/2601] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:23.990947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b0a795e6-e5c5-4acb-901a-bcc13fd42f18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:23.991739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b0a795e6-e5c5-4acb-901a-bcc13fd42f18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:23.998869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a795e6-e5c5-4acb-901a-bcc13fd42f18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:23.999392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a795e6-e5c5-4acb-901a-bcc13fd42f18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:23.999836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a795e6-e5c5-4acb-901a-bcc13fd42f18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:24.000528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a795e6-e5c5-4acb-901a-bcc13fd42f18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:24.000981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a795e6-e5c5-4acb-901a-bcc13fd42f18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:24.001405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0a795e6-e5c5-4acb-901a-bcc13fd42f18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:24.218956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b0a795e6-e5c5-4acb-901a-bcc13fd42f18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:24.227582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b0a795e6-e5c5-4acb-901a-bcc13fd42f18 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.241159 Aug 31 00:52:24.228220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1273/2602] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:25.010135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:25.010741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:25.017343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:25.017821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:25.018255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:25.018933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:25.019408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:25.019829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:25.082770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:25.092411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:25.093852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:25.094989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2ec3fc7d-5812-44ad-8787-abcd24e57729 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088791 Aug 31 00:52:25.095572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1330/2603] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:25.249540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-63189628-15c4-4cf8-a688-6843a244b847 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:25.250074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-63189628-15c4-4cf8-a688-6843a244b847 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:25.256501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63189628-15c4-4cf8-a688-6843a244b847 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:25.256980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63189628-15c4-4cf8-a688-6843a244b847 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:25.257417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63189628-15c4-4cf8-a688-6843a244b847 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:25.258100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63189628-15c4-4cf8-a688-6843a244b847 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:25.258552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63189628-15c4-4cf8-a688-6843a244b847 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:25.259054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63189628-15c4-4cf8-a688-6843a244b847 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:25.387408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-63189628-15c4-4cf8-a688-6843a244b847 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:25.395668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-63189628-15c4-4cf8-a688-6843a244b847 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150057 Aug 31 00:52:25.396232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1274/2604] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:26.118647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:26.119269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:26.126126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:26.126604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:26.127031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:26.127731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:26.128184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:26.128601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:26.191319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:26.201302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:26.202734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:26.203905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c8d2336d-3ebe-4ed0-bd3c-1a90ca2b3c2c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089124 Aug 31 00:52:26.204457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1331/2605] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:26.417350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-143f8987-817a-44d4-b81e-82aa45a99b2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:26.418002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-143f8987-817a-44d4-b81e-82aa45a99b2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:26.425543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-143f8987-817a-44d4-b81e-82aa45a99b2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:26.426028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-143f8987-817a-44d4-b81e-82aa45a99b2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:26.426465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-143f8987-817a-44d4-b81e-82aa45a99b2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:26.427212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-143f8987-817a-44d4-b81e-82aa45a99b2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:26.427664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-143f8987-817a-44d4-b81e-82aa45a99b2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:26.428081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-143f8987-817a-44d4-b81e-82aa45a99b2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:26.444005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:26.577258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-143f8987-817a-44d4-b81e-82aa45a99b2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:26.588406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-143f8987-817a-44d4-b81e-82aa45a99b2c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.174492 Aug 31 00:52:26.589339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1275/2606] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:26 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:52:27.228415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:27.229126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:27.235690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:27.236165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:27.236594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:27.237268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:27.237712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:27.238131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:27.300192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:27.308881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:27.310356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:27.311511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3014f821-c7bd-4230-88d9-9f3bb81c1e55 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088020 Aug 31 00:52:27.312060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1332/2607] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:27.610330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-16b40a85-9889-45b5-8d36-040b8dbcc58d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:27.610933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-16b40a85-9889-45b5-8d36-040b8dbcc58d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:27.617440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16b40a85-9889-45b5-8d36-040b8dbcc58d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:27.617920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16b40a85-9889-45b5-8d36-040b8dbcc58d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:27.618396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16b40a85-9889-45b5-8d36-040b8dbcc58d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:27.619096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16b40a85-9889-45b5-8d36-040b8dbcc58d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:27.619545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16b40a85-9889-45b5-8d36-040b8dbcc58d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:27.619963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-16b40a85-9889-45b5-8d36-040b8dbcc58d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:27.751822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-16b40a85-9889-45b5-8d36-040b8dbcc58d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:27.760651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-16b40a85-9889-45b5-8d36-040b8dbcc58d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154212 Aug 31 00:52:27.761209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1276/2608] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:27 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:28.333868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:28.334475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:28.341655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:28.342266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:28.342646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:28.343368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:28.343824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:28.344237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:28.406988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:28.416439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:28.417528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:28.418647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-380edc56-c088-4f35-afd2-3be49bae8ef7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088701 Aug 31 00:52:28.419223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1333/2609] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:28.781579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d479bfd5-59e1-489f-8552-4f539a7a59c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:28.782244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d479bfd5-59e1-489f-8552-4f539a7a59c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:28.788733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d479bfd5-59e1-489f-8552-4f539a7a59c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:28.789200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d479bfd5-59e1-489f-8552-4f539a7a59c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:28.789628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d479bfd5-59e1-489f-8552-4f539a7a59c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:28.791166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d479bfd5-59e1-489f-8552-4f539a7a59c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:28.791644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d479bfd5-59e1-489f-8552-4f539a7a59c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:28.792058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d479bfd5-59e1-489f-8552-4f539a7a59c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:28.919895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d479bfd5-59e1-489f-8552-4f539a7a59c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:28.928758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d479bfd5-59e1-489f-8552-4f539a7a59c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151006 Aug 31 00:52:28.929322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1277/2610] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:29.441679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:29.442227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:29.449005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:29.449489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:29.449958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:29.450654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:29.451118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:29.451543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:29.513147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:29.521588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:29.523014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:29.524161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1c783f80-e0f1-477c-bea5-64873db3473e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086474 Aug 31 00:52:29.525355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1334/2611] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:29.950633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-af3c6936-5811-4318-8508-09ad36e0e975 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:29.951249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-af3c6936-5811-4318-8508-09ad36e0e975 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:29.957733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af3c6936-5811-4318-8508-09ad36e0e975 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:29.958211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af3c6936-5811-4318-8508-09ad36e0e975 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:29.958642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af3c6936-5811-4318-8508-09ad36e0e975 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:29.959343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af3c6936-5811-4318-8508-09ad36e0e975 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:29.959793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af3c6936-5811-4318-8508-09ad36e0e975 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:29.960212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af3c6936-5811-4318-8508-09ad36e0e975 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:30.098782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-af3c6936-5811-4318-8508-09ad36e0e975 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:30.107806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-af3c6936-5811-4318-8508-09ad36e0e975 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.161799 Aug 31 00:52:30.108368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1278/2612] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:30.547499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:30.548169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:30.554651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:30.555147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:30.556141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:30.556850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:30.557316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:30.557731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:30.621194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:30.629701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:30.631152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:30.632272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8b3f989f-6707-4108-a721-fde2f2f1021e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088778 Aug 31 00:52:30.632822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1335/2613] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:31.128879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-92354e6a-73e9-4d0f-ac5f-8ec253676bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:31.129484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-92354e6a-73e9-4d0f-ac5f-8ec253676bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:31.137770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92354e6a-73e9-4d0f-ac5f-8ec253676bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:31.138246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92354e6a-73e9-4d0f-ac5f-8ec253676bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:31.138673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92354e6a-73e9-4d0f-ac5f-8ec253676bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:31.139374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92354e6a-73e9-4d0f-ac5f-8ec253676bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:31.139850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92354e6a-73e9-4d0f-ac5f-8ec253676bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:31.140265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92354e6a-73e9-4d0f-ac5f-8ec253676bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:31.286728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-92354e6a-73e9-4d0f-ac5f-8ec253676bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:31.295565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-92354e6a-73e9-4d0f-ac5f-8ec253676bf1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.170575 Aug 31 00:52:31.296137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1279/2614] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:31.654627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:31.655267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:31.661645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:31.662116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:31.662542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:31.663250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:31.663693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:31.664107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:31.724237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:31.733222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:31.734757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:31.735954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bd863ae4-5aaf-400f-82ad-7b4987378661 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085308 Aug 31 00:52:31.736512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1336/2615] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:32.316818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5dbdfe94-b4db-4c37-aece-3b6302fc516a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:32.317362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5dbdfe94-b4db-4c37-aece-3b6302fc516a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:32.323902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbdfe94-b4db-4c37-aece-3b6302fc516a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:32.324394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbdfe94-b4db-4c37-aece-3b6302fc516a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:32.324878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbdfe94-b4db-4c37-aece-3b6302fc516a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:32.325651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbdfe94-b4db-4c37-aece-3b6302fc516a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:32.326098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbdfe94-b4db-4c37-aece-3b6302fc516a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:32.326521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dbdfe94-b4db-4c37-aece-3b6302fc516a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:32.454012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5dbdfe94-b4db-4c37-aece-3b6302fc516a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:32.462778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5dbdfe94-b4db-4c37-aece-3b6302fc516a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149255 Aug 31 00:52:32.463362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1280/2616] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:32.759092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:32.759741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:32.766292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:32.766808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:32.767271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:32.767963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:32.768419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:32.768840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:32.833226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:32.844648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:32.846827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:32.847993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-afd9eefb-77f7-49ed-83f0-a5b97f2d7907 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092952 Aug 31 00:52:32.850898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1337/2617] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:33.484913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f026d53b-0346-47cf-b198-665abfd5cefd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:33.485566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f026d53b-0346-47cf-b198-665abfd5cefd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:33.491977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f026d53b-0346-47cf-b198-665abfd5cefd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:33.492457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f026d53b-0346-47cf-b198-665abfd5cefd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:33.492893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f026d53b-0346-47cf-b198-665abfd5cefd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:33.493656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f026d53b-0346-47cf-b198-665abfd5cefd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:33.494103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f026d53b-0346-47cf-b198-665abfd5cefd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:33.494534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f026d53b-0346-47cf-b198-665abfd5cefd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:33.625150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f026d53b-0346-47cf-b198-665abfd5cefd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:33.633529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f026d53b-0346-47cf-b198-665abfd5cefd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152478 Aug 31 00:52:33.634830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1281/2618] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:33 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:33.873451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:33.874044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:33.880476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:33.880946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:33.881371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:33.882039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:33.882481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:33.882892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:33.946079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:33.955375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:33.956792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:33.957905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2dac9246-50ba-4a2d-abf6-ab254ecd8a25 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088400 Aug 31 00:52:33.958449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1338/2619] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:33 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:34.655363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c9bcfe5-540c-42b3-9924-77d235416f46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:34.655969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c9bcfe5-540c-42b3-9924-77d235416f46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:34.662747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9bcfe5-540c-42b3-9924-77d235416f46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:34.663257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9bcfe5-540c-42b3-9924-77d235416f46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:34.663695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9bcfe5-540c-42b3-9924-77d235416f46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:34.664367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9bcfe5-540c-42b3-9924-77d235416f46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:34.665405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9bcfe5-540c-42b3-9924-77d235416f46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:34.665733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c9bcfe5-540c-42b3-9924-77d235416f46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:34.795475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0c9bcfe5-540c-42b3-9924-77d235416f46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:34.803620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c9bcfe5-540c-42b3-9924-77d235416f46 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152079 Aug 31 00:52:34.804185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1282/2620] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:34 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:34.982275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:34.982798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:34.989243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:34.989721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:34.990151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:34.990824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:34.991307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:34.991720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:35.053434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:35.063153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:35.064938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:35.065716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-53ae8c2d-e42a-4501-b84f-d79fb8539035 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088069 Aug 31 00:52:35.066278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1339/2621] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:35.826491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4590d812-27ff-40df-bfd1-28d9e62efa60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:35.827121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4590d812-27ff-40df-bfd1-28d9e62efa60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:35.833808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4590d812-27ff-40df-bfd1-28d9e62efa60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:35.834274 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4590d812-27ff-40df-bfd1-28d9e62efa60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:35.834705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4590d812-27ff-40df-bfd1-28d9e62efa60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:35.835409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4590d812-27ff-40df-bfd1-28d9e62efa60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:35.835859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4590d812-27ff-40df-bfd1-28d9e62efa60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:35.836279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4590d812-27ff-40df-bfd1-28d9e62efa60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:35.964843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4590d812-27ff-40df-bfd1-28d9e62efa60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:35.973420 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4590d812-27ff-40df-bfd1-28d9e62efa60 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150874 Aug 31 00:52:35.973995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1283/2622] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:36.089111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:36.089763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:36.096392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:36.096865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:36.097291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:36.097963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:36.098402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:36.098817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:36.160127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:36.168701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:36.170052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:36.171218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bca29899-6eb3-4d75-9027-8f315b5e8115 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086280 Aug 31 00:52:36.171778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1340/2623] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:36.995783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-504bdeb6-e483-4ccc-b9f1-a9fd9c37bf56 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:36.996400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-504bdeb6-e483-4ccc-b9f1-a9fd9c37bf56 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:37.002941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-504bdeb6-e483-4ccc-b9f1-a9fd9c37bf56 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:37.003444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-504bdeb6-e483-4ccc-b9f1-a9fd9c37bf56 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:37.003882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-504bdeb6-e483-4ccc-b9f1-a9fd9c37bf56 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:37.004561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-504bdeb6-e483-4ccc-b9f1-a9fd9c37bf56 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:37.005006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-504bdeb6-e483-4ccc-b9f1-a9fd9c37bf56 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:37.005422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-504bdeb6-e483-4ccc-b9f1-a9fd9c37bf56 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:37.138136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-504bdeb6-e483-4ccc-b9f1-a9fd9c37bf56 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:37.146628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-504bdeb6-e483-4ccc-b9f1-a9fd9c37bf56 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155659 Aug 31 00:52:37.147210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1284/2624] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:37.193761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:37.194365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:37.201047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:37.201528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:37.201961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:37.202636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:37.203106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:37.203529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:37.265024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:37.273721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:37.275290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:37.276428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-91eae645-0164-4dab-890a-ab015719cf1c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086615 Aug 31 00:52:37.276977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1341/2625] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:38.169224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3e5eecd5-cdf4-4425-b977-da0a86573463 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:38.170834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3e5eecd5-cdf4-4425-b977-da0a86573463 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:38.178479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5eecd5-cdf4-4425-b977-da0a86573463 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:38.178999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5eecd5-cdf4-4425-b977-da0a86573463 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:38.179471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5eecd5-cdf4-4425-b977-da0a86573463 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:38.180154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5eecd5-cdf4-4425-b977-da0a86573463 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:38.181304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5eecd5-cdf4-4425-b977-da0a86573463 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:38.181739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e5eecd5-cdf4-4425-b977-da0a86573463 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:38.301386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:38.302006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:38.308949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:38.309434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:38.309865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:38.310551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:38.310999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:38.311445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:38.317549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e5eecd5-cdf4-4425-b977-da0a86573463 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:38.326562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3e5eecd5-cdf4-4425-b977-da0a86573463 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.162372 Aug 31 00:52:38.327175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1285/2626] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:38.327823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:38.377904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:38.387252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:38.388696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:38.389824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3bb44f15-bf6b-4a56-a450-f82ebe60b33b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092952 Aug 31 00:52:38.390382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1342/2627] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:39.348363 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-aa5fd4f6-3067-479d-9e5b-7adc764bf7b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:39.348971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-aa5fd4f6-3067-479d-9e5b-7adc764bf7b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:39.351221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=70 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:39.357341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4f6-3067-479d-9e5b-7adc764bf7b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:39.357968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4f6-3067-479d-9e5b-7adc764bf7b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:39.358504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4f6-3067-479d-9e5b-7adc764bf7b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:39.359325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4f6-3067-479d-9e5b-7adc764bf7b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:39.360022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4f6-3067-479d-9e5b-7adc764bf7b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:39.360599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4f6-3067-479d-9e5b-7adc764bf7b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:39.412452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:39.413059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:39.419610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:39.420091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:39.420532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:39.421250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:39.421706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:39.422122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:39.498934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:39.507534 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:39.509564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:39.510678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cdfecfe9-e21c-4aec-8fe9-9bb1f6a10712 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.102218 Aug 31 00:52:39.511468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1343/2628] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:39.515737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-aa5fd4f6-3067-479d-9e5b-7adc764bf7b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:39.524660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-aa5fd4f6-3067-479d-9e5b-7adc764bf7b3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.179828 Aug 31 00:52:39.525223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1286/2629] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:39 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:40.533443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:40.534080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:40.541517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:40.542008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:40.542442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:40.543166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:40.543621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:40.544051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:40.546562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3b676d92-f843-4846-93f0-ef960a21a9e9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:40.547219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3b676d92-f843-4846-93f0-ef960a21a9e9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:40.553481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b676d92-f843-4846-93f0-ef960a21a9e9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:40.553961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b676d92-f843-4846-93f0-ef960a21a9e9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:40.554395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b676d92-f843-4846-93f0-ef960a21a9e9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:40.555102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b676d92-f843-4846-93f0-ef960a21a9e9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:40.555670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b676d92-f843-4846-93f0-ef960a21a9e9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:40.556555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b676d92-f843-4846-93f0-ef960a21a9e9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:40.862219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:40.871775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:40.873208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:40.874340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-33cea18b-637b-4e39-9825-12f79d770465 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.344803 Aug 31 00:52:40.874896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1344/2630] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:40.949347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3b676d92-f843-4846-93f0-ef960a21a9e9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:40.957527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3b676d92-f843-4846-93f0-ef960a21a9e9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.414796 Aug 31 00:52:40.958094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1287/2631] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:41.897391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:41.897948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:41.905437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:41.905912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:41.906340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:41.907019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:41.907489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:41.907903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:41.969511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:41.978027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-12a04b58-b727-4f53-86d4-eebcff27184b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:41.978653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-12a04b58-b727-4f53-86d4-eebcff27184b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:41.978782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:41.980150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:41.981269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1a1ea42c-b1c3-427a-9c35-4b1272dc615b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087907 Aug 31 00:52:41.981823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1345/2632] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:41.985350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12a04b58-b727-4f53-86d4-eebcff27184b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:41.985985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12a04b58-b727-4f53-86d4-eebcff27184b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:41.986426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12a04b58-b727-4f53-86d4-eebcff27184b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:41.987149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12a04b58-b727-4f53-86d4-eebcff27184b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:41.987626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12a04b58-b727-4f53-86d4-eebcff27184b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:41.988053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12a04b58-b727-4f53-86d4-eebcff27184b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:42.040119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:52:42.040645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:52:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 (ip 10.222.0.67) !!! Aug 31 00:52:42.129427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-12a04b58-b727-4f53-86d4-eebcff27184b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:42.138469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-12a04b58-b727-4f53-86d4-eebcff27184b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.164663 Aug 31 00:52:42.139029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1288/2633] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:41 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:43.005186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:43.005792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:43.013182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:43.013659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:43.014089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:43.014768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:43.015245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:43.015668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:43.075792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:43.084259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:43.085695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:43.087490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e2aa977a-a973-4473-b063-6b831c2828e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086324 Aug 31 00:52:43.088038 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1346/2634] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:43.159672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0dc39c77-03bd-47f7-915b-73e50566698d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:43.160268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0dc39c77-03bd-47f7-915b-73e50566698d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:43.166606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dc39c77-03bd-47f7-915b-73e50566698d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:43.167105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dc39c77-03bd-47f7-915b-73e50566698d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:43.167534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dc39c77-03bd-47f7-915b-73e50566698d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:43.168205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dc39c77-03bd-47f7-915b-73e50566698d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:43.168645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dc39c77-03bd-47f7-915b-73e50566698d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:43.169055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dc39c77-03bd-47f7-915b-73e50566698d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:43.296507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0dc39c77-03bd-47f7-915b-73e50566698d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:43.304630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0dc39c77-03bd-47f7-915b-73e50566698d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148734 Aug 31 00:52:43.305825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1289/2635] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:44.110544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:44.111169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:44.113523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=62 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:44.118815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:44.119324 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:44.119756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:44.120440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:44.120888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:44.121304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:44.185613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:44.194235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:44.197970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:44.197970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b496907e-ed86-4ce8-b8d8-db5df50596f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090921 Aug 31 00:52:44.198267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1347/2636] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:44.327172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f1a63268-8211-488c-a56b-8f2d0c18ad00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:44.327782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f1a63268-8211-488c-a56b-8f2d0c18ad00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:44.334212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1a63268-8211-488c-a56b-8f2d0c18ad00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:44.334692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1a63268-8211-488c-a56b-8f2d0c18ad00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:44.335150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1a63268-8211-488c-a56b-8f2d0c18ad00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:44.335825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1a63268-8211-488c-a56b-8f2d0c18ad00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:44.336307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1a63268-8211-488c-a56b-8f2d0c18ad00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:44.336831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1a63268-8211-488c-a56b-8f2d0c18ad00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:44.464263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f1a63268-8211-488c-a56b-8f2d0c18ad00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:44.472309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f1a63268-8211-488c-a56b-8f2d0c18ad00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149039 Aug 31 00:52:44.472868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1290/2637] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:45.220050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:45.220662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:45.227564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:45.228099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:45.228530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:45.229261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:45.229705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:45.230118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:45.291487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:45.301498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:45.302922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:45.304067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cf89ecfa-2466-4cc9-85e1-251d6dfe026d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088010 Aug 31 00:52:45.304614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1348/2638] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:45.494920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-94279e86-9437-4c7f-982c-0b3acc79e4ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:45.495551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-94279e86-9437-4c7f-982c-0b3acc79e4ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:45.501958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94279e86-9437-4c7f-982c-0b3acc79e4ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:45.502467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94279e86-9437-4c7f-982c-0b3acc79e4ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:45.502874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94279e86-9437-4c7f-982c-0b3acc79e4ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:45.503588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94279e86-9437-4c7f-982c-0b3acc79e4ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:45.504040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94279e86-9437-4c7f-982c-0b3acc79e4ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:45.504462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-94279e86-9437-4c7f-982c-0b3acc79e4ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:45.637001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-94279e86-9437-4c7f-982c-0b3acc79e4ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:45.645176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-94279e86-9437-4c7f-982c-0b3acc79e4ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155068 Aug 31 00:52:45.645742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1291/2639] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:46.327443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:46.328041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:46.334574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:46.335064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:46.335497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:46.336187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:46.336643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:46.337060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:46.398042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:46.407219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:46.408644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:46.409755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-79904e1d-cede-4446-8dd8-5939d3983df4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086357 Aug 31 00:52:46.410303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1349/2640] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:46.667838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-61f22445-c968-457e-95a1-e97a6a9e1b00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:46.668396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-61f22445-c968-457e-95a1-e97a6a9e1b00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:46.675014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61f22445-c968-457e-95a1-e97a6a9e1b00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:46.675580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61f22445-c968-457e-95a1-e97a6a9e1b00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:46.676008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61f22445-c968-457e-95a1-e97a6a9e1b00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:46.676741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61f22445-c968-457e-95a1-e97a6a9e1b00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:46.677185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61f22445-c968-457e-95a1-e97a6a9e1b00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:46.677599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-61f22445-c968-457e-95a1-e97a6a9e1b00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:46.680191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:46.809126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-61f22445-c968-457e-95a1-e97a6a9e1b00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:46.817337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-61f22445-c968-457e-95a1-e97a6a9e1b00 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154297 Aug 31 00:52:46.817901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1292/2641] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:46 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:47.432777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:47.433369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:47.439917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:47.440395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:47.440832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:47.441517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:47.441969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:47.442390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:47.508619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:47.517348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:47.518787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:47.519950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fee70138-2ef1-45b9-8abf-296809e5835c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091324 Aug 31 00:52:47.520509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1350/2642] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:47.839292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2ab5abf8-025c-493c-a5f9-7b4ed18568b5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:47.839926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2ab5abf8-025c-493c-a5f9-7b4ed18568b5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:47.846469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ab5abf8-025c-493c-a5f9-7b4ed18568b5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:47.846947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ab5abf8-025c-493c-a5f9-7b4ed18568b5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:47.847412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ab5abf8-025c-493c-a5f9-7b4ed18568b5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:47.848091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ab5abf8-025c-493c-a5f9-7b4ed18568b5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:47.848539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ab5abf8-025c-493c-a5f9-7b4ed18568b5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:47.848960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ab5abf8-025c-493c-a5f9-7b4ed18568b5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:47.973827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2ab5abf8-025c-493c-a5f9-7b4ed18568b5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:47.982517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2ab5abf8-025c-493c-a5f9-7b4ed18568b5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.147785 Aug 31 00:52:47.983099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1293/2643] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:47 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:48.543723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:48.544336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:48.550765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:48.551291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:48.551724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:48.552402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:48.552850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:48.553268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:48.616930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:48.626281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:48.628238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:48.629424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8b98ddae-afec-4689-b28b-374438376215 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090371 Aug 31 00:52:48.629996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1351/2644] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:49.004839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4158ed06-c9fb-4a29-b1bd-4ec15d62537a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:49.005451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4158ed06-c9fb-4a29-b1bd-4ec15d62537a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:49.012606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4158ed06-c9fb-4a29-b1bd-4ec15d62537a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:49.013089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4158ed06-c9fb-4a29-b1bd-4ec15d62537a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:49.013519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4158ed06-c9fb-4a29-b1bd-4ec15d62537a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:49.014199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4158ed06-c9fb-4a29-b1bd-4ec15d62537a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:49.014646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4158ed06-c9fb-4a29-b1bd-4ec15d62537a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:49.015096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4158ed06-c9fb-4a29-b1bd-4ec15d62537a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:49.144276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4158ed06-c9fb-4a29-b1bd-4ec15d62537a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:49.153405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4158ed06-c9fb-4a29-b1bd-4ec15d62537a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152453 Aug 31 00:52:49.154052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1294/2645] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:49.653005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:49.653597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:49.659983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:49.660460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:49.660886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:49.661562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:49.662005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:49.662420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:49.724422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:49.733389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:49.734823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:49.735969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-35f3897d-31dd-4d62-b8ee-d4ca0df66d52 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087126 Aug 31 00:52:49.736518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1352/2646] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:50.174595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8cde0c9f-2f0d-487d-88f3-486afa5a4d19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:50.175231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8cde0c9f-2f0d-487d-88f3-486afa5a4d19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:50.181813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cde0c9f-2f0d-487d-88f3-486afa5a4d19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:50.182287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cde0c9f-2f0d-487d-88f3-486afa5a4d19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:50.182716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cde0c9f-2f0d-487d-88f3-486afa5a4d19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:50.183432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cde0c9f-2f0d-487d-88f3-486afa5a4d19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:50.183881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cde0c9f-2f0d-487d-88f3-486afa5a4d19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:50.184301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8cde0c9f-2f0d-487d-88f3-486afa5a4d19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:50.314008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8cde0c9f-2f0d-487d-88f3-486afa5a4d19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:50.322538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8cde0c9f-2f0d-487d-88f3-486afa5a4d19 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151767 Aug 31 00:52:50.323120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1295/2647] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:50.759704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:50.760297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:50.766450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:50.766926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:50.767389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:50.768071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:50.768522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:50.768945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:50.836017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:50.845289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:50.846733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:50.847892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6281e604-0e3c-4cb7-8efb-21213b6bcb44 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092714 Aug 31 00:52:50.848456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1353/2648] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:51.343657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b3145427-72da-486f-a461-72d8b02eb7b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:51.344263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b3145427-72da-486f-a461-72d8b02eb7b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:51.350923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3145427-72da-486f-a461-72d8b02eb7b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:51.351430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3145427-72da-486f-a461-72d8b02eb7b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:51.352726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3145427-72da-486f-a461-72d8b02eb7b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:51.353213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3145427-72da-486f-a461-72d8b02eb7b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:51.353663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3145427-72da-486f-a461-72d8b02eb7b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:51.354085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3145427-72da-486f-a461-72d8b02eb7b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:51.480843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b3145427-72da-486f-a461-72d8b02eb7b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:51.489401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b3145427-72da-486f-a461-72d8b02eb7b0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149573 Aug 31 00:52:51.489958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1296/2649] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:51.871588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:51.872122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:51.878504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:51.878983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:51.879448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:51.880132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:51.880578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:51.880997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:51.942388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:51.951227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:51.952666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:51.953795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b6930413-4c2a-480a-9fb8-9cf613aeaae4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086689 Aug 31 00:52:51.954346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1354/2650] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:52.512178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b2d0b5f7-811c-4977-809a-f80e34e79026 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:52.512773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b2d0b5f7-811c-4977-809a-f80e34e79026 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:52.519163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2d0b5f7-811c-4977-809a-f80e34e79026 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:52.519682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2d0b5f7-811c-4977-809a-f80e34e79026 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:52.520113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2d0b5f7-811c-4977-809a-f80e34e79026 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:52.520923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2d0b5f7-811c-4977-809a-f80e34e79026 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:52.521366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2d0b5f7-811c-4977-809a-f80e34e79026 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:52.521782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2d0b5f7-811c-4977-809a-f80e34e79026 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:52.656575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2d0b5f7-811c-4977-809a-f80e34e79026 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:52.664928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b2d0b5f7-811c-4977-809a-f80e34e79026 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157497 Aug 31 00:52:52.665485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1297/2651] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:52.977256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:52.977983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:52.984481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:52.984963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:52.985426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:52.986111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:52.986566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:52.986987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:53.049445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:53.058952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:53.060466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:53.061598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1bd5224d-18bc-468c-8d6b-e824d8ba2766 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089212 Aug 31 00:52:53.062152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1355/2652] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:53.685798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-01e81054-69c6-4366-9770-dec4f8578393 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:53.686401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-01e81054-69c6-4366-9770-dec4f8578393 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:53.692788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01e81054-69c6-4366-9770-dec4f8578393 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:53.693267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01e81054-69c6-4366-9770-dec4f8578393 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:53.693697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01e81054-69c6-4366-9770-dec4f8578393 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:53.694377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01e81054-69c6-4366-9770-dec4f8578393 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:53.694823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01e81054-69c6-4366-9770-dec4f8578393 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:53.695830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01e81054-69c6-4366-9770-dec4f8578393 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:53.824885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01e81054-69c6-4366-9770-dec4f8578393 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:53.833023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-01e81054-69c6-4366-9770-dec4f8578393 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151045 Aug 31 00:52:53.833593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1298/2653] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:53 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:54.084037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:54.084634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:54.091775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:54.092260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:54.092726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:54.093434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:54.093890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:54.094312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:54.164022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:54.172733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:54.174155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:54.175293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-45765f46-7eb5-4985-a97b-5fc633795c51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.095174 Aug 31 00:52:54.175892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1356/2654] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:54.856195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9277046d-489c-482d-aac6-ab4896d9a3d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:54.856803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9277046d-489c-482d-aac6-ab4896d9a3d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:54.863138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9277046d-489c-482d-aac6-ab4896d9a3d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:54.863611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9277046d-489c-482d-aac6-ab4896d9a3d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:54.864037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9277046d-489c-482d-aac6-ab4896d9a3d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:54.864709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9277046d-489c-482d-aac6-ab4896d9a3d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:54.865149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9277046d-489c-482d-aac6-ab4896d9a3d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:54.865562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9277046d-489c-482d-aac6-ab4896d9a3d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:54.993738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9277046d-489c-482d-aac6-ab4896d9a3d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:55.001831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9277046d-489c-482d-aac6-ab4896d9a3d3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150108 Aug 31 00:52:55.002390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1299/2655] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:54 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:55.199054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:55.199625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:55.206006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:55.206485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:55.206912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:55.207625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:55.208074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:55.208494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:55.272093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:55.281186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:55.282623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:55.283774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6fbdfd27-9748-45a7-986f-1d075a68ec7f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089479 Aug 31 00:52:55.284350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1357/2656] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:56.023550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ddede825-d053-478a-9b56-6a80cd77a87d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:56.024151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ddede825-d053-478a-9b56-6a80cd77a87d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:56.030536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddede825-d053-478a-9b56-6a80cd77a87d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:56.031080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddede825-d053-478a-9b56-6a80cd77a87d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:56.031584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddede825-d053-478a-9b56-6a80cd77a87d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:56.032283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddede825-d053-478a-9b56-6a80cd77a87d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:56.032734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddede825-d053-478a-9b56-6a80cd77a87d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:56.033157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddede825-d053-478a-9b56-6a80cd77a87d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:56.172780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ddede825-d053-478a-9b56-6a80cd77a87d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:56.181133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ddede825-d053-478a-9b56-6a80cd77a87d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.161474 Aug 31 00:52:56.181702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1300/2657] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:56.305875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:56.306440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:56.312769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:56.313244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:56.313673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:56.314350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:56.314796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:56.315242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:56.377212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:56.386163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:56.387639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:56.388774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4a23a78e-119d-4253-b5d9-4f00967897b2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086988 Aug 31 00:52:56.389329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1358/2658] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:52:57.201755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f22876a5-e9b4-49cc-b5cf-b563d3f4b439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:57.202365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f22876a5-e9b4-49cc-b5cf-b563d3f4b439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:57.208795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f22876a5-e9b4-49cc-b5cf-b563d3f4b439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:57.209274 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f22876a5-e9b4-49cc-b5cf-b563d3f4b439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:57.209709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f22876a5-e9b4-49cc-b5cf-b563d3f4b439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:57.210386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f22876a5-e9b4-49cc-b5cf-b563d3f4b439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:57.211398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f22876a5-e9b4-49cc-b5cf-b563d3f4b439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:57.212135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f22876a5-e9b4-49cc-b5cf-b563d3f4b439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:57.349195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f22876a5-e9b4-49cc-b5cf-b563d3f4b439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:57.357482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f22876a5-e9b4-49cc-b5cf-b563d3f4b439 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.159624 Aug 31 00:52:57.358048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1301/2659] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:57.412261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:57.412860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:57.419584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:57.420068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:57.420499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:57.421179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:57.421630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:57.422053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:57.424598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:52:57.488179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:57.497166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:57.498609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:57.499779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-836983f6-9b76-45dd-abd0-486191aa6240 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091426 Aug 31 00:52:57.500331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1359/2660] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:58.377624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d6794976-991d-4e2e-b245-72a0214cca38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:58.378221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d6794976-991d-4e2e-b245-72a0214cca38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:58.384992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6794976-991d-4e2e-b245-72a0214cca38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:58.385483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6794976-991d-4e2e-b245-72a0214cca38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:58.385890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6794976-991d-4e2e-b245-72a0214cca38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:58.386558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6794976-991d-4e2e-b245-72a0214cca38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:58.386999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6794976-991d-4e2e-b245-72a0214cca38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:58.387474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6794976-991d-4e2e-b245-72a0214cca38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:58.524246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:58.524939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:58.532970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:58.533450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:58.533876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:58.534638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:58.535111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:58.535641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:58.590392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d6794976-991d-4e2e-b245-72a0214cca38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:58.598650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d6794976-991d-4e2e-b245-72a0214cca38 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.224830 Aug 31 00:52:58.599623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1302/2661] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:52:58.607075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:58.615631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:58.617620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:58.618843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7f948ef3-d937-41bf-ba59-aecb14e3a6f5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.100175 Aug 31 00:52:58.619428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1360/2662] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:59.621463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ac3b38ce-5283-4af6-85ef-15e2e3ef2e0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:59.622073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ac3b38ce-5283-4af6-85ef-15e2e3ef2e0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:59.628271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3b38ce-5283-4af6-85ef-15e2e3ef2e0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:59.628753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3b38ce-5283-4af6-85ef-15e2e3ef2e0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:59.629180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3b38ce-5283-4af6-85ef-15e2e3ef2e0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:59.629863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3b38ce-5283-4af6-85ef-15e2e3ef2e0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:59.630308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3b38ce-5283-4af6-85ef-15e2e3ef2e0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:59.630724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac3b38ce-5283-4af6-85ef-15e2e3ef2e0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:59.641985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:52:59.642707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:52:59.649765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:59.650321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:59.650762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:59.651483 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:52:59.651938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:52:59.652390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:52:59.729288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:59.738022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:59.739522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:59.740681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a9ca1840-6929-48e8-994e-5647dc98c80d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.102789 Aug 31 00:52:59.741251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1361/2663] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:52:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:52:59.788996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ac3b38ce-5283-4af6-85ef-15e2e3ef2e0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:52:59.797093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ac3b38ce-5283-4af6-85ef-15e2e3ef2e0d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.179943 Aug 31 00:52:59.797650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1303/2664] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:52:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:00.763177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:00.763893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:00.770175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:00.770646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:00.771104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:00.771773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:00.772219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:00.772632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:00.817680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-891af866-3752-4df0-a42c-68205608cb50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:00.818285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-891af866-3752-4df0-a42c-68205608cb50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:00.825357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891af866-3752-4df0-a42c-68205608cb50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:00.825831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891af866-3752-4df0-a42c-68205608cb50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:00.826290 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891af866-3752-4df0-a42c-68205608cb50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:00.826972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891af866-3752-4df0-a42c-68205608cb50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:00.827438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891af866-3752-4df0-a42c-68205608cb50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:00.827852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-891af866-3752-4df0-a42c-68205608cb50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:00.835201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:00.844927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:00.846368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:00.847529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-02efdac0-71e1-4064-8cd8-e8a8f18f1e41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088307 Aug 31 00:53:00.848087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1362/2665] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:00.956115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-891af866-3752-4df0-a42c-68205608cb50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:00.964355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-891af866-3752-4df0-a42c-68205608cb50 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150477 Aug 31 00:53:00.964917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1304/2666] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:53:01.871586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:01.872125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:01.878501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:01.878982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:01.879459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:01.880149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:01.880600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:01.881017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:01.948309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:01.957044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:01.958482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:01.959645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-13d87ada-4d53-4680-a161-6e1c7dfd614e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092340 Aug 31 00:53:01.960200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1363/2667] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:01.985633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-92c3b7de-e239-41c7-8606-d6b18e39a445 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:01.986232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-92c3b7de-e239-41c7-8606-d6b18e39a445 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:01.992629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c3b7de-e239-41c7-8606-d6b18e39a445 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:01.993103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c3b7de-e239-41c7-8606-d6b18e39a445 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:01.993538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c3b7de-e239-41c7-8606-d6b18e39a445 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:01.994215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c3b7de-e239-41c7-8606-d6b18e39a445 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:01.994656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c3b7de-e239-41c7-8606-d6b18e39a445 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:01.995089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92c3b7de-e239-41c7-8606-d6b18e39a445 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:02.135381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-92c3b7de-e239-41c7-8606-d6b18e39a445 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:02.143485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-92c3b7de-e239-41c7-8606-d6b18e39a445 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.161642 Aug 31 00:53:02.144044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1305/2668] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:02.983264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:02.983800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:02.990219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:02.990701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:02.991166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:02.991856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:02.992831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:02.993339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:03.054284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:03.063875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:03.065315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:03.066478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-956635b1-31b1-4a68-b988-788a5b6e5e48 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087275 Aug 31 00:53:03.067057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1364/2669] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:03.167330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e5bb59d5-5085-488d-b44d-15f35257c27f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:03.167928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e5bb59d5-5085-488d-b44d-15f35257c27f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:03.174253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5bb59d5-5085-488d-b44d-15f35257c27f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:03.174722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5bb59d5-5085-488d-b44d-15f35257c27f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:03.175180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5bb59d5-5085-488d-b44d-15f35257c27f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:03.175850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5bb59d5-5085-488d-b44d-15f35257c27f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:03.176293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5bb59d5-5085-488d-b44d-15f35257c27f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:03.176709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e5bb59d5-5085-488d-b44d-15f35257c27f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:03.308605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e5bb59d5-5085-488d-b44d-15f35257c27f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:03.316741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e5bb59d5-5085-488d-b44d-15f35257c27f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153871 Aug 31 00:53:03.317322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1306/2670] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:04.089956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:04.090586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:04.097232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:04.097724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:04.098153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:04.099119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:04.099568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:04.099985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:04.166280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:04.174971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:04.176440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:04.177575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7e3052c3-bc82-4e2b-a93e-a633e09d5d28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091714 Aug 31 00:53:04.178113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1365/2671] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:04.338056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5c30fabe-7ec7-49b7-bef6-d5bb5bd139aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:04.338747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5c30fabe-7ec7-49b7-bef6-d5bb5bd139aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:04.345388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c30fabe-7ec7-49b7-bef6-d5bb5bd139aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:04.345906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c30fabe-7ec7-49b7-bef6-d5bb5bd139aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:04.346343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c30fabe-7ec7-49b7-bef6-d5bb5bd139aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:04.347031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c30fabe-7ec7-49b7-bef6-d5bb5bd139aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:04.347516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c30fabe-7ec7-49b7-bef6-d5bb5bd139aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:04.347933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c30fabe-7ec7-49b7-bef6-d5bb5bd139aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:04.481320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5c30fabe-7ec7-49b7-bef6-d5bb5bd139aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:04.489413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5c30fabe-7ec7-49b7-bef6-d5bb5bd139aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155144 Aug 31 00:53:04.489972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1307/2672] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:05.204828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:05.205429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:05.211891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:05.212368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:05.212798 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:05.213474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:05.213928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:05.214366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:05.278266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:05.288080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:05.290001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:05.291206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cf8d01a2-1f2e-4845-bf1d-a413b7096aad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090220 Aug 31 00:53:05.291808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1366/2673] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:05.510944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8d70b760-2ffe-4b11-ad20-2fd609438e54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:05.511565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8d70b760-2ffe-4b11-ad20-2fd609438e54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:05.517863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d70b760-2ffe-4b11-ad20-2fd609438e54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:05.518339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d70b760-2ffe-4b11-ad20-2fd609438e54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:05.518764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d70b760-2ffe-4b11-ad20-2fd609438e54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:05.519464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d70b760-2ffe-4b11-ad20-2fd609438e54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:05.519937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d70b760-2ffe-4b11-ad20-2fd609438e54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:05.520353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d70b760-2ffe-4b11-ad20-2fd609438e54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:05.649459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8d70b760-2ffe-4b11-ad20-2fd609438e54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:05.651663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:53:05.658861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8d70b760-2ffe-4b11-ad20-2fd609438e54 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152335 Aug 31 00:53:05.659499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1308/2674] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:06.315174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:06.315759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:06.322989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:06.323497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:06.323937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:06.324628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:06.325107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:06.325528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:06.387863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:06.396280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:06.397709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:06.400004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-01878a16-c271-4d3d-a446-5735d620569a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088558 Aug 31 00:53:06.400565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1367/2675] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:06.681835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7533a1d9-34d5-49ae-a33c-69348647d9cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:06.682443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7533a1d9-34d5-49ae-a33c-69348647d9cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:06.688872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7533a1d9-34d5-49ae-a33c-69348647d9cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:06.689345 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7533a1d9-34d5-49ae-a33c-69348647d9cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:06.689777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7533a1d9-34d5-49ae-a33c-69348647d9cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:06.690456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7533a1d9-34d5-49ae-a33c-69348647d9cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:06.690900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7533a1d9-34d5-49ae-a33c-69348647d9cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:06.691344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7533a1d9-34d5-49ae-a33c-69348647d9cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:06.822046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7533a1d9-34d5-49ae-a33c-69348647d9cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:06.830210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7533a1d9-34d5-49ae-a33c-69348647d9cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152943 Aug 31 00:53:06.830765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1309/2676] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:07.422277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:07.422897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:07.429510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:07.430004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:07.430438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:07.431168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:07.431643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:07.432130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:07.493349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:07.501901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:07.503398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:07.504533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f1e85e5d-debd-4fca-b5ca-2a04d2c655d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086243 Aug 31 00:53:07.505100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1368/2677] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:07.851580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-82129e46-53b4-46da-9bf4-2b573b1e4448 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:07.852403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-82129e46-53b4-46da-9bf4-2b573b1e4448 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:07.858569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82129e46-53b4-46da-9bf4-2b573b1e4448 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:07.859066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82129e46-53b4-46da-9bf4-2b573b1e4448 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:07.859503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82129e46-53b4-46da-9bf4-2b573b1e4448 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:07.860185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82129e46-53b4-46da-9bf4-2b573b1e4448 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:07.860633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82129e46-53b4-46da-9bf4-2b573b1e4448 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:07.861052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82129e46-53b4-46da-9bf4-2b573b1e4448 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:07.989277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-82129e46-53b4-46da-9bf4-2b573b1e4448 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:07.997982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-82129e46-53b4-46da-9bf4-2b573b1e4448 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150536 Aug 31 00:53:07.998611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1310/2678] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:08.527704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:08.528305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:08.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:08.535478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:08.535909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:08.536603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:08.537051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:08.537470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:08.605004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:08.613815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:08.615293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:08.616423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-010c3838-31ba-4f73-b375-3ddd7e916d1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092788 Aug 31 00:53:08.617590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1369/2679] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:09.019470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-547091c1-ada8-4961-a541-d86d9a1b7ceb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:09.020073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-547091c1-ada8-4961-a541-d86d9a1b7ceb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:09.026915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-547091c1-ada8-4961-a541-d86d9a1b7ceb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:09.027414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-547091c1-ada8-4961-a541-d86d9a1b7ceb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:09.027838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-547091c1-ada8-4961-a541-d86d9a1b7ceb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:09.028507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-547091c1-ada8-4961-a541-d86d9a1b7ceb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:09.028946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-547091c1-ada8-4961-a541-d86d9a1b7ceb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:09.029359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-547091c1-ada8-4961-a541-d86d9a1b7ceb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:09.155321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-547091c1-ada8-4961-a541-d86d9a1b7ceb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:09.163473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-547091c1-ada8-4961-a541-d86d9a1b7ceb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.147849 Aug 31 00:53:09.164823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1311/2680] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:09.640137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:09.640758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:09.647136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:09.647606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:09.648031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:09.648969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:09.649407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:09.649818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:09.711862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:09.720393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:09.721816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:09.722924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c0b88a2d-3fc6-4c91-81c5-447c6c460e5c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086731 Aug 31 00:53:09.723764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1370/2681] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:10.186071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e9fb879b-677f-442a-af1a-73d1a7fe9640 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:10.186678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e9fb879b-677f-442a-af1a-73d1a7fe9640 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:10.189007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=52 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:53:10.194114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fb879b-677f-442a-af1a-73d1a7fe9640 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:10.194596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fb879b-677f-442a-af1a-73d1a7fe9640 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:10.195089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fb879b-677f-442a-af1a-73d1a7fe9640 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:10.195951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fb879b-677f-442a-af1a-73d1a7fe9640 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:10.196406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fb879b-677f-442a-af1a-73d1a7fe9640 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:10.196830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fb879b-677f-442a-af1a-73d1a7fe9640 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:10.331295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e9fb879b-677f-442a-af1a-73d1a7fe9640 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:10.340161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e9fb879b-677f-442a-af1a-73d1a7fe9640 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.158030 Aug 31 00:53:10.340751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1312/2682] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:10.746141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:10.746777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:10.753269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:10.753732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:10.754168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:10.754858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:10.755360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:10.755838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:10.817360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:10.827093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:10.828546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:10.829648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0b042bd2-a4b2-4ecd-9f9b-de1ec34949a4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087795 Aug 31 00:53:10.830201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1371/2683] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:11.362005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d69aa206-091d-4eda-be7c-ad023169bcb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:11.362611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d69aa206-091d-4eda-be7c-ad023169bcb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:11.369772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d69aa206-091d-4eda-be7c-ad023169bcb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:11.370246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d69aa206-091d-4eda-be7c-ad023169bcb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:11.370675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d69aa206-091d-4eda-be7c-ad023169bcb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:11.371371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d69aa206-091d-4eda-be7c-ad023169bcb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:11.371821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d69aa206-091d-4eda-be7c-ad023169bcb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:11.372239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d69aa206-091d-4eda-be7c-ad023169bcb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:11.498398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d69aa206-091d-4eda-be7c-ad023169bcb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:11.506503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d69aa206-091d-4eda-be7c-ad023169bcb5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148383 Aug 31 00:53:11.507082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1313/2684] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:11.853449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:11.854035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:11.860467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:11.860947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:11.861374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:11.862056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:11.862536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:11.862952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:11.941786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:11.950364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:11.951835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:11.952968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-40b94901-c12e-49c6-bf01-9bf44f3829bc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.104382 Aug 31 00:53:11.953530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1372/2685] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:12.528295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ce10e2f6-35a5-4fc0-9435-0b67bc8e66fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:12.528931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ce10e2f6-35a5-4fc0-9435-0b67bc8e66fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:12.535515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce10e2f6-35a5-4fc0-9435-0b67bc8e66fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:12.536059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce10e2f6-35a5-4fc0-9435-0b67bc8e66fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:12.536490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce10e2f6-35a5-4fc0-9435-0b67bc8e66fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:12.537177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce10e2f6-35a5-4fc0-9435-0b67bc8e66fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:12.537755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce10e2f6-35a5-4fc0-9435-0b67bc8e66fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:12.538175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce10e2f6-35a5-4fc0-9435-0b67bc8e66fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:12.671186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ce10e2f6-35a5-4fc0-9435-0b67bc8e66fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:12.684569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ce10e2f6-35a5-4fc0-9435-0b67bc8e66fb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.160036 Aug 31 00:53:12.685150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1314/2686] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:12.976826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:12.977651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:12.984007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:12.984490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:12.984923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:12.985607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:12.986060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:12.986479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:13.048574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:13.057612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:13.059073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:13.060224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-176be711-a34b-4780-b9b9-6735990ae96e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088161 Aug 31 00:53:13.060776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1373/2687] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:13.706506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a9e64872-86c5-4de3-9fda-2549f86f5821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:13.707129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a9e64872-86c5-4de3-9fda-2549f86f5821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:13.713686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9e64872-86c5-4de3-9fda-2549f86f5821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:13.714160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9e64872-86c5-4de3-9fda-2549f86f5821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:13.714586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9e64872-86c5-4de3-9fda-2549f86f5821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:13.715295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9e64872-86c5-4de3-9fda-2549f86f5821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:13.715740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9e64872-86c5-4de3-9fda-2549f86f5821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:13.716155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a9e64872-86c5-4de3-9fda-2549f86f5821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:13.851762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a9e64872-86c5-4de3-9fda-2549f86f5821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:13.859829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a9e64872-86c5-4de3-9fda-2549f86f5821 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157138 Aug 31 00:53:13.860389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1315/2688] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:14.082870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:14.083479 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:14.090090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:14.090563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:14.090987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:14.091688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:14.092134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:14.092547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:14.153430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:14.161932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:14.163400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:14.166101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-624e9c60-7959-4cbd-8f47-841854e30ddc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086842 Aug 31 00:53:14.166751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1374/2689] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:14.881456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6dddfbf1-96d3-4f0b-9ca3-b70fb040f41f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:14.882150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6dddfbf1-96d3-4f0b-9ca3-b70fb040f41f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:14.889082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dddfbf1-96d3-4f0b-9ca3-b70fb040f41f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:14.889565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dddfbf1-96d3-4f0b-9ca3-b70fb040f41f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:14.890006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dddfbf1-96d3-4f0b-9ca3-b70fb040f41f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:14.890692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dddfbf1-96d3-4f0b-9ca3-b70fb040f41f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:14.891171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dddfbf1-96d3-4f0b-9ca3-b70fb040f41f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:14.891598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dddfbf1-96d3-4f0b-9ca3-b70fb040f41f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:15.019917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6dddfbf1-96d3-4f0b-9ca3-b70fb040f41f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:15.028621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6dddfbf1-96d3-4f0b-9ca3-b70fb040f41f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150990 Aug 31 00:53:15.029181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1316/2690] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:15.188653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:15.189226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:15.191454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=56 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:53:15.196918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:15.197390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:15.197813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:15.198487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:15.198930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:15.199369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:15.263353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:15.265491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:53:15.274580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:15.276053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:15.277180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c205dda1-f0f4-4ea7-bc75-7c3d35a68f1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092498 Aug 31 00:53:15.277727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1375/2691] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:16.050205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e7923f02-63e5-4e23-81c2-d3bc73b21479 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:16.050825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e7923f02-63e5-4e23-81c2-d3bc73b21479 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:16.057940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7923f02-63e5-4e23-81c2-d3bc73b21479 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:16.058410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7923f02-63e5-4e23-81c2-d3bc73b21479 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:16.058833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7923f02-63e5-4e23-81c2-d3bc73b21479 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:16.059527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7923f02-63e5-4e23-81c2-d3bc73b21479 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:16.059972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7923f02-63e5-4e23-81c2-d3bc73b21479 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:16.060387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7923f02-63e5-4e23-81c2-d3bc73b21479 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:16.185301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e7923f02-63e5-4e23-81c2-d3bc73b21479 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:16.193407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e7923f02-63e5-4e23-81c2-d3bc73b21479 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.146978 Aug 31 00:53:16.193972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1317/2692] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:16.300161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:16.300731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:16.307912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:16.308389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:16.308817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:16.309489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:16.309934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:16.310351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:16.374395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:16.383079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:16.384517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:16.385668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b24f4cf9-80b5-41b1-b873-0bf6cdd71b1f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089805 Aug 31 00:53:16.386225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1376/2693] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:17.215212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a69e8938-e9fe-48d8-a57b-6b8afa26024f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:17.215821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a69e8938-e9fe-48d8-a57b-6b8afa26024f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:17.222619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a69e8938-e9fe-48d8-a57b-6b8afa26024f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:17.223133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a69e8938-e9fe-48d8-a57b-6b8afa26024f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:17.223831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a69e8938-e9fe-48d8-a57b-6b8afa26024f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:17.224515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a69e8938-e9fe-48d8-a57b-6b8afa26024f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:17.224965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a69e8938-e9fe-48d8-a57b-6b8afa26024f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:17.225390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a69e8938-e9fe-48d8-a57b-6b8afa26024f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:17.360980 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a69e8938-e9fe-48d8-a57b-6b8afa26024f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:17.370086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a69e8938-e9fe-48d8-a57b-6b8afa26024f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.159170 Aug 31 00:53:17.370648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1318/2694] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:17.408796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:17.409381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:17.417033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:17.417865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:17.418615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:17.419864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:17.420654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:17.421392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:17.492768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:17.501441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:17.502865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:17.504017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4df8a758-3685-4e01-93cc-6ac2d521a1e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.099223 Aug 31 00:53:17.504572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1377/2695] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:18.392311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-056a1955-18de-41ce-bca5-bc746fe096c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:18.392896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-056a1955-18de-41ce-bca5-bc746fe096c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:18.400096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-056a1955-18de-41ce-bca5-bc746fe096c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:18.400591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-056a1955-18de-41ce-bca5-bc746fe096c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:18.401021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-056a1955-18de-41ce-bca5-bc746fe096c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:18.401694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-056a1955-18de-41ce-bca5-bc746fe096c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:18.402137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-056a1955-18de-41ce-bca5-bc746fe096c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:18.402550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-056a1955-18de-41ce-bca5-bc746fe096c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:18.527314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:18.527919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:18.532332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-056a1955-18de-41ce-bca5-bc746fe096c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:18.534360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:18.534848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:18.535315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:18.536013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:18.536467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:18.536893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:18.540582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-056a1955-18de-41ce-bca5-bc746fe096c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152152 Aug 31 00:53:18.541151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1319/2696] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:18 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:18.602656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:18.611191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:18.612613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:18.613721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b394d947-4d09-454d-a575-8f71302dc46b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090883 Aug 31 00:53:18.614266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1378/2697] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:19.561766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-abbcf868-3e25-42fd-8039-314144e6f127 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:19.562372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-abbcf868-3e25-42fd-8039-314144e6f127 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:19.568737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abbcf868-3e25-42fd-8039-314144e6f127 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:19.569212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abbcf868-3e25-42fd-8039-314144e6f127 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:19.569639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abbcf868-3e25-42fd-8039-314144e6f127 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:19.570350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abbcf868-3e25-42fd-8039-314144e6f127 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:19.570802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abbcf868-3e25-42fd-8039-314144e6f127 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:19.571250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abbcf868-3e25-42fd-8039-314144e6f127 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:19.637283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:19.637885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:19.644312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:19.644792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:19.645217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:19.645892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:19.646332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:19.646745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:19.720832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:19.725452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-abbcf868-3e25-42fd-8039-314144e6f127 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:19.730319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:19.731775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:19.732897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ee7b0baf-fd76-4bb4-b374-fda78754184f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.099693 Aug 31 00:53:19.733451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1379/2698] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:19.734239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-abbcf868-3e25-42fd-8039-314144e6f127 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.176325 Aug 31 00:53:19.734750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1320/2699] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:20.755466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bd1b9f78-aa4c-426e-b9ec-cfed05eef6ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:20.756261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:20.756647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bd1b9f78-aa4c-426e-b9ec-cfed05eef6ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:20.756765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:20.762204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:20.762614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd1b9f78-aa4c-426e-b9ec-cfed05eef6ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:20.762763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:20.763113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:20.763240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd1b9f78-aa4c-426e-b9ec-cfed05eef6ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:20.763547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd1b9f78-aa4c-426e-b9ec-cfed05eef6ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:20.763791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:20.764264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd1b9f78-aa4c-426e-b9ec-cfed05eef6ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:20.764423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:20.764727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd1b9f78-aa4c-426e-b9ec-cfed05eef6ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:20.764880 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:20.765143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd1b9f78-aa4c-426e-b9ec-cfed05eef6ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:20.855019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:20.863816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:20.865235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:20.866377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ffa4d1f1-5ad6-4c14-ab1f-bebcd045f04a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.114760 Aug 31 00:53:20.866926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1380/2700] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:20.918449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bd1b9f78-aa4c-426e-b9ec-cfed05eef6ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:20.926829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bd1b9f78-aa4c-426e-b9ec-cfed05eef6ed tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.175168 Aug 31 00:53:20.927430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1321/2701] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:21.890278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:21.890814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:21.897232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:21.897708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:21.898137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:21.898922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:21.899402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:21.899847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:21.948089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cfda0cef-576c-4709-b388-4c72928cdd2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:21.948705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cfda0cef-576c-4709-b388-4c72928cdd2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:21.955201 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfda0cef-576c-4709-b388-4c72928cdd2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:21.956006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfda0cef-576c-4709-b388-4c72928cdd2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:21.956180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfda0cef-576c-4709-b388-4c72928cdd2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:21.956759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfda0cef-576c-4709-b388-4c72928cdd2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:21.957206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfda0cef-576c-4709-b388-4c72928cdd2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:21.957619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cfda0cef-576c-4709-b388-4c72928cdd2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:21.961441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:21.970491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:21.971966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:21.973117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5a22c04a-c910-4bdb-9cfc-41acbae76a82 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086915 Aug 31 00:53:21.974173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1381/2702] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:22.089410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cfda0cef-576c-4709-b388-4c72928cdd2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:22.097601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cfda0cef-576c-4709-b388-4c72928cdd2d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154206 Aug 31 00:53:22.098164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1322/2703] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:21 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:53:22.997108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:22.997718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:23.004187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:23.004665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:23.005100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:23.005785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:23.006233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:23.006653 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:23.068293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:23.077216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:23.078689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:23.079853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-52dd794b-f5bf-4ee9-b060-e8766e64ca9a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087421 Aug 31 00:53:23.080413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1382/2704] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:22 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:23.119461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-21640bbb-fee5-4fe6-8ae8-3dc6a582ad64 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:23.120065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-21640bbb-fee5-4fe6-8ae8-3dc6a582ad64 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:23.126432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21640bbb-fee5-4fe6-8ae8-3dc6a582ad64 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:23.126908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21640bbb-fee5-4fe6-8ae8-3dc6a582ad64 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:23.127373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21640bbb-fee5-4fe6-8ae8-3dc6a582ad64 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:23.128053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21640bbb-fee5-4fe6-8ae8-3dc6a582ad64 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:23.128503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21640bbb-fee5-4fe6-8ae8-3dc6a582ad64 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:23.128925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21640bbb-fee5-4fe6-8ae8-3dc6a582ad64 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:23.256664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-21640bbb-fee5-4fe6-8ae8-3dc6a582ad64 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:23.264890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-21640bbb-fee5-4fe6-8ae8-3dc6a582ad64 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149204 Aug 31 00:53:23.265455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1323/2705] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:24.103362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:24.104220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:24.110637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:24.111141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:24.111571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:24.112241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:24.112681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:24.113095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:24.178824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:24.187908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:24.189337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:24.190447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9be2c575-364f-43c4-b512-a23801d4eed1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091065 Aug 31 00:53:24.190993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1383/2706] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:24.287020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f4871fd3-6489-40d9-80ca-48dbc26ea331 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:24.287599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f4871fd3-6489-40d9-80ca-48dbc26ea331 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:24.294776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4871fd3-6489-40d9-80ca-48dbc26ea331 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:24.295288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4871fd3-6489-40d9-80ca-48dbc26ea331 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:24.295724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4871fd3-6489-40d9-80ca-48dbc26ea331 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:24.296405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4871fd3-6489-40d9-80ca-48dbc26ea331 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:24.296854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4871fd3-6489-40d9-80ca-48dbc26ea331 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:24.297276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4871fd3-6489-40d9-80ca-48dbc26ea331 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:24.423713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f4871fd3-6489-40d9-80ca-48dbc26ea331 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:24.432607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f4871fd3-6489-40d9-80ca-48dbc26ea331 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148816 Aug 31 00:53:24.433174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1324/2707] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:25.214670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:25.215302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:25.221833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:25.222305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:25.222735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:25.223693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:25.224133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:25.224549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:25.286018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:25.294868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:25.296349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:25.297466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5039ca00-c3bf-4a24-933a-62426908599a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087982 Aug 31 00:53:25.298017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1384/2708] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:25.454474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-62e50388-5a05-4df5-b596-52f9fc45705e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:25.455098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-62e50388-5a05-4df5-b596-52f9fc45705e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:25.461444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62e50388-5a05-4df5-b596-52f9fc45705e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:25.461911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62e50388-5a05-4df5-b596-52f9fc45705e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:25.462333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62e50388-5a05-4df5-b596-52f9fc45705e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:25.463232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62e50388-5a05-4df5-b596-52f9fc45705e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:25.463742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62e50388-5a05-4df5-b596-52f9fc45705e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:25.464159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62e50388-5a05-4df5-b596-52f9fc45705e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:25.478929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:53:25.596828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-62e50388-5a05-4df5-b596-52f9fc45705e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:25.605342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-62e50388-5a05-4df5-b596-52f9fc45705e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154730 Aug 31 00:53:25.605913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1325/2709] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:26.320513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:26.321172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:26.328401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:26.328890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:26.329329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:26.330029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:26.330480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:26.330904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:26.399137 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:26.408556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:26.409993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:26.411201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aead580b-1a30-4bf0-91c2-9e4e210238d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.094724 Aug 31 00:53:26.411795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1385/2710] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:26.627540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-524467ed-3c72-4a48-87f5-92e3f59c6b59 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:26.628146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-524467ed-3c72-4a48-87f5-92e3f59c6b59 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:26.634657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-524467ed-3c72-4a48-87f5-92e3f59c6b59 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:26.635294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-524467ed-3c72-4a48-87f5-92e3f59c6b59 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:26.635861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-524467ed-3c72-4a48-87f5-92e3f59c6b59 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:26.636559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-524467ed-3c72-4a48-87f5-92e3f59c6b59 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:26.637015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-524467ed-3c72-4a48-87f5-92e3f59c6b59 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:26.637444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-524467ed-3c72-4a48-87f5-92e3f59c6b59 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:26.780682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-524467ed-3c72-4a48-87f5-92e3f59c6b59 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:26.789079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-524467ed-3c72-4a48-87f5-92e3f59c6b59 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.166047 Aug 31 00:53:26.789856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1326/2711] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:26 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:27.435565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:27.436358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:27.442794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:27.443312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:27.443747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:27.444434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:27.444883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:27.445308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:27.509221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:27.519149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:27.520625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:27.521762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2b9e575a-de52-4f17-aa3e-78d6e76b659d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090770 Aug 31 00:53:27.522327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1386/2712] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:27.811838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8928dcfd-9f64-4f14-ad36-527361208d4c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:27.812370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8928dcfd-9f64-4f14-ad36-527361208d4c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:27.818713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8928dcfd-9f64-4f14-ad36-527361208d4c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:27.819231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8928dcfd-9f64-4f14-ad36-527361208d4c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:27.819662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8928dcfd-9f64-4f14-ad36-527361208d4c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:27.820340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8928dcfd-9f64-4f14-ad36-527361208d4c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:27.820789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8928dcfd-9f64-4f14-ad36-527361208d4c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:27.821213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8928dcfd-9f64-4f14-ad36-527361208d4c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:27.950200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8928dcfd-9f64-4f14-ad36-527361208d4c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:27.958462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8928dcfd-9f64-4f14-ad36-527361208d4c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150627 Aug 31 00:53:27.959027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1327/2713] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:27 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:28.544417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:28.545018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:28.552069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:28.552557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:28.552992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:28.553677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:28.554125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:28.554543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:28.616233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:28.625455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:28.626922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:28.628090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7f40b1f8-871e-4e97-8bfb-91730485510b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087635 Aug 31 00:53:28.628651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1387/2714] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:28.981145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a3a16a93-db82-4f2d-ab9f-a3566e2c5866 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:28.981748 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a3a16a93-db82-4f2d-ab9f-a3566e2c5866 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:28.988237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3a16a93-db82-4f2d-ab9f-a3566e2c5866 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:28.988714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3a16a93-db82-4f2d-ab9f-a3566e2c5866 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:28.989150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3a16a93-db82-4f2d-ab9f-a3566e2c5866 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:28.989830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3a16a93-db82-4f2d-ab9f-a3566e2c5866 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:28.990283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3a16a93-db82-4f2d-ab9f-a3566e2c5866 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:28.990699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3a16a93-db82-4f2d-ab9f-a3566e2c5866 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:29.121869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a3a16a93-db82-4f2d-ab9f-a3566e2c5866 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:29.129927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a3a16a93-db82-4f2d-ab9f-a3566e2c5866 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153105 Aug 31 00:53:29.130482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1328/2715] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:29.652033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:29.652644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:29.659087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:29.659572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:29.660032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:29.660717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:29.661169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:29.661590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:29.723773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:29.733360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:29.734802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:29.735986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bce93644-cd2b-4ad5-a573-996c73edb495 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088637 Aug 31 00:53:29.736547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1388/2716] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:30.151516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7581b4ef-fda0-4092-a4e9-b0cf6e2fc7ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:30.152769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7581b4ef-fda0-4092-a4e9-b0cf6e2fc7ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:30.159364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7581b4ef-fda0-4092-a4e9-b0cf6e2fc7ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:30.159849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7581b4ef-fda0-4092-a4e9-b0cf6e2fc7ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:30.160285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7581b4ef-fda0-4092-a4e9-b0cf6e2fc7ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:30.161001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7581b4ef-fda0-4092-a4e9-b0cf6e2fc7ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:30.161452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7581b4ef-fda0-4092-a4e9-b0cf6e2fc7ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:30.161904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7581b4ef-fda0-4092-a4e9-b0cf6e2fc7ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:30.287933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7581b4ef-fda0-4092-a4e9-b0cf6e2fc7ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:30.297123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7581b4ef-fda0-4092-a4e9-b0cf6e2fc7ef tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149541 Aug 31 00:53:30.298539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1329/2717] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:30.758697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:30.759339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:30.765994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:30.766422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:30.766853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:30.767564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:30.768009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:30.768426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:30.831879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:30.841288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:30.842713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:30.843867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d894dee4-7b97-44de-8c68-6ac1d56278eb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089150 Aug 31 00:53:30.844424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1389/2718] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:31.319381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6475d11f-69eb-4d28-a2b8-d9e6deedf04e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:31.319992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6475d11f-69eb-4d28-a2b8-d9e6deedf04e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:31.327339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6475d11f-69eb-4d28-a2b8-d9e6deedf04e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:31.327799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6475d11f-69eb-4d28-a2b8-d9e6deedf04e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:31.328230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6475d11f-69eb-4d28-a2b8-d9e6deedf04e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:31.328908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6475d11f-69eb-4d28-a2b8-d9e6deedf04e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:31.329350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6475d11f-69eb-4d28-a2b8-d9e6deedf04e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:31.329766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6475d11f-69eb-4d28-a2b8-d9e6deedf04e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:31.457328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6475d11f-69eb-4d28-a2b8-d9e6deedf04e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:31.465491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6475d11f-69eb-4d28-a2b8-d9e6deedf04e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150038 Aug 31 00:53:31.466048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1330/2719] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:31.867882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:31.868516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:31.875802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:31.876287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:31.876724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:31.877414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:31.877862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:31.878315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:31.943002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:31.951553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:31.952987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:31.954110 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-13f987ce-fbd1-4758-9c4a-603561eb0f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090123 Aug 31 00:53:31.954665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1390/2720] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:32.486915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d217c7c7-09d4-4080-af5f-e79969d400e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:32.486915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d217c7c7-09d4-4080-af5f-e79969d400e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:32.493619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d217c7c7-09d4-4080-af5f-e79969d400e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:32.494204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d217c7c7-09d4-4080-af5f-e79969d400e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:32.494643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d217c7c7-09d4-4080-af5f-e79969d400e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:32.495368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d217c7c7-09d4-4080-af5f-e79969d400e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:32.495822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d217c7c7-09d4-4080-af5f-e79969d400e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:32.496244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d217c7c7-09d4-4080-af5f-e79969d400e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:32.630651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d217c7c7-09d4-4080-af5f-e79969d400e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:32.639723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d217c7c7-09d4-4080-af5f-e79969d400e7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157419 Aug 31 00:53:32.640271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1331/2721] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:32.977073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:32.977681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:32.984185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:32.984664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:32.985096 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:32.985775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:32.986218 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:32.986637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:33.048365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:33.057752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:33.059389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:33.060578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8f5b16b9-8d2e-42b0-b208-e9295939db46 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087645 Aug 31 00:53:33.061082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1391/2722] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:33.661079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ab24e517-1aed-4768-aa88-589fbecc4457 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:33.661682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ab24e517-1aed-4768-aa88-589fbecc4457 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:33.668768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab24e517-1aed-4768-aa88-589fbecc4457 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:33.669247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab24e517-1aed-4768-aa88-589fbecc4457 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:33.669676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab24e517-1aed-4768-aa88-589fbecc4457 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:33.670356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab24e517-1aed-4768-aa88-589fbecc4457 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:33.670800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab24e517-1aed-4768-aa88-589fbecc4457 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:33.671256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab24e517-1aed-4768-aa88-589fbecc4457 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:33.799713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ab24e517-1aed-4768-aa88-589fbecc4457 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:33.808203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ab24e517-1aed-4768-aa88-589fbecc4457 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151084 Aug 31 00:53:33.808801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1332/2723] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:33 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:34.084434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:34.085026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:34.092246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:34.092718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:34.093143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:34.093813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:34.094261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:34.094674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:34.109434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:53:34.158924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:34.167518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:34.168943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:34.170073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f858497b-3614-43d6-8ec6-d25ced88280e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089609 Aug 31 00:53:34.170627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1392/2724] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:34.829966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-79a0e44a-c3ca-41ff-a553-e6cd0f446103 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:34.830569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-79a0e44a-c3ca-41ff-a553-e6cd0f446103 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:34.837108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79a0e44a-c3ca-41ff-a553-e6cd0f446103 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:34.837832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79a0e44a-c3ca-41ff-a553-e6cd0f446103 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:34.838358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79a0e44a-c3ca-41ff-a553-e6cd0f446103 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:34.839199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79a0e44a-c3ca-41ff-a553-e6cd0f446103 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:34.839872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79a0e44a-c3ca-41ff-a553-e6cd0f446103 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:34.840304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-79a0e44a-c3ca-41ff-a553-e6cd0f446103 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:34.968459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-79a0e44a-c3ca-41ff-a553-e6cd0f446103 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:34.976971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-79a0e44a-c3ca-41ff-a553-e6cd0f446103 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150921 Aug 31 00:53:34.977522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1333/2725] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:34 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:35.192101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:35.192654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:35.199215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:35.199696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:35.200130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:35.200807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:35.201257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:35.201678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:35.262249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:35.270749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:35.272234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:35.273379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-51d0666a-4d2e-4157-8084-471ed6159f66 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085305 Aug 31 00:53:35.273931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1393/2726] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:35.999692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ce8eb245-af04-4b88-8514-85c735388a8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:36.000307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ce8eb245-af04-4b88-8514-85c735388a8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:36.006744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce8eb245-af04-4b88-8514-85c735388a8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:36.007263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce8eb245-af04-4b88-8514-85c735388a8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:36.007700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce8eb245-af04-4b88-8514-85c735388a8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:36.008378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce8eb245-af04-4b88-8514-85c735388a8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:36.008828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce8eb245-af04-4b88-8514-85c735388a8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:36.009250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce8eb245-af04-4b88-8514-85c735388a8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:36.140248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ce8eb245-af04-4b88-8514-85c735388a8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:36.148385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ce8eb245-af04-4b88-8514-85c735388a8c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152716 Aug 31 00:53:36.148946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1334/2727] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:36.296898 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:36.297425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:36.303757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:36.304241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:36.304677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:36.305358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:36.305805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:36.306294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:36.370597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:36.379197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:36.380644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:36.381776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-12cd2e3b-8e78-4553-a072-c29622d3d879 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088899 Aug 31 00:53:36.382327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1394/2728] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:37.169838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d91c5f72-486c-4875-9142-a7541002c00d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:37.170562 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d91c5f72-486c-4875-9142-a7541002c00d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:37.177079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d91c5f72-486c-4875-9142-a7541002c00d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:37.177585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d91c5f72-486c-4875-9142-a7541002c00d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:37.178024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d91c5f72-486c-4875-9142-a7541002c00d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:37.178709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d91c5f72-486c-4875-9142-a7541002c00d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:37.179191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d91c5f72-486c-4875-9142-a7541002c00d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:37.179619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d91c5f72-486c-4875-9142-a7541002c00d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:37.312006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d91c5f72-486c-4875-9142-a7541002c00d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:37.320205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d91c5f72-486c-4875-9142-a7541002c00d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154556 Aug 31 00:53:37.320772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1335/2729] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:37 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:37.404201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:37.404801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:37.411269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:37.411750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:37.412187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:37.412870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:37.413319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:37.413737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:37.477572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:37.486116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:37.487670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:37.488788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-222e4b2a-9f0b-48c1-947c-478de1fc1795 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088474 Aug 31 00:53:37.489347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1395/2730] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:37.844849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-725d29ba-dfa0-431d-96af-d267ff164e06 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:37.845337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-725d29ba-dfa0-431d-96af-d267ff164e06 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:37.852005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d29ba-dfa0-431d-96af-d267ff164e06 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:37.852486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d29ba-dfa0-431d-96af-d267ff164e06 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:37.852923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d29ba-dfa0-431d-96af-d267ff164e06 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:37.854175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d29ba-dfa0-431d-96af-d267ff164e06 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:37.854622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d29ba-dfa0-431d-96af-d267ff164e06 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:37.855059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d29ba-dfa0-431d-96af-d267ff164e06 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:37.878693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-725d29ba-dfa0-431d-96af-d267ff164e06 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/ips" status: 200 len: 147 microversion: 2.1 time: 0.101914 Aug 31 00:53:37.879263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1336/2731] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 31 00:53:37 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/ips => generated 147 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:53:38.343378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d41596a-a1fd-4cfa-9c3a-3654a0fcc1a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:38.344467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d41596a-a1fd-4cfa-9c3a-3654a0fcc1a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:38.351271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d41596a-a1fd-4cfa-9c3a-3654a0fcc1a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:38.351756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d41596a-a1fd-4cfa-9c3a-3654a0fcc1a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:38.352247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d41596a-a1fd-4cfa-9c3a-3654a0fcc1a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:38.352958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d41596a-a1fd-4cfa-9c3a-3654a0fcc1a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:38.354174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d41596a-a1fd-4cfa-9c3a-3654a0fcc1a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:38.354818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d41596a-a1fd-4cfa-9c3a-3654a0fcc1a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:38.483619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8d41596a-a1fd-4cfa-9c3a-3654a0fcc1a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:38.491788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d41596a-a1fd-4cfa-9c3a-3654a0fcc1a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153359 Aug 31 00:53:38.492351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1396/2732] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:38.511438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:38.512036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:38.518332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:38.518803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:38.519268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:38.519938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:38.520378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:38.520791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:38.587203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:38.596613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:38.598230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:38.599381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-07d197df-2108-4236-8cda-dcf4d9e5ee28 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092315 Aug 31 00:53:38.599932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1337/2733] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:39.513446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4ad6deef-99d6-4ab3-9b22-22cc01dce0e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:39.514080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4ad6deef-99d6-4ab3-9b22-22cc01dce0e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:39.520439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad6deef-99d6-4ab3-9b22-22cc01dce0e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:39.520910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad6deef-99d6-4ab3-9b22-22cc01dce0e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:39.521337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad6deef-99d6-4ab3-9b22-22cc01dce0e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:39.522002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad6deef-99d6-4ab3-9b22-22cc01dce0e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:39.522445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad6deef-99d6-4ab3-9b22-22cc01dce0e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:39.522856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4ad6deef-99d6-4ab3-9b22-22cc01dce0e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:39.622295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:39.622928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:39.629321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:39.629808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:39.630241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:39.630933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:39.631413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:39.631838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:39.655600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4ad6deef-99d6-4ab3-9b22-22cc01dce0e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:39.663897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4ad6deef-99d6-4ab3-9b22-22cc01dce0e2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154297 Aug 31 00:53:39.664551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1397/2734] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:39 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:39.694263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:39.703220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:39.704672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:39.706048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-89baad7b-b106-4a0f-9352-d4f1fb3a15a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088202 Aug 31 00:53:39.706612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1338/2735] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:40.685952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e3378849-af4b-4021-a904-705d93f2a8d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:40.686552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e3378849-af4b-4021-a904-705d93f2a8d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:40.693013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3378849-af4b-4021-a904-705d93f2a8d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:40.693493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3378849-af4b-4021-a904-705d93f2a8d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:40.693929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3378849-af4b-4021-a904-705d93f2a8d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:40.694603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3378849-af4b-4021-a904-705d93f2a8d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:40.695074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3378849-af4b-4021-a904-705d93f2a8d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:40.695500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3378849-af4b-4021-a904-705d93f2a8d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:40.728223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:40.729017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:40.731312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=54 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:53:40.736957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:40.737527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:40.738024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:40.738798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:40.739340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:40.739828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:40.816008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:40.825391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:40.826846 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:40.828019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-698c8b07-9723-4286-b49a-ab15d254345a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.103575 Aug 31 00:53:40.828573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1339/2736] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:40.847724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e3378849-af4b-4021-a904-705d93f2a8d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:40.856727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e3378849-af4b-4021-a904-705d93f2a8d1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.174714 Aug 31 00:53:40.857326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1398/2737] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:41.853273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:41.853861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:41.861285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:41.861765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:41.862198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:41.862874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:41.863354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:41.863779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:41.879970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8c95600f-4a76-4d84-bc82-1175650ef0a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:41.880579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8c95600f-4a76-4d84-bc82-1175650ef0a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:41.887971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c95600f-4a76-4d84-bc82-1175650ef0a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:41.888458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c95600f-4a76-4d84-bc82-1175650ef0a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:41.888903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c95600f-4a76-4d84-bc82-1175650ef0a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:41.889598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c95600f-4a76-4d84-bc82-1175650ef0a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:41.890052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c95600f-4a76-4d84-bc82-1175650ef0a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:41.890527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c95600f-4a76-4d84-bc82-1175650ef0a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:41.929422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:41.939135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:41.940565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:41.941694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-24934acb-2ee2-43cb-aa0a-7398bbc941e9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092335 Aug 31 00:53:41.942251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1340/2738] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:42.024488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8c95600f-4a76-4d84-bc82-1175650ef0a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:42.033105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8c95600f-4a76-4d84-bc82-1175650ef0a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.159096 Aug 31 00:53:42.033666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1399/2739] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:41 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:53:42.965803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:42.966402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:42.974781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:42.975288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:42.975716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:42.976396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:42.976838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:42.977257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:43.041581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:43.051078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:43.052530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:43.053585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eca6b5ae-f640-446d-b1c7-8d80349a11f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:43.054037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-393aceec-f26c-4acf-a9b7-bf7c40dbfcf0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091943 Aug 31 00:53:43.054202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eca6b5ae-f640-446d-b1c7-8d80349a11f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:43.054487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1341/2740] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:43.062518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eca6b5ae-f640-446d-b1c7-8d80349a11f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:43.063000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eca6b5ae-f640-446d-b1c7-8d80349a11f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:43.063481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eca6b5ae-f640-446d-b1c7-8d80349a11f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:43.064172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eca6b5ae-f640-446d-b1c7-8d80349a11f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:43.064657 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eca6b5ae-f640-446d-b1c7-8d80349a11f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:43.065105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eca6b5ae-f640-446d-b1c7-8d80349a11f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:43.196093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eca6b5ae-f640-446d-b1c7-8d80349a11f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:43.205231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eca6b5ae-f640-446d-b1c7-8d80349a11f3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155422 Aug 31 00:53:43.205802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1400/2741] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:53:44.076571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:44.077206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:44.083598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:44.084080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:44.084514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:44.085195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:44.085644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:44.086064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:44.102103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:53:44.153556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:44.168292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:44.169875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:44.171015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9f8f91c1-3c98-49be-adf8-34ead59eb789 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.098801 Aug 31 00:53:44.171596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1342/2742] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:44.227800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fc563b8c-818c-4cb3-8eb2-e4a8309953a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:44.228356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fc563b8c-818c-4cb3-8eb2-e4a8309953a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:44.234966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc563b8c-818c-4cb3-8eb2-e4a8309953a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:44.235487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc563b8c-818c-4cb3-8eb2-e4a8309953a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:44.235926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc563b8c-818c-4cb3-8eb2-e4a8309953a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:44.236611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc563b8c-818c-4cb3-8eb2-e4a8309953a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:44.237066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc563b8c-818c-4cb3-8eb2-e4a8309953a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:44.237486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc563b8c-818c-4cb3-8eb2-e4a8309953a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:44.364344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fc563b8c-818c-4cb3-8eb2-e4a8309953a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:44.374728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fc563b8c-818c-4cb3-8eb2-e4a8309953a3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150907 Aug 31 00:53:44.375334 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1401/2743] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:45.194121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:45.194729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:45.201353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:45.201821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:45.202246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:45.202927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:45.203392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:45.203814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:45.274572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:45.283340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:45.284815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:45.285976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1aeece70-4aff-475d-96d6-ee6f7ae9d757 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.095774 Aug 31 00:53:45.286537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1343/2744] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:45.399975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04c840b3-28a1-4dda-b5c8-d2d64a9705a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:45.400578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-04c840b3-28a1-4dda-b5c8-d2d64a9705a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:45.403090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=54 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:53:45.408559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04c840b3-28a1-4dda-b5c8-d2d64a9705a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:45.409038 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04c840b3-28a1-4dda-b5c8-d2d64a9705a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:45.409486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04c840b3-28a1-4dda-b5c8-d2d64a9705a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:45.410153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04c840b3-28a1-4dda-b5c8-d2d64a9705a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:45.410603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04c840b3-28a1-4dda-b5c8-d2d64a9705a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:45.411023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04c840b3-28a1-4dda-b5c8-d2d64a9705a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:45.779088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-04c840b3-28a1-4dda-b5c8-d2d64a9705a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:45.787268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-04c840b3-28a1-4dda-b5c8-d2d64a9705a7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.391092 Aug 31 00:53:45.787834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1402/2745] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:46.310029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:46.310578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:46.317039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:46.317517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:46.317951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:46.318634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:46.319108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:46.319535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:46.383700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:46.396536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:46.397954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:46.399096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-745c17ac-911e-4d94-a1c2-052dfa3f4ce1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.093855 Aug 31 00:53:46.399647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1344/2746] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:46.809433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cececa9f-e2e5-4fbe-9a51-70ca65d83500 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:46.810034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cececa9f-e2e5-4fbe-9a51-70ca65d83500 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:46.816457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cececa9f-e2e5-4fbe-9a51-70ca65d83500 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:46.816939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cececa9f-e2e5-4fbe-9a51-70ca65d83500 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:46.817374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cececa9f-e2e5-4fbe-9a51-70ca65d83500 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:46.818053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cececa9f-e2e5-4fbe-9a51-70ca65d83500 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:46.818545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cececa9f-e2e5-4fbe-9a51-70ca65d83500 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:46.819055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cececa9f-e2e5-4fbe-9a51-70ca65d83500 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:46.953206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cececa9f-e2e5-4fbe-9a51-70ca65d83500 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:46.961512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cececa9f-e2e5-4fbe-9a51-70ca65d83500 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156838 Aug 31 00:53:46.962074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1403/2747] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:46 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:47.422600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:47.424523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:47.429760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:47.430242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:47.430678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:47.431397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:47.431847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:47.432277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:47.496864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:47.505489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:47.506927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:47.508089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fcbe451f-6f7c-4381-b077-14471b7535e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090360 Aug 31 00:53:47.508642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1345/2748] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:47.983868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-83241c65-5030-48db-b0ad-ecac5fd3a5f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:47.984478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-83241c65-5030-48db-b0ad-ecac5fd3a5f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:47.991228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83241c65-5030-48db-b0ad-ecac5fd3a5f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:47.991713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83241c65-5030-48db-b0ad-ecac5fd3a5f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:47.992147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83241c65-5030-48db-b0ad-ecac5fd3a5f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:47.992843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83241c65-5030-48db-b0ad-ecac5fd3a5f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:47.993303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83241c65-5030-48db-b0ad-ecac5fd3a5f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:47.993728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-83241c65-5030-48db-b0ad-ecac5fd3a5f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:48.120694 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-83241c65-5030-48db-b0ad-ecac5fd3a5f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:48.129150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-83241c65-5030-48db-b0ad-ecac5fd3a5f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149823 Aug 31 00:53:48.129731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1404/2749] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:47 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:48.530964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:48.531722 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:48.538487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:48.538964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:48.539418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:48.540127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:48.540567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:48.540982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:48.608057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:48.616624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:48.618039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:48.619207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a33edbd6-a8cb-4ec2-ae47-3d076e78d5c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092427 Aug 31 00:53:48.619754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1346/2750] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:49.151265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a383b3b2-486a-446b-8cd5-b687a1b61760 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:49.152084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a383b3b2-486a-446b-8cd5-b687a1b61760 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:49.158467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a383b3b2-486a-446b-8cd5-b687a1b61760 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:49.158940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a383b3b2-486a-446b-8cd5-b687a1b61760 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:49.159394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a383b3b2-486a-446b-8cd5-b687a1b61760 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:49.160062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a383b3b2-486a-446b-8cd5-b687a1b61760 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:49.160532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a383b3b2-486a-446b-8cd5-b687a1b61760 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:49.160949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a383b3b2-486a-446b-8cd5-b687a1b61760 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:49.290574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a383b3b2-486a-446b-8cd5-b687a1b61760 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:49.299397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a383b3b2-486a-446b-8cd5-b687a1b61760 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151967 Aug 31 00:53:49.299958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1405/2751] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:49.642774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:49.643413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:49.649922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:49.650396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:49.650823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:49.651528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:49.652227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:49.652641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:49.713996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:49.723247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:49.724692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:49.725839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d89068f7-3ef9-459f-8183-cc0623b82e8f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086917 Aug 31 00:53:49.726398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1347/2752] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:50.321500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-db57acda-8961-4a10-b847-3009af9ee5fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:50.322061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-db57acda-8961-4a10-b847-3009af9ee5fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:50.329501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db57acda-8961-4a10-b847-3009af9ee5fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:50.329989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db57acda-8961-4a10-b847-3009af9ee5fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:50.330427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db57acda-8961-4a10-b847-3009af9ee5fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:50.331181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db57acda-8961-4a10-b847-3009af9ee5fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:50.331634 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db57acda-8961-4a10-b847-3009af9ee5fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:50.332057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db57acda-8961-4a10-b847-3009af9ee5fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:50.464725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-db57acda-8961-4a10-b847-3009af9ee5fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:50.473268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-db57acda-8961-4a10-b847-3009af9ee5fe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155503 Aug 31 00:53:50.473834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1406/2753] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:50.749248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:50.749878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:50.756550 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:50.757061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:50.757493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:50.758177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:50.758623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:50.759102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:50.819156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:50.828399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:50.829839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:50.831013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-222fda0f-b23e-479d-a135-4c8d3a1c6539 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086281 Aug 31 00:53:50.831588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1348/2754] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:51.494878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bfc08135-715a-4d46-8122-0d730eab9630 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:51.496223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bfc08135-715a-4d46-8122-0d730eab9630 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:51.502896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfc08135-715a-4d46-8122-0d730eab9630 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:51.503405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfc08135-715a-4d46-8122-0d730eab9630 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:51.503836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfc08135-715a-4d46-8122-0d730eab9630 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:51.504515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfc08135-715a-4d46-8122-0d730eab9630 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:51.504959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfc08135-715a-4d46-8122-0d730eab9630 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:51.505374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bfc08135-715a-4d46-8122-0d730eab9630 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:51.630589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bfc08135-715a-4d46-8122-0d730eab9630 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:51.638778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bfc08135-715a-4d46-8122-0d730eab9630 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.147757 Aug 31 00:53:51.639367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1407/2755] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:51.853280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:51.853881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:51.860882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:51.861347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:51.861773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:51.862436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:51.862886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:51.863342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:51.927933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:51.936637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:51.938047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:51.939196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-af60c79b-4ac5-4edd-89c2-4cf255862935 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089742 Aug 31 00:53:51.939746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1349/2756] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:52.660547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a770041d-7c56-4303-8086-e2895b0fbcb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:52.661152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a770041d-7c56-4303-8086-e2895b0fbcb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:52.668086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a770041d-7c56-4303-8086-e2895b0fbcb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:52.668757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a770041d-7c56-4303-8086-e2895b0fbcb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:52.669189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a770041d-7c56-4303-8086-e2895b0fbcb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:52.669866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a770041d-7c56-4303-8086-e2895b0fbcb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:52.670311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a770041d-7c56-4303-8086-e2895b0fbcb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:52.670726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a770041d-7c56-4303-8086-e2895b0fbcb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:52.796983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a770041d-7c56-4303-8086-e2895b0fbcb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:52.805050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a770041d-7c56-4303-8086-e2895b0fbcb9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148340 Aug 31 00:53:52.805601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1408/2757] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:52.962320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:52.962959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:52.969338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:52.969816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:52.970248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:52.970929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:52.971398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:52.971812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:53.033442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:53.041947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:53.044044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:53.045178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0d503c90-de88-4c42-b211-9d6ec97698f2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086820 Aug 31 00:53:53.045728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1350/2758] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:53.826778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3836e92d-2e8b-4e13-8a9d-a5138b2bcbfe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:53.827575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3836e92d-2e8b-4e13-8a9d-a5138b2bcbfe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:53.834302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3836e92d-2e8b-4e13-8a9d-a5138b2bcbfe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:53.834807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3836e92d-2e8b-4e13-8a9d-a5138b2bcbfe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:53.835244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3836e92d-2e8b-4e13-8a9d-a5138b2bcbfe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:53.835931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3836e92d-2e8b-4e13-8a9d-a5138b2bcbfe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:53.836376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3836e92d-2e8b-4e13-8a9d-a5138b2bcbfe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:53.836800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3836e92d-2e8b-4e13-8a9d-a5138b2bcbfe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:53.840752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:53:53.969045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3836e92d-2e8b-4e13-8a9d-a5138b2bcbfe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:53.977574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3836e92d-2e8b-4e13-8a9d-a5138b2bcbfe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155213 Aug 31 00:53:53.978144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1409/2759] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:53 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:54.067982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:54.068588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:54.075747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:54.076222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:54.076653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:54.077329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:54.077779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:54.078189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:54.139578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:54.148153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:54.149583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:54.150707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e00a2ffb-5c9d-42f6-a2fd-380803a422fe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086635 Aug 31 00:53:54.151308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1351/2760] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:54.998354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ac54ba5e-d5cd-4106-a76b-3fee12363fcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:54.998958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ac54ba5e-d5cd-4106-a76b-3fee12363fcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:55.005365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac54ba5e-d5cd-4106-a76b-3fee12363fcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:55.005841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac54ba5e-d5cd-4106-a76b-3fee12363fcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:55.006272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac54ba5e-d5cd-4106-a76b-3fee12363fcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:55.006946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac54ba5e-d5cd-4106-a76b-3fee12363fcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:55.007429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac54ba5e-d5cd-4106-a76b-3fee12363fcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:55.007847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac54ba5e-d5cd-4106-a76b-3fee12363fcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:55.138166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ac54ba5e-d5cd-4106-a76b-3fee12363fcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:55.146455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ac54ba5e-d5cd-4106-a76b-3fee12363fcd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152096 Aug 31 00:53:55.147018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1410/2761] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:54 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:55.173426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:55.174037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:55.180387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:55.180868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:55.181308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:55.181987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:55.182437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:55.183624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:55.249821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:55.258362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:55.259826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:55.260948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b8e4669d-a4cc-423b-9b5b-cb06f2afbb14 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091417 Aug 31 00:53:55.261654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1352/2762] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:56.168157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ee59cacf-7fe9-4338-8ee2-578e1264e720 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:56.168789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ee59cacf-7fe9-4338-8ee2-578e1264e720 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:56.175562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee59cacf-7fe9-4338-8ee2-578e1264e720 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:56.176038 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee59cacf-7fe9-4338-8ee2-578e1264e720 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:56.176464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee59cacf-7fe9-4338-8ee2-578e1264e720 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:56.177139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee59cacf-7fe9-4338-8ee2-578e1264e720 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:56.177582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee59cacf-7fe9-4338-8ee2-578e1264e720 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:56.177995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ee59cacf-7fe9-4338-8ee2-578e1264e720 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:56.283493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:56.284089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:56.290381 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:56.290911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:56.291608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:56.292302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:56.293101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:56.293536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:56.306970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ee59cacf-7fe9-4338-8ee2-578e1264e720 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:56.316571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ee59cacf-7fe9-4338-8ee2-578e1264e720 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152328 Aug 31 00:53:56.317145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1411/2763] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:56.358298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:56.367162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:56.368610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:56.369747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ca4f60c8-a6d9-45f1-8c0f-6ca818e177c3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090301 Aug 31 00:53:56.370849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1353/2764] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:57.337651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9e369a54-2518-4147-a0f4-4149c4722be1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:57.338279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9e369a54-2518-4147-a0f4-4149c4722be1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:57.344891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e369a54-2518-4147-a0f4-4149c4722be1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:57.345371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e369a54-2518-4147-a0f4-4149c4722be1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:57.345821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e369a54-2518-4147-a0f4-4149c4722be1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:57.346487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e369a54-2518-4147-a0f4-4149c4722be1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:57.346940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e369a54-2518-4147-a0f4-4149c4722be1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:57.347388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e369a54-2518-4147-a0f4-4149c4722be1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:57.393039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:57.393643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:57.400068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:57.400551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:57.400986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:57.401734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:57.402243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:57.402669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:57.482844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:57.491524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:57.492972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:57.494114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a6eaf93d-52cf-4f53-af95-58ea10461a70 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.104967 Aug 31 00:53:57.494673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1354/2765] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:53:57.504101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9e369a54-2518-4147-a0f4-4149c4722be1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:57.512364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9e369a54-2518-4147-a0f4-4149c4722be1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.178552 Aug 31 00:53:57.512924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1412/2766] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:53:58.518172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:58.518850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:58.525249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:58.525726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:58.526156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:58.527239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:58.527703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:58.528128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:58.533676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-df071e60-b459-47f4-83cb-157e20c88c23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:58.534273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-df071e60-b459-47f4-83cb-157e20c88c23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:58.540624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df071e60-b459-47f4-83cb-157e20c88c23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:58.541100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df071e60-b459-47f4-83cb-157e20c88c23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:58.541530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df071e60-b459-47f4-83cb-157e20c88c23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:58.542208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df071e60-b459-47f4-83cb-157e20c88c23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:58.542655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df071e60-b459-47f4-83cb-157e20c88c23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:58.543112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df071e60-b459-47f4-83cb-157e20c88c23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:58.593242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:58.602595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:58.604066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:58.605577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f03fb84d-4bfd-495e-84b0-a55d2df08515 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091019 Aug 31 00:53:58.606155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1355/2767] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:58.686330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-df071e60-b459-47f4-83cb-157e20c88c23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:58.694372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-df071e60-b459-47f4-83cb-157e20c88c23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.164526 Aug 31 00:53:58.694922 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1413/2768] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:53:59.628802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:59.629409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:59.636467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:59.636933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:59.637365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:59.638042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:59.638481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:59.638895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:59.702781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:59.711371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:59.712828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:59.714559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-08fb460b-1572-4589-9e88-7066b2d3803f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089071 Aug 31 00:53:59.715128 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1356/2769] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:53:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:53:59.716265 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-18cab0e9-c7b0-48a4-be07-f5720e3697e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:53:59.716921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-18cab0e9-c7b0-48a4-be07-f5720e3697e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:53:59.723947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18cab0e9-c7b0-48a4-be07-f5720e3697e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:59.724431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18cab0e9-c7b0-48a4-be07-f5720e3697e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:59.725142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18cab0e9-c7b0-48a4-be07-f5720e3697e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:59.726314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18cab0e9-c7b0-48a4-be07-f5720e3697e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:53:59.726314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18cab0e9-c7b0-48a4-be07-f5720e3697e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:53:59.726772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-18cab0e9-c7b0-48a4-be07-f5720e3697e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:53:59.858032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-18cab0e9-c7b0-48a4-be07-f5720e3697e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:53:59.866546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-18cab0e9-c7b0-48a4-be07-f5720e3697e8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155760 Aug 31 00:53:59.867124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1414/2770] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:53:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:54:00.738303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:00.738898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:00.745797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:00.746357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:00.746788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:00.747493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:00.747939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:00.748355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:00.809222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:00.817708 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:00.819162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:00.820288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8f3741ee-6776-4ae8-b0f3-9fc9e3f687d7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085959 Aug 31 00:54:00.820863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1357/2771] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:00.887455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a3120538-d625-4ac5-8e37-c0ffb9e8234d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:00.888062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a3120538-d625-4ac5-8e37-c0ffb9e8234d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:00.895213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3120538-d625-4ac5-8e37-c0ffb9e8234d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:00.895693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3120538-d625-4ac5-8e37-c0ffb9e8234d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:00.896118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3120538-d625-4ac5-8e37-c0ffb9e8234d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:00.896794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3120538-d625-4ac5-8e37-c0ffb9e8234d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:00.897236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3120538-d625-4ac5-8e37-c0ffb9e8234d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:00.897650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3120538-d625-4ac5-8e37-c0ffb9e8234d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:01.031026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a3120538-d625-4ac5-8e37-c0ffb9e8234d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:01.039056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a3120538-d625-4ac5-8e37-c0ffb9e8234d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155621 Aug 31 00:54:01.039647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1415/2772] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:00 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:01.842450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:01.843077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:01.849781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:01.850256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:01.850685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:01.851388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:01.851836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:01.852254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:01.916471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:01.925706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:01.927180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:01.928319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b2badee4-1b96-4177-a3c1-facc75b80329 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089793 Aug 31 00:54:01.928875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1358/2773] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:02.060833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8398d8a2-4dcf-42e3-86fa-c5fc9f38e31a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:02.061420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8398d8a2-4dcf-42e3-86fa-c5fc9f38e31a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:02.067848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8398d8a2-4dcf-42e3-86fa-c5fc9f38e31a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:02.068321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8398d8a2-4dcf-42e3-86fa-c5fc9f38e31a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:02.068746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8398d8a2-4dcf-42e3-86fa-c5fc9f38e31a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:02.069420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8398d8a2-4dcf-42e3-86fa-c5fc9f38e31a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:02.069863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8398d8a2-4dcf-42e3-86fa-c5fc9f38e31a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:02.070277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8398d8a2-4dcf-42e3-86fa-c5fc9f38e31a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:02.244536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8398d8a2-4dcf-42e3-86fa-c5fc9f38e31a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:02.253081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8398d8a2-4dcf-42e3-86fa-c5fc9f38e31a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.196167 Aug 31 00:54:02.253646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1416/2774] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:02.954135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:02.954697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:02.961058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:02.961553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:02.961977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:02.962645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:02.963110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:02.963524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:02.966240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:03.028815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:03.037358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:03.038778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:03.039917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e1a75ef6-a4be-4f64-a6ea-92fb70808d88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092297 Aug 31 00:54:03.040465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1359/2775] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:02 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:03.274823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7cae4f70-c00d-44e4-b632-7f43d7d7017f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:03.275547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7cae4f70-c00d-44e4-b632-7f43d7d7017f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:03.283196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cae4f70-c00d-44e4-b632-7f43d7d7017f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:03.283901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cae4f70-c00d-44e4-b632-7f43d7d7017f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:03.284338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cae4f70-c00d-44e4-b632-7f43d7d7017f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:03.285029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cae4f70-c00d-44e4-b632-7f43d7d7017f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:03.285674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cae4f70-c00d-44e4-b632-7f43d7d7017f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:03.286086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cae4f70-c00d-44e4-b632-7f43d7d7017f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:03.439076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7cae4f70-c00d-44e4-b632-7f43d7d7017f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:03.447637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7cae4f70-c00d-44e4-b632-7f43d7d7017f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.176509 Aug 31 00:54:03.449056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1417/2776] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:04.062720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:04.063361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:04.069856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:04.070362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:04.071157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:04.071734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:04.072269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:04.072803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:04.179291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:04.188612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:04.190061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:04.191227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1f726d4a-5858-4381-9d47-9474b9037b8d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.132463 Aug 31 00:54:04.191788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1360/2777] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:04.470062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0088826a-a300-4cb1-a092-4935e30b9b28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:04.470625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0088826a-a300-4cb1-a092-4935e30b9b28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:04.477415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0088826a-a300-4cb1-a092-4935e30b9b28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:04.477897 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0088826a-a300-4cb1-a092-4935e30b9b28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:04.478331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0088826a-a300-4cb1-a092-4935e30b9b28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:04.479019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0088826a-a300-4cb1-a092-4935e30b9b28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:04.480333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0088826a-a300-4cb1-a092-4935e30b9b28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:04.481003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0088826a-a300-4cb1-a092-4935e30b9b28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:04.611173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0088826a-a300-4cb1-a092-4935e30b9b28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:04.619396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0088826a-a300-4cb1-a092-4935e30b9b28 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153309 Aug 31 00:54:04.620006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1418/2778] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:05.214163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:05.214767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:05.221188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:05.221668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:05.222096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:05.223064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:05.223521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:05.223943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:05.285779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:05.294754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:05.296236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:05.297361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1dd1aa6f-eec5-4d24-b3c5-e4d50fdbe061 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087040 Aug 31 00:54:05.297919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1361/2779] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:05.640962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a4b5a69b-039f-4496-aee1-ca3bd0a57b94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:05.641564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a4b5a69b-039f-4496-aee1-ca3bd0a57b94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:05.648035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b5a69b-039f-4496-aee1-ca3bd0a57b94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:05.648514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b5a69b-039f-4496-aee1-ca3bd0a57b94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:05.648941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b5a69b-039f-4496-aee1-ca3bd0a57b94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:05.649623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b5a69b-039f-4496-aee1-ca3bd0a57b94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:05.650066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b5a69b-039f-4496-aee1-ca3bd0a57b94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:05.650482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4b5a69b-039f-4496-aee1-ca3bd0a57b94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:05.780714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4b5a69b-039f-4496-aee1-ca3bd0a57b94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:05.789263 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a4b5a69b-039f-4496-aee1-ca3bd0a57b94 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152546 Aug 31 00:54:05.789829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1419/2780] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:06.321519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:06.322165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:06.329419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:06.329904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:06.330340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:06.331021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:06.331520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:06.331944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:06.398138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:06.408068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:06.409518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:06.410648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a3424ed6-d244-472b-aa51-acfeafe880be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.093050 Aug 31 00:54:06.411228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1362/2781] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:06.812881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5c1c7d15-a1f2-4e36-a143-3dbd0ca0f4a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:06.813471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5c1c7d15-a1f2-4e36-a143-3dbd0ca0f4a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:06.820640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1c7d15-a1f2-4e36-a143-3dbd0ca0f4a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:06.821142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1c7d15-a1f2-4e36-a143-3dbd0ca0f4a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:06.821577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1c7d15-a1f2-4e36-a143-3dbd0ca0f4a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:06.822257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1c7d15-a1f2-4e36-a143-3dbd0ca0f4a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:06.822704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1c7d15-a1f2-4e36-a143-3dbd0ca0f4a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:06.824362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c1c7d15-a1f2-4e36-a143-3dbd0ca0f4a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:06.957193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5c1c7d15-a1f2-4e36-a143-3dbd0ca0f4a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:06.965890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5c1c7d15-a1f2-4e36-a143-3dbd0ca0f4a4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157001 Aug 31 00:54:06.966512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1420/2782] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:06 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:07.433657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:07.434295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:07.440909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:07.441392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:07.441823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:07.442502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:07.442955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:07.443472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:07.507739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:07.516715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:07.518161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:07.519325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4e7443c1-b8c3-40a5-915b-d29ff9e0d9b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089586 Aug 31 00:54:07.519889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1363/2783] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:07.989688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-919859a7-8b67-4e11-9d24-7e02a5831973 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:07.990291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-919859a7-8b67-4e11-9d24-7e02a5831973 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:07.997601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-919859a7-8b67-4e11-9d24-7e02a5831973 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:07.998085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-919859a7-8b67-4e11-9d24-7e02a5831973 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:07.998523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-919859a7-8b67-4e11-9d24-7e02a5831973 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:07.999246 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-919859a7-8b67-4e11-9d24-7e02a5831973 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:07.999709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-919859a7-8b67-4e11-9d24-7e02a5831973 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:08.000127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-919859a7-8b67-4e11-9d24-7e02a5831973 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:08.139339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-919859a7-8b67-4e11-9d24-7e02a5831973 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:08.147438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-919859a7-8b67-4e11-9d24-7e02a5831973 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.161654 Aug 31 00:54:08.147994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1421/2784] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:08.543418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:08.544004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:08.550647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:08.551157 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:08.551587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:08.552260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:08.552705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:08.553117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:08.614723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:08.624397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:08.625812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:08.626933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-517c06ba-5142-413a-ba3f-56a25e100080 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088166 Aug 31 00:54:08.627510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1364/2785] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:09.168995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fdfc7d59-1a4d-4bd5-af3c-3981b762d8d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:09.169604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fdfc7d59-1a4d-4bd5-af3c-3981b762d8d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:09.176076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdfc7d59-1a4d-4bd5-af3c-3981b762d8d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:09.176559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdfc7d59-1a4d-4bd5-af3c-3981b762d8d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:09.176994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdfc7d59-1a4d-4bd5-af3c-3981b762d8d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:09.177679 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdfc7d59-1a4d-4bd5-af3c-3981b762d8d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:09.178130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdfc7d59-1a4d-4bd5-af3c-3981b762d8d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:09.178553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdfc7d59-1a4d-4bd5-af3c-3981b762d8d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:09.309493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fdfc7d59-1a4d-4bd5-af3c-3981b762d8d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:09.317573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fdfc7d59-1a4d-4bd5-af3c-3981b762d8d6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152912 Aug 31 00:54:09.318144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1422/2786] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:09.653256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:09.654414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:09.663017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:09.663521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:09.663944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:09.664623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:09.665064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:09.665478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:09.732769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:09.741604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:09.743065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:09.744186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e6fa4fa2-c1a7-46cb-a2b5-0d5b6e5ade42 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.098110 Aug 31 00:54:09.744741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1365/2787] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:10.340570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-32cf69f6-b0e0-428a-97cb-ff4ea8cacd88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:10.341174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-32cf69f6-b0e0-428a-97cb-ff4ea8cacd88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:10.347822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32cf69f6-b0e0-428a-97cb-ff4ea8cacd88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:10.348297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32cf69f6-b0e0-428a-97cb-ff4ea8cacd88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:10.348722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32cf69f6-b0e0-428a-97cb-ff4ea8cacd88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:10.349389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32cf69f6-b0e0-428a-97cb-ff4ea8cacd88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:10.349832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32cf69f6-b0e0-428a-97cb-ff4ea8cacd88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:10.350247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32cf69f6-b0e0-428a-97cb-ff4ea8cacd88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:10.478403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-32cf69f6-b0e0-428a-97cb-ff4ea8cacd88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:10.487642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-32cf69f6-b0e0-428a-97cb-ff4ea8cacd88 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151664 Aug 31 00:54:10.488213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1423/2788] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:10.766976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:10.767549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:10.769850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=54 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:10.775026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:10.775525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:10.775952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:10.776630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:10.777823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:10.778249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:10.838391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:10.848042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:10.849475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:10.850599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a820745c-add2-4a00-914e-38c7f2287cf2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087721 Aug 31 00:54:10.851184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1366/2789] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:11.509127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-22f3f3bc-a3e2-432e-90ba-d267585abee2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:11.509720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-22f3f3bc-a3e2-432e-90ba-d267585abee2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:11.516641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22f3f3bc-a3e2-432e-90ba-d267585abee2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:11.517112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22f3f3bc-a3e2-432e-90ba-d267585abee2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:11.517535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22f3f3bc-a3e2-432e-90ba-d267585abee2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:11.518204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22f3f3bc-a3e2-432e-90ba-d267585abee2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:11.518647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22f3f3bc-a3e2-432e-90ba-d267585abee2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:11.519073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-22f3f3bc-a3e2-432e-90ba-d267585abee2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:11.649789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-22f3f3bc-a3e2-432e-90ba-d267585abee2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:11.659575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-22f3f3bc-a3e2-432e-90ba-d267585abee2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154221 Aug 31 00:54:11.660148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1424/2790] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:11.874422 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:11.875046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:11.881504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:11.881986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:11.882419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:11.883130 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:11.883584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:11.884004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:11.944610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:11.954256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:11.955734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:11.956870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e409fe9f-f84c-4269-ab29-cc9e0b2b8dc7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087379 Aug 31 00:54:11.957426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1367/2791] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:12.680817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0409582c-ae56-43a6-8dc7-3d8b88192d85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:12.681509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0409582c-ae56-43a6-8dc7-3d8b88192d85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:12.688279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0409582c-ae56-43a6-8dc7-3d8b88192d85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:12.688774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0409582c-ae56-43a6-8dc7-3d8b88192d85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:12.689210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0409582c-ae56-43a6-8dc7-3d8b88192d85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:12.689902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0409582c-ae56-43a6-8dc7-3d8b88192d85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:12.690357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0409582c-ae56-43a6-8dc7-3d8b88192d85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:12.690779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0409582c-ae56-43a6-8dc7-3d8b88192d85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:12.856556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0409582c-ae56-43a6-8dc7-3d8b88192d85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:12.858738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:12.866167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0409582c-ae56-43a6-8dc7-3d8b88192d85 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.189338 Aug 31 00:54:12.866738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1425/2792] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:12.979630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:12.980232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:12.986703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:12.987208 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:12.987641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:12.988323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:12.988776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:12.989198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:13.068123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:13.077743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:13.079219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:13.080361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6dc5d928-dba4-46b9-8149-ed895104909d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.104667 Aug 31 00:54:13.080930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1368/2793] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:13.887644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d6401124-04f1-45f6-a8f4-f7021950495b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:13.888269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d6401124-04f1-45f6-a8f4-f7021950495b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:13.894647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6401124-04f1-45f6-a8f4-f7021950495b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:13.895159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6401124-04f1-45f6-a8f4-f7021950495b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:13.895594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6401124-04f1-45f6-a8f4-f7021950495b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:13.896310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6401124-04f1-45f6-a8f4-f7021950495b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:13.896763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6401124-04f1-45f6-a8f4-f7021950495b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:13.897181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d6401124-04f1-45f6-a8f4-f7021950495b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:14.027746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d6401124-04f1-45f6-a8f4-f7021950495b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:14.035781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d6401124-04f1-45f6-a8f4-f7021950495b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152137 Aug 31 00:54:14.036341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1426/2794] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:13 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:14.103727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:14.104326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:14.111486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:14.111953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:14.112374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:14.113045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:14.113539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:14.113963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:14.180259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:14.188931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:14.190360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:14.191521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-628283d0-9507-45c7-98c5-547ea11b5d90 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091629 Aug 31 00:54:14.192069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1369/2795] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:15.056895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e20e6863-ae0c-4cc5-a485-6c579d62b9eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:15.057497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e20e6863-ae0c-4cc5-a485-6c579d62b9eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:15.064432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e20e6863-ae0c-4cc5-a485-6c579d62b9eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:15.064904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e20e6863-ae0c-4cc5-a485-6c579d62b9eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:15.065331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e20e6863-ae0c-4cc5-a485-6c579d62b9eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:15.066013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e20e6863-ae0c-4cc5-a485-6c579d62b9eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:15.066455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e20e6863-ae0c-4cc5-a485-6c579d62b9eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:15.066868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e20e6863-ae0c-4cc5-a485-6c579d62b9eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:15.200956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e20e6863-ae0c-4cc5-a485-6c579d62b9eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:15.209106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e20e6863-ae0c-4cc5-a485-6c579d62b9eb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156056 Aug 31 00:54:15.209829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1427/2796] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:15.214408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:15.215103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:15.221792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:15.222541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:15.222968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:15.223673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:15.224118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:15.224534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:15.285572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:15.294789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:15.296256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:15.297526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e1bbaa34-8a3f-46dd-a057-157601b0b65b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087014 Aug 31 00:54:15.298049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1370/2797] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:16.230902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0f04566b-f6f0-45a0-bf01-c1239e26f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:16.231601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0f04566b-f6f0-45a0-bf01-c1239e26f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:16.233908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:16.239269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f04566b-f6f0-45a0-bf01-c1239e26f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:16.239752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f04566b-f6f0-45a0-bf01-c1239e26f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:16.240185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f04566b-f6f0-45a0-bf01-c1239e26f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:16.240868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f04566b-f6f0-45a0-bf01-c1239e26f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:16.241346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f04566b-f6f0-45a0-bf01-c1239e26f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:16.241766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f04566b-f6f0-45a0-bf01-c1239e26f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:16.320606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:16.321220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:16.328838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:16.329328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:16.329766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:16.330460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:16.330914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:16.331367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:16.386787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0f04566b-f6f0-45a0-bf01-c1239e26f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:16.396143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0f04566b-f6f0-45a0-bf01-c1239e26f3bf tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.169392 Aug 31 00:54:16.396817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1428/2798] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:16.403194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:16.412107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:16.413545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:16.414682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-15deeb7c-90be-46a7-999d-9682e975c7bb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.098004 Aug 31 00:54:16.415262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1371/2799] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:54:17.418301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4da89924-d7c7-4141-8aff-1319733a8b34 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:17.418895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4da89924-d7c7-4141-8aff-1319733a8b34 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:17.425463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4da89924-d7c7-4141-8aff-1319733a8b34 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:17.425949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4da89924-d7c7-4141-8aff-1319733a8b34 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:17.426386 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4da89924-d7c7-4141-8aff-1319733a8b34 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:17.427101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4da89924-d7c7-4141-8aff-1319733a8b34 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:17.427553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4da89924-d7c7-4141-8aff-1319733a8b34 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:17.427978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4da89924-d7c7-4141-8aff-1319733a8b34 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:17.437897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:17.438504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:17.445073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:17.445592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:17.446030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:17.446717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:17.447204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:17.447625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:17.526726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:17.535373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:17.536797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:17.537924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d27e420f-b62f-4071-97d8-5b8c2871b38e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.103890 Aug 31 00:54:17.538477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1372/2800] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:54:17.584454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4da89924-d7c7-4141-8aff-1319733a8b34 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:17.592640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4da89924-d7c7-4141-8aff-1319733a8b34 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.178815 Aug 31 00:54:17.593202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1429/2801] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:18.561055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:18.564162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:18.568144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:18.568631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:18.569089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:18.569779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:18.570230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:18.570653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:18.615270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6d929e7a-9f83-460d-b4c0-220642bcc374 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:18.615864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6d929e7a-9f83-460d-b4c0-220642bcc374 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:18.623676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d929e7a-9f83-460d-b4c0-220642bcc374 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:18.624166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d929e7a-9f83-460d-b4c0-220642bcc374 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:18.624597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d929e7a-9f83-460d-b4c0-220642bcc374 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:18.625291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d929e7a-9f83-460d-b4c0-220642bcc374 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:18.625740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d929e7a-9f83-460d-b4c0-220642bcc374 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:18.626160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d929e7a-9f83-460d-b4c0-220642bcc374 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:18.635278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:18.656475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:18.657925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:18.659089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2c7fb829-d044-41bb-a9cc-1defb79b1f4a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.102596 Aug 31 00:54:18.659658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1373/2802] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:18.772183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6d929e7a-9f83-460d-b4c0-220642bcc374 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:18.780447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6d929e7a-9f83-460d-b4c0-220642bcc374 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.169523 Aug 31 00:54:18.781012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1430/2803] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:18 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:54:19.681871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:19.682466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:19.689652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:19.690141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:19.690572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:19.691317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:19.692059 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:19.692559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:19.760080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:19.769293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:19.770725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:19.771883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f9ab30d6-3e20-48be-9648-4974d0621c35 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.094012 Aug 31 00:54:19.772435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1374/2804] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:19.801573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a88ef652-64d6-4d05-8f93-49a9cae53c95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:19.802264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a88ef652-64d6-4d05-8f93-49a9cae53c95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:19.809118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88ef652-64d6-4d05-8f93-49a9cae53c95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:19.809591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88ef652-64d6-4d05-8f93-49a9cae53c95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:19.810022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88ef652-64d6-4d05-8f93-49a9cae53c95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:19.810703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88ef652-64d6-4d05-8f93-49a9cae53c95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:19.811179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88ef652-64d6-4d05-8f93-49a9cae53c95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:19.811599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88ef652-64d6-4d05-8f93-49a9cae53c95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:19.943733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a88ef652-64d6-4d05-8f93-49a9cae53c95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:19.952083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a88ef652-64d6-4d05-8f93-49a9cae53c95 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154317 Aug 31 00:54:19.952642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1431/2805] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:19 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:20.794170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:20.794847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:20.801178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:20.801656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:20.802085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:20.802767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:20.803242 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:20.803674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:20.864643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:20.866807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:20.875391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:20.876836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:20.877972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-652bf1dd-7d71-43e3-8c6d-ed67556130ef tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087870 Aug 31 00:54:20.878531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1375/2806] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:20.974381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-95d5e24c-e148-49d3-b5c8-71c7e819076c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:20.975017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-95d5e24c-e148-49d3-b5c8-71c7e819076c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:20.981186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95d5e24c-e148-49d3-b5c8-71c7e819076c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:20.981668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95d5e24c-e148-49d3-b5c8-71c7e819076c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:20.982109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95d5e24c-e148-49d3-b5c8-71c7e819076c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:20.982792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95d5e24c-e148-49d3-b5c8-71c7e819076c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:20.983279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95d5e24c-e148-49d3-b5c8-71c7e819076c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:20.983700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95d5e24c-e148-49d3-b5c8-71c7e819076c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:21.113283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-95d5e24c-e148-49d3-b5c8-71c7e819076c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:21.122540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-95d5e24c-e148-49d3-b5c8-71c7e819076c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152437 Aug 31 00:54:21.123128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1432/2807] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:21.901544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:21.902175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:21.908794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:21.909269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:21.909696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:21.910447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:21.910840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:21.911300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:21.976105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:21.985532 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:21.986988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:21.988181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-222d49c3-643b-49c4-81f2-733ae52dff5d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090704 Aug 31 00:54:21.988767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1376/2808] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:22.143858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7e623499-d2c1-4319-a9d1-ba5a37efbfac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:22.144494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7e623499-d2c1-4319-a9d1-ba5a37efbfac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:22.150914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e623499-d2c1-4319-a9d1-ba5a37efbfac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:22.151585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e623499-d2c1-4319-a9d1-ba5a37efbfac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:22.152003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e623499-d2c1-4319-a9d1-ba5a37efbfac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:22.152697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e623499-d2c1-4319-a9d1-ba5a37efbfac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:22.153253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e623499-d2c1-4319-a9d1-ba5a37efbfac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:22.153680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e623499-d2c1-4319-a9d1-ba5a37efbfac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:22.280419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7e623499-d2c1-4319-a9d1-ba5a37efbfac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:22.288613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7e623499-d2c1-4319-a9d1-ba5a37efbfac tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148657 Aug 31 00:54:22.289178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1433/2809] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:22 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:23.011957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:23.012565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:23.014776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:54:23.014919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:54:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 (ip 10.222.0.67) !!! Aug 31 00:54:23.022691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:23.023189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:23.023617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:23.024295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:23.024737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:23.025150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:23.092654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:23.101805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:23.103287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:23.104431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-450a0f9f-cb00-4182-ad7f-69500d63ce43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.096386 Aug 31 00:54:23.105847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1377/2810] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:23.311461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9c5b52b7-ecec-4144-98eb-3c6a15936c5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:23.311996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9c5b52b7-ecec-4144-98eb-3c6a15936c5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:23.313948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:54:23.314118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:54:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 (ip 10.222.0.67) !!! Aug 31 00:54:23.315131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:54:23.315247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:54:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 (ip 10.222.0.67) !!! Aug 31 00:54:23.322535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c5b52b7-ecec-4144-98eb-3c6a15936c5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:23.323014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c5b52b7-ecec-4144-98eb-3c6a15936c5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:23.323520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c5b52b7-ecec-4144-98eb-3c6a15936c5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:23.324257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c5b52b7-ecec-4144-98eb-3c6a15936c5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:23.324741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c5b52b7-ecec-4144-98eb-3c6a15936c5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:23.325160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c5b52b7-ecec-4144-98eb-3c6a15936c5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:23.463487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9c5b52b7-ecec-4144-98eb-3c6a15936c5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:23.472616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9c5b52b7-ecec-4144-98eb-3c6a15936c5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.165208 Aug 31 00:54:23.473204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1434/2811] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:24.127816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:24.128426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:24.134776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:24.135285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:24.135719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:24.136401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:24.136843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:24.137284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:24.199609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:24.208008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:24.209435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:24.210560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f6292781-61b1-48f1-9ef5-f8762d547d54 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086755 Aug 31 00:54:24.211144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1378/2812] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:24.493888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-126e2a12-ed4e-4c8a-8e65-f523ac5ab4b2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:24.494491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-126e2a12-ed4e-4c8a-8e65-f523ac5ab4b2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:24.501641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-126e2a12-ed4e-4c8a-8e65-f523ac5ab4b2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:24.502120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-126e2a12-ed4e-4c8a-8e65-f523ac5ab4b2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:24.502552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-126e2a12-ed4e-4c8a-8e65-f523ac5ab4b2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:24.503425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-126e2a12-ed4e-4c8a-8e65-f523ac5ab4b2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:24.503877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-126e2a12-ed4e-4c8a-8e65-f523ac5ab4b2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:24.504301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-126e2a12-ed4e-4c8a-8e65-f523ac5ab4b2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:24.630363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-126e2a12-ed4e-4c8a-8e65-f523ac5ab4b2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:24.639273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-126e2a12-ed4e-4c8a-8e65-f523ac5ab4b2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149232 Aug 31 00:54:24.639849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1435/2813] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:25.233412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:25.234043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:25.240665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:25.241138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:25.241561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:25.242233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:25.242678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:25.243116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:25.308991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:25.318670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:25.320135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:25.321275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0dcf583a-22eb-4963-8142-3c4dc5c47a9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091823 Aug 31 00:54:25.321838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1379/2814] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:25.661637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-77bc33c0-2897-4b7c-af53-4a023384eabe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:25.662261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-77bc33c0-2897-4b7c-af53-4a023384eabe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:25.669293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77bc33c0-2897-4b7c-af53-4a023384eabe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:25.669772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77bc33c0-2897-4b7c-af53-4a023384eabe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:25.670198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77bc33c0-2897-4b7c-af53-4a023384eabe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:25.670869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77bc33c0-2897-4b7c-af53-4a023384eabe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:25.671344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77bc33c0-2897-4b7c-af53-4a023384eabe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:25.671759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-77bc33c0-2897-4b7c-af53-4a023384eabe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:25.803519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-77bc33c0-2897-4b7c-af53-4a023384eabe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:25.812087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-77bc33c0-2897-4b7c-af53-4a023384eabe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154269 Aug 31 00:54:25.812652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1436/2815] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:26.345122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:26.345758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:26.352499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:26.352964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:26.353395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:26.354062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:26.354998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:26.355438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:26.418903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:26.430297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:26.431778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:26.433158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-501c3fa7-124e-4991-a581-b7334a257ace tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091700 Aug 31 00:54:26.433913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1380/2816] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:26.838104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0e26533-f7fe-4f50-9a7b-1e32fc1e9ec1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:26.839251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0e26533-f7fe-4f50-9a7b-1e32fc1e9ec1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:26.847604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e26533-f7fe-4f50-9a7b-1e32fc1e9ec1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:26.848188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e26533-f7fe-4f50-9a7b-1e32fc1e9ec1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:26.848767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e26533-f7fe-4f50-9a7b-1e32fc1e9ec1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:26.849905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e26533-f7fe-4f50-9a7b-1e32fc1e9ec1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:26.850357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e26533-f7fe-4f50-9a7b-1e32fc1e9ec1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:26.851160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0e26533-f7fe-4f50-9a7b-1e32fc1e9ec1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:27.015986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0e26533-f7fe-4f50-9a7b-1e32fc1e9ec1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:27.025414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0e26533-f7fe-4f50-9a7b-1e32fc1e9ec1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.192956 Aug 31 00:54:27.025994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1437/2817] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:26 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:27.457879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:27.458441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:27.465688 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:27.466177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:27.466620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:27.467336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:27.467788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:27.468210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:27.532637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:27.541436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:27.542924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:27.544094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a5e9ab37-125f-4b56-a629-0d437d698626 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090265 Aug 31 00:54:27.544650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1381/2818] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:28.048424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2c4d4988-5290-44fe-82f2-a1284c1bfb10 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:28.049024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2c4d4988-5290-44fe-82f2-a1284c1bfb10 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:28.055522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c4d4988-5290-44fe-82f2-a1284c1bfb10 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:28.055999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c4d4988-5290-44fe-82f2-a1284c1bfb10 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:28.056436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c4d4988-5290-44fe-82f2-a1284c1bfb10 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:28.057112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c4d4988-5290-44fe-82f2-a1284c1bfb10 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:28.058308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c4d4988-5290-44fe-82f2-a1284c1bfb10 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:28.058745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c4d4988-5290-44fe-82f2-a1284c1bfb10 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:28.185118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2c4d4988-5290-44fe-82f2-a1284c1bfb10 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:28.193255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2c4d4988-5290-44fe-82f2-a1284c1bfb10 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148744 Aug 31 00:54:28.193856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1438/2819] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:28.567452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:28.568077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:28.576521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:28.577007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:28.577445 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:28.578137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:28.578596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:28.579021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:28.643645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:28.652651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:28.654100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:28.655271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e8728492-4969-48d3-9a06-8d01aa96f0d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091809 Aug 31 00:54:28.655829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1382/2820] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:29.214846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5be70c37-e55d-44c4-8d36-2654970c9660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:29.215465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5be70c37-e55d-44c4-8d36-2654970c9660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:29.222138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5be70c37-e55d-44c4-8d36-2654970c9660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:29.222614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5be70c37-e55d-44c4-8d36-2654970c9660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:29.223052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5be70c37-e55d-44c4-8d36-2654970c9660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:29.223733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5be70c37-e55d-44c4-8d36-2654970c9660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:29.224174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5be70c37-e55d-44c4-8d36-2654970c9660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:29.224588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5be70c37-e55d-44c4-8d36-2654970c9660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:29.352526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5be70c37-e55d-44c4-8d36-2654970c9660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:29.361580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5be70c37-e55d-44c4-8d36-2654970c9660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151088 Aug 31 00:54:29.362153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1439/2821] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:29.677757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:29.678366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:29.685714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:29.686199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:29.686629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:29.687349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:29.687798 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:29.688213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:29.752044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:29.761413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:29.763188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:29.764326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0fa97718-ce85-4851-b31e-7c340e642453 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090490 Aug 31 00:54:29.764877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1383/2822] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:30.385373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-20cf389e-256e-4703-93d2-d981832f21c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:30.386879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-20cf389e-256e-4703-93d2-d981832f21c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:30.393524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20cf389e-256e-4703-93d2-d981832f21c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:30.394004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20cf389e-256e-4703-93d2-d981832f21c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:30.394440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20cf389e-256e-4703-93d2-d981832f21c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:30.395149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20cf389e-256e-4703-93d2-d981832f21c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:30.395600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20cf389e-256e-4703-93d2-d981832f21c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:30.396019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20cf389e-256e-4703-93d2-d981832f21c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:30.527093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-20cf389e-256e-4703-93d2-d981832f21c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:30.535377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-20cf389e-256e-4703-93d2-d981832f21c7 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157412 Aug 31 00:54:30.535941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1440/2823] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:30.787227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:30.787777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:30.794555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:30.795023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:30.795470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:30.796146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:30.796593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:30.797011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:30.861689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:30.871104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:30.872560 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:30.873687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-09152e7f-9099-402a-ac2a-67d1c3944820 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090472 Aug 31 00:54:30.874241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1384/2824] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:31.556785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-159e1af7-01db-4d70-8d11-6b867312aafe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:31.557416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-159e1af7-01db-4d70-8d11-6b867312aafe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:31.563936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-159e1af7-01db-4d70-8d11-6b867312aafe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:31.564448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-159e1af7-01db-4d70-8d11-6b867312aafe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:31.564877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-159e1af7-01db-4d70-8d11-6b867312aafe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:31.565558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-159e1af7-01db-4d70-8d11-6b867312aafe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:31.566006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-159e1af7-01db-4d70-8d11-6b867312aafe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:31.566423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-159e1af7-01db-4d70-8d11-6b867312aafe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:31.692723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-159e1af7-01db-4d70-8d11-6b867312aafe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:31.701801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-159e1af7-01db-4d70-8d11-6b867312aafe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148861 Aug 31 00:54:31.702368 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1441/2825] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:31.895693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:31.896226 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:31.903392 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:31.903873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:31.904309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:31.904994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:31.905448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:31.905869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:31.969730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:31.978811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:31.980460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:31.981585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b9cbc831-7ba7-4f1a-875d-01e370147a7d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089868 Aug 31 00:54:31.982158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1385/2826] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:32.724090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3e75ff22-51f1-4089-9e1a-af19f62895c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:32.724700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3e75ff22-51f1-4089-9e1a-af19f62895c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:32.732714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e75ff22-51f1-4089-9e1a-af19f62895c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:32.733199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e75ff22-51f1-4089-9e1a-af19f62895c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:32.733639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e75ff22-51f1-4089-9e1a-af19f62895c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:32.734328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e75ff22-51f1-4089-9e1a-af19f62895c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:32.734781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e75ff22-51f1-4089-9e1a-af19f62895c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:32.735233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3e75ff22-51f1-4089-9e1a-af19f62895c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:32.751209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:32.869035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3e75ff22-51f1-4089-9e1a-af19f62895c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:32.878133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3e75ff22-51f1-4089-9e1a-af19f62895c5 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.158187 Aug 31 00:54:32.878705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1442/2827] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:54:33.004698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:33.005424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:33.012471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:33.012948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:33.013385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:33.014065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:33.014511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:33.014930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:33.076944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:33.085467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:33.086891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:33.088041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-90bdaa9c-5149-43f2-90fc-17559a90045a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087282 Aug 31 00:54:33.088663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1386/2828] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:32 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:33.899907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-13885645-3764-45fb-8229-e388104b4b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:33.900505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-13885645-3764-45fb-8229-e388104b4b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:33.907764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13885645-3764-45fb-8229-e388104b4b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:33.908243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13885645-3764-45fb-8229-e388104b4b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:33.908675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13885645-3764-45fb-8229-e388104b4b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:33.909348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13885645-3764-45fb-8229-e388104b4b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:33.909801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13885645-3764-45fb-8229-e388104b4b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:33.910216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13885645-3764-45fb-8229-e388104b4b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:34.043457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13885645-3764-45fb-8229-e388104b4b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:34.051686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-13885645-3764-45fb-8229-e388104b4b8a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155681 Aug 31 00:54:34.052250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1443/2829] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:33 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:34.110262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:34.111212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:34.118202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:34.118915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:34.119576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:34.120634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:34.121126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:34.121552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:34.182777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:34.191462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:34.192899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:34.194027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1785d5e9-5822-45c4-9473-ba28933f7f6d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088090 Aug 31 00:54:34.194601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1387/2830] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:35.075053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e1959106-a3a1-427b-bda3-564d38f54b5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:35.075685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e1959106-a3a1-427b-bda3-564d38f54b5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:35.083063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1959106-a3a1-427b-bda3-564d38f54b5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:35.083550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1959106-a3a1-427b-bda3-564d38f54b5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:35.084017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1959106-a3a1-427b-bda3-564d38f54b5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:35.085021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1959106-a3a1-427b-bda3-564d38f54b5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:35.085622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1959106-a3a1-427b-bda3-564d38f54b5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:35.086052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e1959106-a3a1-427b-bda3-564d38f54b5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:35.214521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e1959106-a3a1-427b-bda3-564d38f54b5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:35.217471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:35.218119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:35.223130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e1959106-a3a1-427b-bda3-564d38f54b5d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153842 Aug 31 00:54:35.227144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1444/2831] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:35.227310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:35.227310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:35.227310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:35.227310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:35.227734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:35.227734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:35.291281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:35.300429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:35.301893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:35.303020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e9fd3e03-e1f8-4a44-b2df-71c071e76124 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089671 Aug 31 00:54:35.303613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1388/2832] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:54:36.244819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dc506efd-44ba-4b6b-8c68-064a7e3d1056 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:36.245461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dc506efd-44ba-4b6b-8c68-064a7e3d1056 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:36.251814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc506efd-44ba-4b6b-8c68-064a7e3d1056 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:36.252296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc506efd-44ba-4b6b-8c68-064a7e3d1056 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:36.252731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc506efd-44ba-4b6b-8c68-064a7e3d1056 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:36.253408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc506efd-44ba-4b6b-8c68-064a7e3d1056 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:36.253858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc506efd-44ba-4b6b-8c68-064a7e3d1056 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:36.254278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc506efd-44ba-4b6b-8c68-064a7e3d1056 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:36.326859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:36.327521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:36.334043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:36.334524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:36.334959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:36.335691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:36.336143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:36.336567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:36.407088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dc506efd-44ba-4b6b-8c68-064a7e3d1056 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:36.409252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:36.415767 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dc506efd-44ba-4b6b-8c68-064a7e3d1056 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.174870 Aug 31 00:54:36.416332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1445/2833] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:36.419561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:36.421005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:36.422146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f0256902-149c-464b-b48f-fbf6e637a111 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.100118 Aug 31 00:54:36.422696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1389/2834] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:54:37.442117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-acac2099-6bba-4b91-8851-fd5e9c1ae1a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:37.442710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-acac2099-6bba-4b91-8851-fd5e9c1ae1a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:37.445075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:37.445685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:37.450220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acac2099-6bba-4b91-8851-fd5e9c1ae1a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:37.450707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acac2099-6bba-4b91-8851-fd5e9c1ae1a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:37.451177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acac2099-6bba-4b91-8851-fd5e9c1ae1a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:37.451869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acac2099-6bba-4b91-8851-fd5e9c1ae1a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:37.452347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acac2099-6bba-4b91-8851-fd5e9c1ae1a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:37.452757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:37.452875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-acac2099-6bba-4b91-8851-fd5e9c1ae1a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:37.453286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:37.453715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:37.454397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:37.454843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:37.455293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:37.545076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:37.553588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:37.555340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:37.556339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2c8868f8-3aef-4608-95ff-e3a270bd8a67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.115469 Aug 31 00:54:37.557009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1390/2835] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:54:37.608210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-acac2099-6bba-4b91-8851-fd5e9c1ae1a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:37.616357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-acac2099-6bba-4b91-8851-fd5e9c1ae1a2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.178164 Aug 31 00:54:37.616907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1446/2836] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:37 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:38.579990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:38.580592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:38.587123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:38.587633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:38.588061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:38.588766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:38.589210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:38.589630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:38.638389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d86b0fb2-928d-46c0-913d-cd7f2e439857 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:38.638962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d86b0fb2-928d-46c0-913d-cd7f2e439857 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:38.645482 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86b0fb2-928d-46c0-913d-cd7f2e439857 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:38.645967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86b0fb2-928d-46c0-913d-cd7f2e439857 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:38.646406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86b0fb2-928d-46c0-913d-cd7f2e439857 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:38.647121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86b0fb2-928d-46c0-913d-cd7f2e439857 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:38.647575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86b0fb2-928d-46c0-913d-cd7f2e439857 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:38.648000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86b0fb2-928d-46c0-913d-cd7f2e439857 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:38.653341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:38.662167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:38.663605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:38.664729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6465f9e9-d941-40a4-800e-6c2d6f544018 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088663 Aug 31 00:54:38.665278 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1391/2837] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:54:38.782207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d86b0fb2-928d-46c0-913d-cd7f2e439857 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:38.790447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d86b0fb2-928d-46c0-913d-cd7f2e439857 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156677 Aug 31 00:54:38.791006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1447/2838] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:54:39.687961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:39.688563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:39.694899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:39.695395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:39.695817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:39.696481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:39.696925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:39.697335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:39.712499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:39.759628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:39.768729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:39.770148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:39.771333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d285f85f-8635-4dd6-a315-abb1a2728659 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087949 Aug 31 00:54:39.771883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1392/2839] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:39.812976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3f1b142a-c2e1-4750-ac54-53c5b4522e3a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:39.813615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3f1b142a-c2e1-4750-ac54-53c5b4522e3a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:39.820042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f1b142a-c2e1-4750-ac54-53c5b4522e3a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:39.820522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f1b142a-c2e1-4750-ac54-53c5b4522e3a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:39.820980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f1b142a-c2e1-4750-ac54-53c5b4522e3a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:39.821669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f1b142a-c2e1-4750-ac54-53c5b4522e3a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:39.822121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f1b142a-c2e1-4750-ac54-53c5b4522e3a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:39.822542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3f1b142a-c2e1-4750-ac54-53c5b4522e3a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:39.950659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3f1b142a-c2e1-4750-ac54-53c5b4522e3a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:39.958754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3f1b142a-c2e1-4750-ac54-53c5b4522e3a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150446 Aug 31 00:54:39.959349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1448/2840] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:39 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:40.794633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:40.795265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:40.797546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=54 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:40.803155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:40.803637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:40.804073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:40.804760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:40.805211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:40.805634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:40.867241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:40.876966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:40.878405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:40.879569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-439848d6-c97b-44b0-b8d8-8446b47a6d0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089451 Aug 31 00:54:40.880122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1393/2841] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:40.981882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c4d6008d-551f-475a-8ca7-a90d6e5c9d9d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:40.982484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c4d6008d-551f-475a-8ca7-a90d6e5c9d9d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:40.989165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4d6008d-551f-475a-8ca7-a90d6e5c9d9d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:40.989649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4d6008d-551f-475a-8ca7-a90d6e5c9d9d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:40.990090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4d6008d-551f-475a-8ca7-a90d6e5c9d9d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:40.990751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4d6008d-551f-475a-8ca7-a90d6e5c9d9d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:40.991235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4d6008d-551f-475a-8ca7-a90d6e5c9d9d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:40.991654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4d6008d-551f-475a-8ca7-a90d6e5c9d9d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:41.123380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c4d6008d-551f-475a-8ca7-a90d6e5c9d9d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:41.131500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c4d6008d-551f-475a-8ca7-a90d6e5c9d9d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154186 Aug 31 00:54:41.132061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1449/2842] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:41.901831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:41.902666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:41.909129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:41.909604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:41.910033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:41.910707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:41.911176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:41.911598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:41.972262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:41.980965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:41.982410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:41.983591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1ff15a4b-3599-4e95-b380-2e103acd3b43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085713 Aug 31 00:54:41.984149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1394/2843] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:42.152874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b92036d9-472f-4a96-9e4b-457890f78fe6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:42.153454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b92036d9-472f-4a96-9e4b-457890f78fe6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:42.159858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b92036d9-472f-4a96-9e4b-457890f78fe6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:42.160339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b92036d9-472f-4a96-9e4b-457890f78fe6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:42.160773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b92036d9-472f-4a96-9e4b-457890f78fe6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:42.161454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b92036d9-472f-4a96-9e4b-457890f78fe6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:42.161906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b92036d9-472f-4a96-9e4b-457890f78fe6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:42.162333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b92036d9-472f-4a96-9e4b-457890f78fe6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:42.288863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b92036d9-472f-4a96-9e4b-457890f78fe6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:42.297496 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b92036d9-472f-4a96-9e4b-457890f78fe6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148536 Aug 31 00:54:42.298071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1450/2844] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:42 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:43.005851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:43.006461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:43.013308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:43.013791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:43.014230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:43.014919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:43.015403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:43.015825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:43.079840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:43.088407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:43.090103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:43.091490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2676b319-268a-4775-8307-61daf5109477 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089506 Aug 31 00:54:43.092055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1395/2845] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:43.320083 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1386f382-e200-4f4c-9886-bb190a39477f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:43.320615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1386f382-e200-4f4c-9886-bb190a39477f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:43.327333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1386f382-e200-4f4c-9886-bb190a39477f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:43.327812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1386f382-e200-4f4c-9886-bb190a39477f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:43.328243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1386f382-e200-4f4c-9886-bb190a39477f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:43.328918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1386f382-e200-4f4c-9886-bb190a39477f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:43.329367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1386f382-e200-4f4c-9886-bb190a39477f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:43.329784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1386f382-e200-4f4c-9886-bb190a39477f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:43.456961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1386f382-e200-4f4c-9886-bb190a39477f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:43.465873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1386f382-e200-4f4c-9886-bb190a39477f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149760 Aug 31 00:54:43.466441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1451/2846] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:44.114834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:44.115454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:44.122123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:44.122595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:44.123029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:44.123731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:44.124181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:44.124602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:44.185896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:44.194490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:44.195968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:44.197101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-34bcd4f2-3c56-42b0-be75-29df9090b7a2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086204 Aug 31 00:54:44.197664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1396/2847] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:44.486626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-045f1074-b0ea-4757-9a25-53fe13058338 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:44.487243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-045f1074-b0ea-4757-9a25-53fe13058338 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:44.494037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045f1074-b0ea-4757-9a25-53fe13058338 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:44.494512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045f1074-b0ea-4757-9a25-53fe13058338 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:44.494941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045f1074-b0ea-4757-9a25-53fe13058338 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:44.495649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045f1074-b0ea-4757-9a25-53fe13058338 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:44.496116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045f1074-b0ea-4757-9a25-53fe13058338 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:44.496624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045f1074-b0ea-4757-9a25-53fe13058338 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:44.629908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-045f1074-b0ea-4757-9a25-53fe13058338 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:44.638980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-045f1074-b0ea-4757-9a25-53fe13058338 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156180 Aug 31 00:54:44.639577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1452/2848] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:45.219659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:45.220313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:45.226821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:45.227322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:45.227757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:45.228425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:45.228886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:45.229280 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:45.293253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:45.301850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:45.303294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:45.304414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5b31309e-c547-4b75-b6b6-1b9a7cdd4320 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088752 Aug 31 00:54:45.304970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1397/2849] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:45.661189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b9b50fb3-93ba-4505-a8b1-1a9ca54eface tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:45.661818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b9b50fb3-93ba-4505-a8b1-1a9ca54eface tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:45.669177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9b50fb3-93ba-4505-a8b1-1a9ca54eface tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:45.669375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9b50fb3-93ba-4505-a8b1-1a9ca54eface tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:45.669641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9b50fb3-93ba-4505-a8b1-1a9ca54eface tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:45.670310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9b50fb3-93ba-4505-a8b1-1a9ca54eface tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:45.670755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9b50fb3-93ba-4505-a8b1-1a9ca54eface tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:45.671206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9b50fb3-93ba-4505-a8b1-1a9ca54eface tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:45.819453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b9b50fb3-93ba-4505-a8b1-1a9ca54eface tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:45.828108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b9b50fb3-93ba-4505-a8b1-1a9ca54eface tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.170780 Aug 31 00:54:45.828669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1453/2850] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:46.328027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:46.328635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:46.334963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:46.335467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:46.335925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:46.336595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:46.337042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:46.337461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:46.400448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:46.409279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:46.410714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:46.412065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f05b675a-4092-4c55-9b0b-077b418940e7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088922 Aug 31 00:54:46.412623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1398/2851] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:46.850168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ef3cec23-c2bd-4d41-bced-013f6f0cea39 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:46.850753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ef3cec23-c2bd-4d41-bced-013f6f0cea39 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:46.853085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:46.859350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef3cec23-c2bd-4d41-bced-013f6f0cea39 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:46.859831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef3cec23-c2bd-4d41-bced-013f6f0cea39 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:46.860257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef3cec23-c2bd-4d41-bced-013f6f0cea39 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:46.860988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef3cec23-c2bd-4d41-bced-013f6f0cea39 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:46.861433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef3cec23-c2bd-4d41-bced-013f6f0cea39 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:46.861845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef3cec23-c2bd-4d41-bced-013f6f0cea39 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:46.991871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ef3cec23-c2bd-4d41-bced-013f6f0cea39 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:47.000239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ef3cec23-c2bd-4d41-bced-013f6f0cea39 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154186 Aug 31 00:54:47.000784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1454/2852] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:46 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:47.433801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:47.434514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:47.440860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:47.441361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:47.441784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:47.442450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:47.442890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:47.443395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:47.505521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:47.514819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:47.516286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:47.517456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-06e0e6b4-a6aa-4f1b-aa86-e526fb17d14f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087585 Aug 31 00:54:47.518013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1399/2853] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:48.021301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ee77f60-8f39-4d9f-812b-b885cff729c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:48.021909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ee77f60-8f39-4d9f-812b-b885cff729c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:48.028778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee77f60-8f39-4d9f-812b-b885cff729c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:48.029259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee77f60-8f39-4d9f-812b-b885cff729c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:48.029698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee77f60-8f39-4d9f-812b-b885cff729c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:48.030382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee77f60-8f39-4d9f-812b-b885cff729c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:48.030844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee77f60-8f39-4d9f-812b-b885cff729c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:48.031294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ee77f60-8f39-4d9f-812b-b885cff729c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:48.165318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ee77f60-8f39-4d9f-812b-b885cff729c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:48.174155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ee77f60-8f39-4d9f-812b-b885cff729c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156749 Aug 31 00:54:48.174728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1455/2854] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:48.541155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:48.541912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:48.548988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:48.549463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:48.549895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:48.550575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:48.551023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:48.551468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:48.612185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:48.620786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:48.622221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:48.623382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-29decf61-96f6-41e4-875e-3cedc4c9fe34 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086171 Aug 31 00:54:48.623930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1400/2855] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:49.196088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9b7246b9-aa6e-49db-8e01-2d1be106af1c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:49.196750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9b7246b9-aa6e-49db-8e01-2d1be106af1c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:49.204252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b7246b9-aa6e-49db-8e01-2d1be106af1c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:49.204775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b7246b9-aa6e-49db-8e01-2d1be106af1c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:49.205209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b7246b9-aa6e-49db-8e01-2d1be106af1c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:49.205899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b7246b9-aa6e-49db-8e01-2d1be106af1c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:49.206352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b7246b9-aa6e-49db-8e01-2d1be106af1c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:49.206773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b7246b9-aa6e-49db-8e01-2d1be106af1c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:49.343753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9b7246b9-aa6e-49db-8e01-2d1be106af1c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:49.352135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9b7246b9-aa6e-49db-8e01-2d1be106af1c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.160001 Aug 31 00:54:49.352698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1456/2856] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:49.645628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:49.646224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:49.652742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:49.653215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:49.653644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:49.654321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:49.654764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:49.655216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:49.718731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:49.727613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:49.729053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:49.730668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a19ab27e-dbae-47d1-a10f-8101e6bfc92b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088600 Aug 31 00:54:49.731257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1401/2857] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:50.373985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed0bba43-0e82-4096-81ef-c2e1e8937c14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:50.374657 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ed0bba43-0e82-4096-81ef-c2e1e8937c14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:50.381134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed0bba43-0e82-4096-81ef-c2e1e8937c14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:50.381610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed0bba43-0e82-4096-81ef-c2e1e8937c14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:50.382036 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed0bba43-0e82-4096-81ef-c2e1e8937c14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:50.382713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed0bba43-0e82-4096-81ef-c2e1e8937c14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:50.383185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed0bba43-0e82-4096-81ef-c2e1e8937c14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:50.383607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed0bba43-0e82-4096-81ef-c2e1e8937c14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:50.509836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ed0bba43-0e82-4096-81ef-c2e1e8937c14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:50.518605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ed0bba43-0e82-4096-81ef-c2e1e8937c14 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148720 Aug 31 00:54:50.519188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1457/2858] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:50.753935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:50.754469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:50.760858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:50.761382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:50.762430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:50.763245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:50.763697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:50.764118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:50.825969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:50.834543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:50.835998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:50.837126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b4426e01-9eea-4806-b5ec-85186cc9ba3a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087784 Aug 31 00:54:50.837691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1402/2859] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:51.540269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dcc33a20-4f81-495b-9971-31975b6e4471 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:51.540866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dcc33a20-4f81-495b-9971-31975b6e4471 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:51.548024 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc33a20-4f81-495b-9971-31975b6e4471 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:51.548492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc33a20-4f81-495b-9971-31975b6e4471 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:51.548911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc33a20-4f81-495b-9971-31975b6e4471 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:51.549579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc33a20-4f81-495b-9971-31975b6e4471 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:51.550021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc33a20-4f81-495b-9971-31975b6e4471 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:51.550431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcc33a20-4f81-495b-9971-31975b6e4471 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:51.688818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dcc33a20-4f81-495b-9971-31975b6e4471 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:51.696910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dcc33a20-4f81-495b-9971-31975b6e4471 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.160561 Aug 31 00:54:51.697465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1458/2860] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:51.859887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:51.860491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:51.867121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:51.867615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:51.868051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:51.868737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:51.869190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:51.869611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:51.931981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:51.941096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:51.942534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:51.943694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e1349111-2e97-4497-b00b-431e462eab78 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087832 Aug 31 00:54:51.944255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1403/2861] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:51 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:52.718411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c99412b3-061d-48a1-9394-71df5d6eb79c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:52.719004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c99412b3-061d-48a1-9394-71df5d6eb79c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:52.725749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99412b3-061d-48a1-9394-71df5d6eb79c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:52.726231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99412b3-061d-48a1-9394-71df5d6eb79c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:52.726666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99412b3-061d-48a1-9394-71df5d6eb79c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:52.727381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99412b3-061d-48a1-9394-71df5d6eb79c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:52.727833 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99412b3-061d-48a1-9394-71df5d6eb79c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:52.728253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99412b3-061d-48a1-9394-71df5d6eb79c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:52.732979 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:52.857518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c99412b3-061d-48a1-9394-71df5d6eb79c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:52.865719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c99412b3-061d-48a1-9394-71df5d6eb79c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151503 Aug 31 00:54:52.866286 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1459/2862] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:52.967759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:52.968367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:52.975376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:52.975790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:52.976220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:52.976906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:52.977351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:52.977769 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:53.044118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:53.052705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:53.054144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:53.055314 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5bae60da-efcf-4091-a189-e09771841317 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092203 Aug 31 00:54:53.055876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1404/2863] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:53.887806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f438c341-7ef8-4ff7-90cd-136d51fabf13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:53.888426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f438c341-7ef8-4ff7-90cd-136d51fabf13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:53.894851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f438c341-7ef8-4ff7-90cd-136d51fabf13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:53.895365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f438c341-7ef8-4ff7-90cd-136d51fabf13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:53.895799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f438c341-7ef8-4ff7-90cd-136d51fabf13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:53.896476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f438c341-7ef8-4ff7-90cd-136d51fabf13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:53.896920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f438c341-7ef8-4ff7-90cd-136d51fabf13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:53.897336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f438c341-7ef8-4ff7-90cd-136d51fabf13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:54.078636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:54.079263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:54.085935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:54.086416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:54.086881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:54.087649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:54.088100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:54.088524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:54.228691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:54.237986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:54.239455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:54.240604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c5bb4367-2f23-4343-8bc0-8deb100474a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.166744 Aug 31 00:54:54.241162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1405/2864] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:54:54.285041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f438c341-7ef8-4ff7-90cd-136d51fabf13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:54.294394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f438c341-7ef8-4ff7-90cd-136d51fabf13 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.411305 Aug 31 00:54:54.294965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1460/2865] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:53 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:55.264561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:55.265138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:55.271479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:55.271958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:55.272385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:55.273057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:55.273501 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:55.273920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:55.323777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b8726e4a-0bac-438d-a84c-efce18e53e6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:55.324423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b8726e4a-0bac-438d-a84c-efce18e53e6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:55.331695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8726e4a-0bac-438d-a84c-efce18e53e6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:55.332177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8726e4a-0bac-438d-a84c-efce18e53e6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:55.332611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8726e4a-0bac-438d-a84c-efce18e53e6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:55.333298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8726e4a-0bac-438d-a84c-efce18e53e6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:55.333749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8726e4a-0bac-438d-a84c-efce18e53e6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:55.334171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b8726e4a-0bac-438d-a84c-efce18e53e6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:55.337409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:55.346123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:55.347856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:55.348988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-40f1a71f-6e2e-4322-9c08-8bff6ce35d1d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089252 Aug 31 00:54:55.349848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1406/2866] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:55.467907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b8726e4a-0bac-438d-a84c-efce18e53e6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:55.476475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b8726e4a-0bac-438d-a84c-efce18e53e6b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156590 Aug 31 00:54:55.477051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1461/2867] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:55 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:54:56.372076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:56.372691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:56.379167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:56.379675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:56.380080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:56.380760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:56.381202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:56.381620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:56.442712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:56.451470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:56.452921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:56.454047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7bd4e4e7-c814-488a-9b3f-a5684f2d924e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086672 Aug 31 00:54:56.454607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1407/2868] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:56.498910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3cfea004-3e6a-4d1e-b182-2779cb9c67de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:56.499624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3cfea004-3e6a-4d1e-b182-2779cb9c67de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:56.506016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cfea004-3e6a-4d1e-b182-2779cb9c67de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:56.506493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cfea004-3e6a-4d1e-b182-2779cb9c67de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:56.506950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cfea004-3e6a-4d1e-b182-2779cb9c67de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:56.507680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cfea004-3e6a-4d1e-b182-2779cb9c67de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:56.508128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cfea004-3e6a-4d1e-b182-2779cb9c67de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:56.508545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cfea004-3e6a-4d1e-b182-2779cb9c67de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:56.641003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3cfea004-3e6a-4d1e-b182-2779cb9c67de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:56.649079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3cfea004-3e6a-4d1e-b182-2779cb9c67de tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154574 Aug 31 00:54:56.649651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1462/2869] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:57.476742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:57.477325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:57.484589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:57.485062 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:57.485494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:57.486172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:57.486617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:57.487058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:57.547581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:57.556329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:57.557758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:57.559172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-06a3b97b-0f09-4041-bd00-b55915fcb3a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086163 Aug 31 00:54:57.559738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1408/2870] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:57.670312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f3f7b8b8-e6a1-4db7-805d-88cc9476e603 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:57.670954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f3f7b8b8-e6a1-4db7-805d-88cc9476e603 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:57.677446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3f7b8b8-e6a1-4db7-805d-88cc9476e603 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:57.677928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3f7b8b8-e6a1-4db7-805d-88cc9476e603 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:57.678366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3f7b8b8-e6a1-4db7-805d-88cc9476e603 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:57.679057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3f7b8b8-e6a1-4db7-805d-88cc9476e603 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:57.679531 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3f7b8b8-e6a1-4db7-805d-88cc9476e603 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:57.679960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3f7b8b8-e6a1-4db7-805d-88cc9476e603 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:57.804551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f3f7b8b8-e6a1-4db7-805d-88cc9476e603 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:57.813502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f3f7b8b8-e6a1-4db7-805d-88cc9476e603 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.147723 Aug 31 00:54:57.814066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1463/2871] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:58.581136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:58.581781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:58.588388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:58.588864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:58.590297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:58.591026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:58.591839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:58.592588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:58.598006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:58.658524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:58.667074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:58.668742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:58.669872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e0290d50-6e9b-451e-8c40-08aaf30da989 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092713 Aug 31 00:54:58.670423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1409/2872] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:58.834642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-537ffda3-f852-4e2b-9564-86c89c77fd21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:58.835266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-537ffda3-f852-4e2b-9564-86c89c77fd21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:58.842350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537ffda3-f852-4e2b-9564-86c89c77fd21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:58.842837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537ffda3-f852-4e2b-9564-86c89c77fd21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:58.843306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537ffda3-f852-4e2b-9564-86c89c77fd21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:58.843990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537ffda3-f852-4e2b-9564-86c89c77fd21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:58.844444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537ffda3-f852-4e2b-9564-86c89c77fd21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:58.844863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-537ffda3-f852-4e2b-9564-86c89c77fd21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:58.969609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-537ffda3-f852-4e2b-9564-86c89c77fd21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:58.978056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-537ffda3-f852-4e2b-9564-86c89c77fd21 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.147356 Aug 31 00:54:58.978619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1464/2873] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:54:59.693228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:59.693829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:54:59.700474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:59.700944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:59.701376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:59.702053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:54:59.702504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:54:59.702917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:54:59.767685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:59.776224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:59.778174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:54:59.779338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b3f9c238-fcf1-49a9-8b5e-597e0c2cf6b6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089963 Aug 31 00:54:59.779886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1410/2874] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:54:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:54:59.998752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3227a6aa-7900-4670-85b0-ec2fa8f754df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:54:59.999389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3227a6aa-7900-4670-85b0-ec2fa8f754df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:00.005829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3227a6aa-7900-4670-85b0-ec2fa8f754df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:00.006301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3227a6aa-7900-4670-85b0-ec2fa8f754df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:00.006728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3227a6aa-7900-4670-85b0-ec2fa8f754df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:00.007429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3227a6aa-7900-4670-85b0-ec2fa8f754df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:00.007871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3227a6aa-7900-4670-85b0-ec2fa8f754df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:00.008284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3227a6aa-7900-4670-85b0-ec2fa8f754df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:00.139164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3227a6aa-7900-4670-85b0-ec2fa8f754df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:00.147513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3227a6aa-7900-4670-85b0-ec2fa8f754df tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152842 Aug 31 00:55:00.148079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1465/2875] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:54:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:00.802415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:00.803066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:00.809838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:00.810303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:00.810726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:00.811421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:00.811866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:00.812282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:00.872670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:00.881116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:00.882587 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:00.883750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-aec52200-0537-47b5-acd6-68314e0e8363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085182 Aug 31 00:55:00.884304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1411/2876] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:01.169094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-888fb75d-6425-4740-9a78-298ced12526d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:01.169701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-888fb75d-6425-4740-9a78-298ced12526d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:01.176165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-888fb75d-6425-4740-9a78-298ced12526d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:01.176644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-888fb75d-6425-4740-9a78-298ced12526d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:01.177079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-888fb75d-6425-4740-9a78-298ced12526d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:01.177754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-888fb75d-6425-4740-9a78-298ced12526d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:01.178204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-888fb75d-6425-4740-9a78-298ced12526d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:01.178622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-888fb75d-6425-4740-9a78-298ced12526d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:01.309998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-888fb75d-6425-4740-9a78-298ced12526d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:01.317121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-888fb75d-6425-4740-9a78-298ced12526d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151899 Aug 31 00:55:01.317688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1466/2877] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:01.906615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:01.907252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:01.913660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:01.914152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:01.914585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:01.915294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:01.915744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:01.916169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:01.982127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:01.990972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:01.992447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:01.993590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4948c3f2-ea60-4f32-af61-8381ac60c0d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091154 Aug 31 00:55:01.994151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1412/2878] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:01 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:02.338957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ca18ceb2-8bd4-4d22-afc6-25bf65981bb1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:02.340362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ca18ceb2-8bd4-4d22-afc6-25bf65981bb1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:02.347113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca18ceb2-8bd4-4d22-afc6-25bf65981bb1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:02.347594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca18ceb2-8bd4-4d22-afc6-25bf65981bb1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:02.348054 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca18ceb2-8bd4-4d22-afc6-25bf65981bb1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:02.348732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca18ceb2-8bd4-4d22-afc6-25bf65981bb1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:02.349209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca18ceb2-8bd4-4d22-afc6-25bf65981bb1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:02.349629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca18ceb2-8bd4-4d22-afc6-25bf65981bb1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:02.477696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ca18ceb2-8bd4-4d22-afc6-25bf65981bb1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:02.485865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ca18ceb2-8bd4-4d22-afc6-25bf65981bb1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150763 Aug 31 00:55:02.486427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1467/2879] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:02 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:03.016807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:03.017419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:03.024011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:03.024495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:03.024928 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:03.025611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:03.026064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:03.026490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:03.088212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:03.097647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:03.099093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:03.100214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-97b40195-7571-47d6-935c-7ac627ca0b9b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087403 Aug 31 00:55:03.100762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1413/2880] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:03 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:03.507171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9dc75c75-a630-41bc-ab83-b28f4dcb1892 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:03.507780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9dc75c75-a630-41bc-ab83-b28f4dcb1892 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:03.515200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9dc75c75-a630-41bc-ab83-b28f4dcb1892 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:03.515687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9dc75c75-a630-41bc-ab83-b28f4dcb1892 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:03.516115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9dc75c75-a630-41bc-ab83-b28f4dcb1892 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:03.516801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9dc75c75-a630-41bc-ab83-b28f4dcb1892 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:03.517250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9dc75c75-a630-41bc-ab83-b28f4dcb1892 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:03.517669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9dc75c75-a630-41bc-ab83-b28f4dcb1892 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:03.649242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9dc75c75-a630-41bc-ab83-b28f4dcb1892 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:03.657411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9dc75c75-a630-41bc-ab83-b28f4dcb1892 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154137 Aug 31 00:55:03.657973 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1468/2881] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:03 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:04.122406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:04.123007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:04.129361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:04.129829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:04.130254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:04.130919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:04.131389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:04.131802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:04.192336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:04.201098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:04.202541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:04.203710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ec923451-43dd-4fee-bc6d-3de8d2e5de84 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085887 Aug 31 00:55:04.204266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1414/2882] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:04 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:04.678719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-903f44d5-fde8-45de-a621-ef427c37e957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:04.679599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-903f44d5-fde8-45de-a621-ef427c37e957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:04.686195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903f44d5-fde8-45de-a621-ef427c37e957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:04.686662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903f44d5-fde8-45de-a621-ef427c37e957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:04.687142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903f44d5-fde8-45de-a621-ef427c37e957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:04.687930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903f44d5-fde8-45de-a621-ef427c37e957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:04.688406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903f44d5-fde8-45de-a621-ef427c37e957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:04.688837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903f44d5-fde8-45de-a621-ef427c37e957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:04.817044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-903f44d5-fde8-45de-a621-ef427c37e957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:04.826415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-903f44d5-fde8-45de-a621-ef427c37e957 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151505 Aug 31 00:55:04.826983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1469/2883] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:04 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:05.226208 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:05.226764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:05.233471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:05.233949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:05.234382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:05.235092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:05.235539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:05.236032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:05.302564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:05.314012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:05.315758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:05.317074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8c361f74-aad9-4ac8-8fa2-3ee2755475e3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.095147 Aug 31 00:55:05.317937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1415/2884] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:05 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:05.849078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-91ea3e35-015e-4674-b3bc-1ba8f03a0ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:05.849990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-91ea3e35-015e-4674-b3bc-1ba8f03a0ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:05.857335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ea3e35-015e-4674-b3bc-1ba8f03a0ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:05.857815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ea3e35-015e-4674-b3bc-1ba8f03a0ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:05.858245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ea3e35-015e-4674-b3bc-1ba8f03a0ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:05.858925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ea3e35-015e-4674-b3bc-1ba8f03a0ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:05.859400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ea3e35-015e-4674-b3bc-1ba8f03a0ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:05.859820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ea3e35-015e-4674-b3bc-1ba8f03a0ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:05.990408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91ea3e35-015e-4674-b3bc-1ba8f03a0ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:05.999421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-91ea3e35-015e-4674-b3bc-1ba8f03a0ed0 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154553 Aug 31 00:55:05.999998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1470/2885] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:05 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:06.343571 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:06.344204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:06.350881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:06.351390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:06.351827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:06.352513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:06.352960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:06.353378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:06.416634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:06.425442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:06.426890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:06.428054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d23686a0-1695-41e6-bd9e-36696640212b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089782 Aug 31 00:55:06.428606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1416/2886] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:06 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:07.021379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-418f5ad8-914c-49ae-8dbe-0eeea888b46f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:07.021990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-418f5ad8-914c-49ae-8dbe-0eeea888b46f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:07.028707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418f5ad8-914c-49ae-8dbe-0eeea888b46f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:07.029192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418f5ad8-914c-49ae-8dbe-0eeea888b46f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:07.029622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418f5ad8-914c-49ae-8dbe-0eeea888b46f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:07.030306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418f5ad8-914c-49ae-8dbe-0eeea888b46f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:07.030753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418f5ad8-914c-49ae-8dbe-0eeea888b46f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:07.031202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418f5ad8-914c-49ae-8dbe-0eeea888b46f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:07.162162 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-418f5ad8-914c-49ae-8dbe-0eeea888b46f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:07.171249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-418f5ad8-914c-49ae-8dbe-0eeea888b46f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153790 Aug 31 00:55:07.171821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1471/2887] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:07 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:07.450475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:07.451103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:07.457466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:07.457936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:07.458358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:07.459028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:07.459496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:07.459907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:07.522424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:07.531563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:07.533011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:07.534127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-03576cfa-7558-4418-86f9-bcc1290726ca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087595 Aug 31 00:55:07.534672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1417/2888] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:07 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:08.193078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d1f66b53-7b63-466b-ba97-5ca521692abd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:08.193688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d1f66b53-7b63-466b-ba97-5ca521692abd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:08.200316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f66b53-7b63-466b-ba97-5ca521692abd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:08.200799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f66b53-7b63-466b-ba97-5ca521692abd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:08.201230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f66b53-7b63-466b-ba97-5ca521692abd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:08.201911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f66b53-7b63-466b-ba97-5ca521692abd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:08.202363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f66b53-7b63-466b-ba97-5ca521692abd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:08.202785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1f66b53-7b63-466b-ba97-5ca521692abd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:08.337206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d1f66b53-7b63-466b-ba97-5ca521692abd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:08.346495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d1f66b53-7b63-466b-ba97-5ca521692abd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157024 Aug 31 00:55:08.347078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1472/2889] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:08 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:08.557565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:08.558181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:08.564678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:08.565161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:08.565593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:08.566275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:08.566751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:08.567217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:08.632644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:08.644990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:08.646432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:08.647608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2222f87c-c0cd-44a2-96eb-948cb52b7d05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.094049 Aug 31 00:55:08.648175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1418/2890] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:08 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:09.367627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e9186e2c-0e3c-435b-b3d6-66fa40270021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:09.368247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e9186e2c-0e3c-435b-b3d6-66fa40270021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:09.375338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9186e2c-0e3c-435b-b3d6-66fa40270021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:09.375821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9186e2c-0e3c-435b-b3d6-66fa40270021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:09.376251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9186e2c-0e3c-435b-b3d6-66fa40270021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:09.376933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9186e2c-0e3c-435b-b3d6-66fa40270021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:09.377383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9186e2c-0e3c-435b-b3d6-66fa40270021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:09.377816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e9186e2c-0e3c-435b-b3d6-66fa40270021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:09.510498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e9186e2c-0e3c-435b-b3d6-66fa40270021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:09.518733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e9186e2c-0e3c-435b-b3d6-66fa40270021 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154926 Aug 31 00:55:09.519326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1473/2891] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:09 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:09.671543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:09.672150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:09.678483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:09.678956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:09.679419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:09.680100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:09.680546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:09.680966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:09.747862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:09.756973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:09.758412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:09.759618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f3fb0a5a-0b5a-4acc-962b-c87650b8206a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092612 Aug 31 00:55:09.760180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1419/2892] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:09 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:10.540890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b54fab89-455d-4755-b54f-ceae059770cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:10.541488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b54fab89-455d-4755-b54f-ceae059770cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:10.548180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b54fab89-455d-4755-b54f-ceae059770cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:10.548660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b54fab89-455d-4755-b54f-ceae059770cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:10.549095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b54fab89-455d-4755-b54f-ceae059770cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:10.549773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b54fab89-455d-4755-b54f-ceae059770cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:10.550221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b54fab89-455d-4755-b54f-ceae059770cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:10.550669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b54fab89-455d-4755-b54f-ceae059770cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:10.682178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b54fab89-455d-4755-b54f-ceae059770cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:10.691453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b54fab89-455d-4755-b54f-ceae059770cd tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154424 Aug 31 00:55:10.692026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1474/2893] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:10 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:10.783126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:10.783757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:10.790071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:10.790540 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:10.791025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:10.791660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:10.792767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:10.793191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:10.854210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:10.863391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:10.864811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:10.865925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-45af79dd-abab-4097-a316-6cbdf815b43b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086689 Aug 31 00:55:10.866478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1420/2894] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:10 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:11.712851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c99ac25b-ebe5-4324-b897-cd8fef575707 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:11.713448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c99ac25b-ebe5-4324-b897-cd8fef575707 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:11.719952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99ac25b-ebe5-4324-b897-cd8fef575707 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:11.720425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99ac25b-ebe5-4324-b897-cd8fef575707 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:11.720860 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99ac25b-ebe5-4324-b897-cd8fef575707 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:11.721791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99ac25b-ebe5-4324-b897-cd8fef575707 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:11.722231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99ac25b-ebe5-4324-b897-cd8fef575707 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:11.722671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c99ac25b-ebe5-4324-b897-cd8fef575707 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:11.854563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c99ac25b-ebe5-4324-b897-cd8fef575707 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:11.856856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:11.864849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c99ac25b-ebe5-4324-b897-cd8fef575707 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155874 Aug 31 00:55:11.865427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1475/2895] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:11 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:11.890209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:11.890812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:11.893132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=56 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:11.898249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:11.898724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:11.899187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:11.899863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:11.900339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:11.900760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:11.965950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:11.974976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:11.976416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:11.977535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6894a4f2-15b0-44b3-a9eb-0bde9b482e38 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092430 Aug 31 00:55:11.978085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1421/2896] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:11 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:12.887982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-97134b9f-ba43-4948-9e40-e565f1d5dbb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:12.888645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-97134b9f-ba43-4948-9e40-e565f1d5dbb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:12.895151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97134b9f-ba43-4948-9e40-e565f1d5dbb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:12.895640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97134b9f-ba43-4948-9e40-e565f1d5dbb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:12.896075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97134b9f-ba43-4948-9e40-e565f1d5dbb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:12.896770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97134b9f-ba43-4948-9e40-e565f1d5dbb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:12.897222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97134b9f-ba43-4948-9e40-e565f1d5dbb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:12.897651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97134b9f-ba43-4948-9e40-e565f1d5dbb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:13.000093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:13.000702 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:13.007127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:13.007610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:13.008049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:13.008730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:13.009178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:13.009606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:13.109127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:13.117718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:13.119177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:13.120320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8be37c1a-a358-4a98-8a64-c78a0a274418 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.124224 Aug 31 00:55:13.120886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1422/2897] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:12 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:13.132692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-97134b9f-ba43-4948-9e40-e565f1d5dbb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:13.141785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-97134b9f-ba43-4948-9e40-e565f1d5dbb3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.258698 Aug 31 00:55:13.142359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1476/2898] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:12 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:14.142775 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:14.143406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:14.149784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:14.150252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:14.150677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:14.151894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:14.152484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:14.152896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:14.163748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-81e055bc-4c88-408b-bf4e-1c1ea3deaea3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:14.164347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-81e055bc-4c88-408b-bf4e-1c1ea3deaea3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:14.171478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81e055bc-4c88-408b-bf4e-1c1ea3deaea3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:14.171954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81e055bc-4c88-408b-bf4e-1c1ea3deaea3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:14.172375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81e055bc-4c88-408b-bf4e-1c1ea3deaea3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:14.173058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81e055bc-4c88-408b-bf4e-1c1ea3deaea3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:14.173498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81e055bc-4c88-408b-bf4e-1c1ea3deaea3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:14.173911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81e055bc-4c88-408b-bf4e-1c1ea3deaea3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:14.223191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:14.232999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:14.234434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:14.235608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-68618519-8f16-42b7-a7f7-cf133446f3e0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.096742 Aug 31 00:55:14.236387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1423/2899] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:14 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:14.314576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-81e055bc-4c88-408b-bf4e-1c1ea3deaea3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:14.322723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-81e055bc-4c88-408b-bf4e-1c1ea3deaea3 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.162878 Aug 31 00:55:14.323961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1477/2900] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:14 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:55:15.257815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:15.258396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:15.265129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:15.265691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:15.266179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:15.266914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:15.267477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:15.267903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:15.331943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:15.342347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:15.344075 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:15.344706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4e82cceb-c120-4380-99ee-c2a413a3a76e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:15.345345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4e82cceb-c120-4380-99ee-c2a413a3a76e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:15.345990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-92aedda3-abe1-425b-8c01-f8d7c0f0b901 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091479 Aug 31 00:55:15.346961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1424/2901] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:15 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:15.352439 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e82cceb-c120-4380-99ee-c2a413a3a76e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:15.352957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e82cceb-c120-4380-99ee-c2a413a3a76e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:15.353428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e82cceb-c120-4380-99ee-c2a413a3a76e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:15.354128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e82cceb-c120-4380-99ee-c2a413a3a76e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:15.354578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e82cceb-c120-4380-99ee-c2a413a3a76e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:15.354998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4e82cceb-c120-4380-99ee-c2a413a3a76e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:15.485598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4e82cceb-c120-4380-99ee-c2a413a3a76e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:15.493802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4e82cceb-c120-4380-99ee-c2a413a3a76e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152891 Aug 31 00:55:15.494363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1478/2902] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:15 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:55:16.372652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:16.373444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:16.384426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:16.384918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:16.385336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:16.386030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:16.386475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:16.386891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:16.448821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:16.451117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:16.458624 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:16.460102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:16.461228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0df805ce-a101-46d9-979f-cf3945f80990 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.093323 Aug 31 00:55:16.461791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1425/2903] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:16 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:16.515723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e3381d58-1982-4cd5-91b2-6684b78d2550 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:16.516322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e3381d58-1982-4cd5-91b2-6684b78d2550 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:16.522681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3381d58-1982-4cd5-91b2-6684b78d2550 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:16.523188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3381d58-1982-4cd5-91b2-6684b78d2550 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:16.523616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3381d58-1982-4cd5-91b2-6684b78d2550 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:16.524289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3381d58-1982-4cd5-91b2-6684b78d2550 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:16.524730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3381d58-1982-4cd5-91b2-6684b78d2550 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:16.525142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3381d58-1982-4cd5-91b2-6684b78d2550 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:16.653001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e3381d58-1982-4cd5-91b2-6684b78d2550 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:16.661780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e3381d58-1982-4cd5-91b2-6684b78d2550 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150495 Aug 31 00:55:16.662342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1479/2904] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:16 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:17.486941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:17.487590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:17.493944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:17.494425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:17.494859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:17.495582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:17.496038 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:17.496461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:17.562681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:17.571362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:17.572804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:17.573940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b3709f56-d913-4036-a6dc-98e1c790f304 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091998 Aug 31 00:55:17.574498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1426/2905] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:17 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:17.682980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-84890413-a7e7-447b-a1ff-45f413ec5d1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:17.683609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-84890413-a7e7-447b-a1ff-45f413ec5d1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:17.686302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:17.692135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84890413-a7e7-447b-a1ff-45f413ec5d1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:17.692535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84890413-a7e7-447b-a1ff-45f413ec5d1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:17.693009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84890413-a7e7-447b-a1ff-45f413ec5d1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:17.693699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84890413-a7e7-447b-a1ff-45f413ec5d1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:17.694155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84890413-a7e7-447b-a1ff-45f413ec5d1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:17.694577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84890413-a7e7-447b-a1ff-45f413ec5d1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:17.823412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-84890413-a7e7-447b-a1ff-45f413ec5d1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:17.832219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-84890413-a7e7-447b-a1ff-45f413ec5d1b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153108 Aug 31 00:55:17.832791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1480/2906] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:17 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:18.597035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:18.597639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:18.604000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:18.604568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:18.605006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:18.605690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:18.606192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:18.606564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:18.668325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:18.676836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:18.678259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:18.679461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-efee98a3-1572-47a6-8a6d-0a6a2f6616f0 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086583 Aug 31 00:55:18.680021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1427/2907] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:18 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:18.853759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d7ce3fb2-83e8-4475-8d23-c3e13c852110 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:18.854415 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d7ce3fb2-83e8-4475-8d23-c3e13c852110 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:18.861539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7ce3fb2-83e8-4475-8d23-c3e13c852110 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:18.861947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7ce3fb2-83e8-4475-8d23-c3e13c852110 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:18.862372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7ce3fb2-83e8-4475-8d23-c3e13c852110 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:18.863058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7ce3fb2-83e8-4475-8d23-c3e13c852110 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:18.863507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7ce3fb2-83e8-4475-8d23-c3e13c852110 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:18.863919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7ce3fb2-83e8-4475-8d23-c3e13c852110 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:18.996850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d7ce3fb2-83e8-4475-8d23-c3e13c852110 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:19.006257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d7ce3fb2-83e8-4475-8d23-c3e13c852110 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156137 Aug 31 00:55:19.006812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1481/2908] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:18 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:19.702459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:19.703129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:19.709618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:19.710098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:19.710526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:19.711237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:19.711684 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:19.712102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:19.773277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:19.782850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:19.784333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:19.785465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4de8edd3-e39f-41ab-a2f4-bab207dee905 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087656 Aug 31 00:55:19.786021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1428/2909] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:19 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:20.027361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d32f927b-0d21-48fa-be95-140004a4dbd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:20.027969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d32f927b-0d21-48fa-be95-140004a4dbd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:20.034886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d32f927b-0d21-48fa-be95-140004a4dbd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:20.035397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d32f927b-0d21-48fa-be95-140004a4dbd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:20.035834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d32f927b-0d21-48fa-be95-140004a4dbd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:20.036519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d32f927b-0d21-48fa-be95-140004a4dbd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:20.036971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d32f927b-0d21-48fa-be95-140004a4dbd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:20.037392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d32f927b-0d21-48fa-be95-140004a4dbd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:20.164469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d32f927b-0d21-48fa-be95-140004a4dbd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:20.172972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d32f927b-0d21-48fa-be95-140004a4dbd2 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149610 Aug 31 00:55:20.173521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1482/2910] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:20 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:20.808340 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:20.808882 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:20.816122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:20.816594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:20.817019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:20.817697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:20.818137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:20.818551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:20.883741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:20.893191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:20.894635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:20.895828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-188d3e2e-6827-431b-ab3c-67da2c0646d3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091524 Aug 31 00:55:20.896570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1429/2911] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:20 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:21.194564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-56c08d72-545c-468e-ba8c-beba6cb6c4c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:21.195185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-56c08d72-545c-468e-ba8c-beba6cb6c4c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:21.201366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56c08d72-545c-468e-ba8c-beba6cb6c4c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:21.201838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56c08d72-545c-468e-ba8c-beba6cb6c4c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:21.202264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56c08d72-545c-468e-ba8c-beba6cb6c4c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:21.202930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56c08d72-545c-468e-ba8c-beba6cb6c4c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:21.203399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56c08d72-545c-468e-ba8c-beba6cb6c4c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:21.203815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56c08d72-545c-468e-ba8c-beba6cb6c4c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:21.331382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-56c08d72-545c-468e-ba8c-beba6cb6c4c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:21.339589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-56c08d72-545c-468e-ba8c-beba6cb6c4c6 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148687 Aug 31 00:55:21.340152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1483/2912] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:21 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:21.917917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:21.918519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:21.924964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:21.925468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:21.925868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:21.926541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:21.926983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:21.927431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:21.990149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:21.999640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:22.001086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:22.002230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7eef3b1b-ae40-4549-8c1c-2ad8c45bf954 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088236 Aug 31 00:55:22.002788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1430/2913] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:21 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:22.361529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-af20e7b4-c393-4af8-bbd5-c949e36fa840 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:22.362132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-af20e7b4-c393-4af8-bbd5-c949e36fa840 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:22.368574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af20e7b4-c393-4af8-bbd5-c949e36fa840 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:22.369048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af20e7b4-c393-4af8-bbd5-c949e36fa840 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:22.369478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af20e7b4-c393-4af8-bbd5-c949e36fa840 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:22.370153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af20e7b4-c393-4af8-bbd5-c949e36fa840 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:22.370602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af20e7b4-c393-4af8-bbd5-c949e36fa840 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:22.371019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af20e7b4-c393-4af8-bbd5-c949e36fa840 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:22.504556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-af20e7b4-c393-4af8-bbd5-c949e36fa840 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:22.512831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-af20e7b4-c393-4af8-bbd5-c949e36fa840 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155529 Aug 31 00:55:22.513991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1484/2914] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:22 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:23.025636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:23.026238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:23.033956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:23.034433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:23.034865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:23.035568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:23.036016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:23.036432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:23.096905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:23.105386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:23.106805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:23.108641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-07d0d006-f9a7-4742-b642-0d0d7ae585d8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086928 Aug 31 00:55:23.109197 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1431/2915] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:23 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:23.536072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3ad13750-22d7-4f8c-aeff-575400b99f9f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:23.536678 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3ad13750-22d7-4f8c-aeff-575400b99f9f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:23.543161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ad13750-22d7-4f8c-aeff-575400b99f9f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:23.543636 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ad13750-22d7-4f8c-aeff-575400b99f9f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:23.544063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ad13750-22d7-4f8c-aeff-575400b99f9f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:23.545139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ad13750-22d7-4f8c-aeff-575400b99f9f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:23.545515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ad13750-22d7-4f8c-aeff-575400b99f9f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:23.545890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ad13750-22d7-4f8c-aeff-575400b99f9f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:23.672654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3ad13750-22d7-4f8c-aeff-575400b99f9f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:23.680834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3ad13750-22d7-4f8c-aeff-575400b99f9f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148584 Aug 31 00:55:23.681398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1485/2916] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:23 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:24.131203 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:24.131810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:24.138194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:24.138646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:24.139103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:24.139785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:24.140235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:24.140652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:24.204359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:24.212914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:24.214341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:24.215499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-22d3e7c8-fb7b-49c4-998c-8e09e039174f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088222 Aug 31 00:55:24.216081 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1432/2917] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:24 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:24.703260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-05cb7160-cd0b-4be0-8677-eb9ba4706f7c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:24.704138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-05cb7160-cd0b-4be0-8677-eb9ba4706f7c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:24.710382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05cb7160-cd0b-4be0-8677-eb9ba4706f7c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:24.710866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05cb7160-cd0b-4be0-8677-eb9ba4706f7c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:24.711326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05cb7160-cd0b-4be0-8677-eb9ba4706f7c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:24.712017 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05cb7160-cd0b-4be0-8677-eb9ba4706f7c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:24.712469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05cb7160-cd0b-4be0-8677-eb9ba4706f7c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:24.712893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05cb7160-cd0b-4be0-8677-eb9ba4706f7c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:24.843676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-05cb7160-cd0b-4be0-8677-eb9ba4706f7c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:24.852070 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-05cb7160-cd0b-4be0-8677-eb9ba4706f7c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153155 Aug 31 00:55:24.852635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1486/2918] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:24 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:25.238366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:25.238964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:25.245483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:25.245954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:25.246382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:25.247076 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:25.247869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:25.248034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:25.308353 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:25.317019 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:25.318437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:25.319580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-29ef0e9f-4333-436d-88e6-002b10684830 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085166 Aug 31 00:55:25.320134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1433/2919] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:25 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:25.876407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-34a2bf76-a1b9-479a-94ec-9d20a1cdad5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:25.877138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-34a2bf76-a1b9-479a-94ec-9d20a1cdad5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:25.883641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34a2bf76-a1b9-479a-94ec-9d20a1cdad5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:25.884111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34a2bf76-a1b9-479a-94ec-9d20a1cdad5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:25.884537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34a2bf76-a1b9-479a-94ec-9d20a1cdad5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:25.885240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34a2bf76-a1b9-479a-94ec-9d20a1cdad5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:25.885682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34a2bf76-a1b9-479a-94ec-9d20a1cdad5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:25.886100 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34a2bf76-a1b9-479a-94ec-9d20a1cdad5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:26.015954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34a2bf76-a1b9-479a-94ec-9d20a1cdad5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:26.024019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-34a2bf76-a1b9-479a-94ec-9d20a1cdad5b tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153745 Aug 31 00:55:26.024585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1487/2920] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:25 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:26.342042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:26.342645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:26.349858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:26.350328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:26.350752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:26.351492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:26.351936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:26.352347 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:26.414305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:26.423637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:26.425072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:26.426202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e8bca9b4-d3cd-457d-9b76-7b2fbd9b2a1b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088223 Aug 31 00:55:26.426759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1434/2921] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:26 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:27.048074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a4d3d7ae-feaa-4bfa-94fd-ffac5a25cee4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:27.048686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a4d3d7ae-feaa-4bfa-94fd-ffac5a25cee4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:27.056668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4d3d7ae-feaa-4bfa-94fd-ffac5a25cee4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:27.057144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4d3d7ae-feaa-4bfa-94fd-ffac5a25cee4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:27.057574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4d3d7ae-feaa-4bfa-94fd-ffac5a25cee4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:27.058256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4d3d7ae-feaa-4bfa-94fd-ffac5a25cee4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:27.058700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4d3d7ae-feaa-4bfa-94fd-ffac5a25cee4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:27.059143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4d3d7ae-feaa-4bfa-94fd-ffac5a25cee4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:27.189240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4d3d7ae-feaa-4bfa-94fd-ffac5a25cee4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:27.197087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a4d3d7ae-feaa-4bfa-94fd-ffac5a25cee4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156549 Aug 31 00:55:27.197662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1488/2922] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:27 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:27.449285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:27.449898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:27.457257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:27.457731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:27.458158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:27.458843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:27.459317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:27.459780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:27.524872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:27.533442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:27.534872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:27.536031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6e22ab4b-bcbe-4b93-9981-8d4292eb49a3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090698 Aug 31 00:55:27.536586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1435/2923] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:27 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:28.219352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-48860cf1-1160-4cd8-a933-ae758af46f23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:28.219991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-48860cf1-1160-4cd8-a933-ae758af46f23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:28.226680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48860cf1-1160-4cd8-a933-ae758af46f23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:28.227202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48860cf1-1160-4cd8-a933-ae758af46f23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:28.227644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48860cf1-1160-4cd8-a933-ae758af46f23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:28.228330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48860cf1-1160-4cd8-a933-ae758af46f23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:28.228780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48860cf1-1160-4cd8-a933-ae758af46f23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:28.229202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48860cf1-1160-4cd8-a933-ae758af46f23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:28.378172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-48860cf1-1160-4cd8-a933-ae758af46f23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:28.387126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-48860cf1-1160-4cd8-a933-ae758af46f23 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.171866 Aug 31 00:55:28.387393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1489/2924] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:28 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:28.559346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:28.560215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:28.568187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:28.568595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:28.569031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:28.569726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:28.570179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:28.570621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:28.644176 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:28.654149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:28.656108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:28.657248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a0f97cf4-d77e-46ef-9c37-990e0eab9f71 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.102150 Aug 31 00:55:28.657801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1436/2925] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:28 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:29.411231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b88052e7-cecb-4c2f-8862-8c902db9072e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:29.411834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b88052e7-cecb-4c2f-8862-8c902db9072e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:29.418243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88052e7-cecb-4c2f-8862-8c902db9072e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:29.418721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88052e7-cecb-4c2f-8862-8c902db9072e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:29.419194 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88052e7-cecb-4c2f-8862-8c902db9072e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:29.419981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88052e7-cecb-4c2f-8862-8c902db9072e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:29.420434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88052e7-cecb-4c2f-8862-8c902db9072e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:29.420853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b88052e7-cecb-4c2f-8862-8c902db9072e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:29.551893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b88052e7-cecb-4c2f-8862-8c902db9072e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:29.560196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b88052e7-cecb-4c2f-8862-8c902db9072e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152820 Aug 31 00:55:29.560769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1490/2926] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:29 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:29.682790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:29.683489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:29.690365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:29.690836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:29.691288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:29.691958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:29.692401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:29.692813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:29.755295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:29.764462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:29.765899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:29.767056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a0fc4606-035c-43c4-a49f-d1fdea1f04b5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088188 Aug 31 00:55:29.767613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1437/2927] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:29 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:30.581582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ca5723fe-0a07-469c-a572-7e0a90ec3032 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:30.582222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ca5723fe-0a07-469c-a572-7e0a90ec3032 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:30.588771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca5723fe-0a07-469c-a572-7e0a90ec3032 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:30.589252 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca5723fe-0a07-469c-a572-7e0a90ec3032 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:30.589690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca5723fe-0a07-469c-a572-7e0a90ec3032 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:30.590375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca5723fe-0a07-469c-a572-7e0a90ec3032 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:30.590826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca5723fe-0a07-469c-a572-7e0a90ec3032 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:30.591284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca5723fe-0a07-469c-a572-7e0a90ec3032 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:30.717802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ca5723fe-0a07-469c-a572-7e0a90ec3032 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:30.727990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ca5723fe-0a07-469c-a572-7e0a90ec3032 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150178 Aug 31 00:55:30.728566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1491/2928] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:30 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:55:30.789697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:30.790372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:30.797763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:30.798250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:30.798689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:30.799408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:30.799863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:30.800288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:30.867455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:30.877152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:30.878574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:30.879727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-accdd323-ac5f-49ff-b16a-25aa29994dd8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.093920 Aug 31 00:55:30.880273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1438/2929] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:30 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:31.749858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c0ff11e7-618c-41a5-a9bb-839f3c250491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:31.750527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c0ff11e7-618c-41a5-a9bb-839f3c250491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:31.757442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0ff11e7-618c-41a5-a9bb-839f3c250491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:31.757953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0ff11e7-618c-41a5-a9bb-839f3c250491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:31.758374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0ff11e7-618c-41a5-a9bb-839f3c250491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:31.759067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0ff11e7-618c-41a5-a9bb-839f3c250491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:31.759513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0ff11e7-618c-41a5-a9bb-839f3c250491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:31.759928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0ff11e7-618c-41a5-a9bb-839f3c250491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:31.776712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:31.890565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c0ff11e7-618c-41a5-a9bb-839f3c250491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:31.899237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c0ff11e7-618c-41a5-a9bb-839f3c250491 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153200 Aug 31 00:55:31.899804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1492/2930] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:31 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:31.901873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:31.902359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:31.909137 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:31.909620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:31.910046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:31.910741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:31.911219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:31.911635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:31.977574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:31.986385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:31.987855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:31.989015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-da0d9638-0277-49c0-8dbb-277e3fcca06e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091176 Aug 31 00:55:31.989569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1439/2931] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:31 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:55:32.976947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1174a94c-4254-4700-acd6-e3377df285d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:32.977468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1174a94c-4254-4700-acd6-e3377df285d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:32.984616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1174a94c-4254-4700-acd6-e3377df285d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:32.985120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1174a94c-4254-4700-acd6-e3377df285d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:32.985558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1174a94c-4254-4700-acd6-e3377df285d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:32.986238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1174a94c-4254-4700-acd6-e3377df285d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:32.986688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1174a94c-4254-4700-acd6-e3377df285d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:32.987139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1174a94c-4254-4700-acd6-e3377df285d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:33.012651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:33.013256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:33.019642 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:33.020117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:33.020547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:33.021225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:33.021672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:33.022092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:33.101847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:33.111342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:33.112783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:33.113917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4bf44cd9-4f47-4b16-bd03-9608adc738db tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.105240 Aug 31 00:55:33.114473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1440/2932] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:33 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:55:33.146254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1174a94c-4254-4700-acd6-e3377df285d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:33.155127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1174a94c-4254-4700-acd6-e3377df285d8 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.182173 Aug 31 00:55:33.155690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1493/2933] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:32 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:34.137803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:34.138579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:34.145035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:34.145507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:34.145960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:34.146631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:34.147097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:34.147515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:34.176939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-903d2350-aafa-4cb4-9938-a5b34de136ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:34.177552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-903d2350-aafa-4cb4-9938-a5b34de136ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:34.184257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903d2350-aafa-4cb4-9938-a5b34de136ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:34.184739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903d2350-aafa-4cb4-9938-a5b34de136ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:34.185180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903d2350-aafa-4cb4-9938-a5b34de136ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:34.186695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903d2350-aafa-4cb4-9938-a5b34de136ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:34.187308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903d2350-aafa-4cb4-9938-a5b34de136ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:34.187738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-903d2350-aafa-4cb4-9938-a5b34de136ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:34.210133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:34.218978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:34.220536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:34.222299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-820f7720-8ea9-4560-9203-94fd97149234 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088408 Aug 31 00:55:34.222956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1441/2934] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:34 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:34.317595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-903d2350-aafa-4cb4-9938-a5b34de136ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:34.326522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-903d2350-aafa-4cb4-9938-a5b34de136ba tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152916 Aug 31 00:55:34.327307 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1494/2935] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:34 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:55:35.244931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:35.245472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:35.251930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:35.252403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:35.252830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:35.253504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:35.253950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:35.254367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:35.269337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:35.315782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:35.324552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:35.326506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:35.327685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-83f7dee3-f093-40f0-9564-0d0bb39747f3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086816 Aug 31 00:55:35.328238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1442/2936] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:35 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:35.348967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-872d4d50-f7d9-4c28-9344-1a4e541a38d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:35.349578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-872d4d50-f7d9-4c28-9344-1a4e541a38d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:35.356067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872d4d50-f7d9-4c28-9344-1a4e541a38d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:35.356553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872d4d50-f7d9-4c28-9344-1a4e541a38d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:35.356991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872d4d50-f7d9-4c28-9344-1a4e541a38d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:35.357783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872d4d50-f7d9-4c28-9344-1a4e541a38d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:35.358237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872d4d50-f7d9-4c28-9344-1a4e541a38d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:35.358656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-872d4d50-f7d9-4c28-9344-1a4e541a38d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:35.486260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-872d4d50-f7d9-4c28-9344-1a4e541a38d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:35.494912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-872d4d50-f7d9-4c28-9344-1a4e541a38d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150187 Aug 31 00:55:35.495566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1495/2937] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:35 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:36.351442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:36.352078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:36.359331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:36.359803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:36.360231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:36.361064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:36.361511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:36.361953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:36.426029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:36.434825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:36.436521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:36.437645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b1c6601b-2df4-4f1e-877d-15f53e804363 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090290 Aug 31 00:55:36.438205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1443/2938] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:36 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:55:36.516683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0895c487-b04c-4d9c-a109-4bacc3924d05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:36.517283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0895c487-b04c-4d9c-a109-4bacc3924d05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:36.523714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0895c487-b04c-4d9c-a109-4bacc3924d05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:36.524188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0895c487-b04c-4d9c-a109-4bacc3924d05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:36.524619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0895c487-b04c-4d9c-a109-4bacc3924d05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:36.525293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0895c487-b04c-4d9c-a109-4bacc3924d05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:36.525738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0895c487-b04c-4d9c-a109-4bacc3924d05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:36.526161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0895c487-b04c-4d9c-a109-4bacc3924d05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:36.658916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0895c487-b04c-4d9c-a109-4bacc3924d05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:36.667059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0895c487-b04c-4d9c-a109-4bacc3924d05 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154188 Aug 31 00:55:36.667633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1496/2939] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:36 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:37.460517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:37.461127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:37.468090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:37.468569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:37.468992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:37.469666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:37.470105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:37.470522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:37.533014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:37.541482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:37.542898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:37.544052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-120c1266-88f7-4715-a1b3-1856b192cb05 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087499 Aug 31 00:55:37.544633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1444/2940] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:37 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:37.688978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f21cbe95-3bad-4a65-9d55-e9137d63744e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:37.689578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f21cbe95-3bad-4a65-9d55-e9137d63744e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:37.696088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21cbe95-3bad-4a65-9d55-e9137d63744e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:37.696567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21cbe95-3bad-4a65-9d55-e9137d63744e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:37.697001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21cbe95-3bad-4a65-9d55-e9137d63744e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:37.697740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21cbe95-3bad-4a65-9d55-e9137d63744e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:37.698434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21cbe95-3bad-4a65-9d55-e9137d63744e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:37.698593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f21cbe95-3bad-4a65-9d55-e9137d63744e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:37.828927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f21cbe95-3bad-4a65-9d55-e9137d63744e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:37.836999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f21cbe95-3bad-4a65-9d55-e9137d63744e tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151871 Aug 31 00:55:37.837562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1497/2941] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:37 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:38.566636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:38.567283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:38.573569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:38.574036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:38.574462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:38.575163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:38.575608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:38.576650 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:38.637715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:38.647351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:38.648793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:38.649918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e104e625-9e8a-4544-882d-cb9fd9961b0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087171 Aug 31 00:55:38.650475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1445/2942] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:38 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:38.859285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-14d1acab-5b58-404f-9293-55a036661610 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:38.859895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-14d1acab-5b58-404f-9293-55a036661610 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:38.866322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14d1acab-5b58-404f-9293-55a036661610 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:38.866805 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14d1acab-5b58-404f-9293-55a036661610 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:38.867284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14d1acab-5b58-404f-9293-55a036661610 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:38.867999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14d1acab-5b58-404f-9293-55a036661610 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:38.868452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14d1acab-5b58-404f-9293-55a036661610 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:38.868874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-14d1acab-5b58-404f-9293-55a036661610 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:38.999465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-14d1acab-5b58-404f-9293-55a036661610 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:39.007585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-14d1acab-5b58-404f-9293-55a036661610 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152353 Aug 31 00:55:39.008139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1498/2943] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:38 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:39.672987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:39.673607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:39.680094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:39.680566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:39.680994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:39.681669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:39.682115 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:39.682530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:39.744701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:39.753435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:39.754864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:39.756027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-83a2e184-e589-40ae-80ee-a2936a7bccbe tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087717 Aug 31 00:55:39.756585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1446/2944] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:39 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:40.028490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d808deb2-c8ef-4fae-85e9-71850a5c412c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:40.029331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d808deb2-c8ef-4fae-85e9-71850a5c412c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:40.035954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d808deb2-c8ef-4fae-85e9-71850a5c412c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:40.036438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d808deb2-c8ef-4fae-85e9-71850a5c412c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:40.036871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d808deb2-c8ef-4fae-85e9-71850a5c412c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:40.037551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d808deb2-c8ef-4fae-85e9-71850a5c412c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:40.038001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d808deb2-c8ef-4fae-85e9-71850a5c412c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:40.038423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d808deb2-c8ef-4fae-85e9-71850a5c412c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:40.170399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d808deb2-c8ef-4fae-85e9-71850a5c412c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:40.178752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d808deb2-c8ef-4fae-85e9-71850a5c412c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154067 Aug 31 00:55:40.179365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1499/2945] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:40 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:40.779215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:40.780006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:40.786374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:40.786856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:40.787360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:40.788046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:40.788496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:40.788920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:40.865898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:40.875757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:40.877190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:40.878315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b766f4ab-1c73-4772-935f-760023b47cc3 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.103214 Aug 31 00:55:40.878867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1447/2946] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:40 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:41.200605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-09b73c9a-47df-4545-a1a2-014ec01bb7d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:41.201402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-09b73c9a-47df-4545-a1a2-014ec01bb7d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:41.207783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09b73c9a-47df-4545-a1a2-014ec01bb7d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:41.208255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09b73c9a-47df-4545-a1a2-014ec01bb7d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:41.208680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09b73c9a-47df-4545-a1a2-014ec01bb7d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:41.209349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09b73c9a-47df-4545-a1a2-014ec01bb7d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:41.209790 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09b73c9a-47df-4545-a1a2-014ec01bb7d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:41.210201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09b73c9a-47df-4545-a1a2-014ec01bb7d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:41.339748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-09b73c9a-47df-4545-a1a2-014ec01bb7d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:41.348845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-09b73c9a-47df-4545-a1a2-014ec01bb7d9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152055 Aug 31 00:55:41.349405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1500/2947] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:41 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:41.901468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:41.902117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:41.904402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=54 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:41.909601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:41.910077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:41.910507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:41.911282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:41.911734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:41.912152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:41.973079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:41.982481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:41.984143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:41.985289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fb05bd43-ed8b-41ed-bb60-b04f37c9f90e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087760 Aug 31 00:55:41.985840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1448/2948] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:41 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:42.369719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4dda7bb-c53d-4b5a-896d-5cc62a013e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:42.370329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4dda7bb-c53d-4b5a-896d-5cc62a013e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:42.376929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4dda7bb-c53d-4b5a-896d-5cc62a013e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:42.377408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4dda7bb-c53d-4b5a-896d-5cc62a013e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:42.377842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4dda7bb-c53d-4b5a-896d-5cc62a013e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:42.378518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4dda7bb-c53d-4b5a-896d-5cc62a013e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:42.378965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4dda7bb-c53d-4b5a-896d-5cc62a013e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:42.379409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4dda7bb-c53d-4b5a-896d-5cc62a013e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:42.515318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f4dda7bb-c53d-4b5a-896d-5cc62a013e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:42.523476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4dda7bb-c53d-4b5a-896d-5cc62a013e04 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157626 Aug 31 00:55:42.524042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1501/2949] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:42 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:43.008502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:43.009105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:43.016154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:43.016631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:43.017060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:43.017735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:43.018180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:43.018594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:43.082179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:43.090927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:43.093249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:43.094412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-475b86f5-6f66-4559-a5d0-4b43b9de55be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089781 Aug 31 00:55:43.094972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1449/2950] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:43 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:43.545945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9406d60b-f980-434e-9eb7-63b243dbb9f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:43.546552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9406d60b-f980-434e-9eb7-63b243dbb9f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:43.553043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9406d60b-f980-434e-9eb7-63b243dbb9f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:43.553522 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9406d60b-f980-434e-9eb7-63b243dbb9f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:43.553957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9406d60b-f980-434e-9eb7-63b243dbb9f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:43.554638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9406d60b-f980-434e-9eb7-63b243dbb9f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:43.555123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9406d60b-f980-434e-9eb7-63b243dbb9f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:43.555549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9406d60b-f980-434e-9eb7-63b243dbb9f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:43.684869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9406d60b-f980-434e-9eb7-63b243dbb9f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:43.693901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9406d60b-f980-434e-9eb7-63b243dbb9f9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.152516 Aug 31 00:55:43.694460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1502/2951] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:43 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:44.118289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:44.118893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:44.125488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:44.125964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:44.126393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:44.127099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:44.127545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:44.127964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:44.339488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:44.349249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:44.350700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:44.351858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-44aea861-ddbf-4807-8bc6-84e252c2a497 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.237457 Aug 31 00:55:44.352408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1450/2952] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:44 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:44.715198 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3ffc5c3e-c8f8-4f43-8e52-00e86a2a43cb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:44.715748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3ffc5c3e-c8f8-4f43-8e52-00e86a2a43cb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:44.722508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c3e-c8f8-4f43-8e52-00e86a2a43cb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:44.722986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c3e-c8f8-4f43-8e52-00e86a2a43cb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:44.723446 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c3e-c8f8-4f43-8e52-00e86a2a43cb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:44.724123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c3e-c8f8-4f43-8e52-00e86a2a43cb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:44.724571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c3e-c8f8-4f43-8e52-00e86a2a43cb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:44.724989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c3e-c8f8-4f43-8e52-00e86a2a43cb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:44.859163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3ffc5c3e-c8f8-4f43-8e52-00e86a2a43cb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:44.867395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3ffc5c3e-c8f8-4f43-8e52-00e86a2a43cb tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.156144 Aug 31 00:55:44.867958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1503/2953] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:44 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:45.374500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:45.375131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:45.381569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:45.382045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:45.382474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:45.383177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:45.383626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:45.384043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:45.445772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:45.454498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:45.455949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:45.457071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7ec5dce0-02eb-45a3-93ae-593e67c4f92a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087382 Aug 31 00:55:45.457618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1451/2954] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:45 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:45.889192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cd57fff3-a99b-45c0-ba94-b7156bba20c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:45.889801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cd57fff3-a99b-45c0-ba94-b7156bba20c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:45.896256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd57fff3-a99b-45c0-ba94-b7156bba20c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:45.896736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd57fff3-a99b-45c0-ba94-b7156bba20c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:45.897170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd57fff3-a99b-45c0-ba94-b7156bba20c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:45.897848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd57fff3-a99b-45c0-ba94-b7156bba20c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:45.898301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd57fff3-a99b-45c0-ba94-b7156bba20c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:45.898720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd57fff3-a99b-45c0-ba94-b7156bba20c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:46.030467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cd57fff3-a99b-45c0-ba94-b7156bba20c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:46.038708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cd57fff3-a99b-45c0-ba94-b7156bba20c4 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.153521 Aug 31 00:55:46.039318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1504/2955] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:45 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:46.480359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:46.481046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:46.488385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:46.488857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:46.489286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:46.490016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:46.490465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:46.490877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:46.552171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:46.561578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:46.563013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:46.564248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-87b86d5e-10af-49fa-8d07-bb6833e1928c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087793 Aug 31 00:55:46.564789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1452/2956] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:46 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:47.061139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ebd84637-74b3-412e-bffc-37662a06b998 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:47.061764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ebd84637-74b3-412e-bffc-37662a06b998 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:47.068129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd84637-74b3-412e-bffc-37662a06b998 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:47.068604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd84637-74b3-412e-bffc-37662a06b998 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:47.069035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd84637-74b3-412e-bffc-37662a06b998 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:47.069709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd84637-74b3-412e-bffc-37662a06b998 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:47.070153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd84637-74b3-412e-bffc-37662a06b998 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:47.070571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebd84637-74b3-412e-bffc-37662a06b998 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:47.204153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ebd84637-74b3-412e-bffc-37662a06b998 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:47.212333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ebd84637-74b3-412e-bffc-37662a06b998 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155641 Aug 31 00:55:47.212895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1505/2957] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:47 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:47.586799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:47.587466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:47.594458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:47.594930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:47.595383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:47.596313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:47.596809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:47.597228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:47.657900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:47.666306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:47.667771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:47.668883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-71d75565-b20c-4a58-8eda-ac2095636160 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.085994 Aug 31 00:55:47.669426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1453/2958] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:47 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:48.235608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d3706d8c-f22f-4017-a6d1-c2621662f948 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:48.236190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d3706d8c-f22f-4017-a6d1-c2621662f948 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:48.238575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:48.243741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3706d8c-f22f-4017-a6d1-c2621662f948 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:48.244221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3706d8c-f22f-4017-a6d1-c2621662f948 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:48.244652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3706d8c-f22f-4017-a6d1-c2621662f948 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:48.245384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3706d8c-f22f-4017-a6d1-c2621662f948 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:48.245782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3706d8c-f22f-4017-a6d1-c2621662f948 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:48.246203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3706d8c-f22f-4017-a6d1-c2621662f948 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:48.377896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d3706d8c-f22f-4017-a6d1-c2621662f948 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:48.386266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d3706d8c-f22f-4017-a6d1-c2621662f948 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.155252 Aug 31 00:55:48.386831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1506/2959] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:48 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:55:48.692346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:48.692947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:48.699393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:48.699879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:48.700312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:48.700994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:48.701443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:48.702404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:48.765752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:48.774263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:48.775727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:48.776828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b95dfa8a-c672-4a64-a93a-86b8d55984e4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088617 Aug 31 00:55:48.777371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1454/2960] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:48 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:49.407655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c600836e-85d9-4326-8ad8-d523b470634a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:49.408256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c600836e-85d9-4326-8ad8-d523b470634a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:49.414668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c600836e-85d9-4326-8ad8-d523b470634a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:49.415180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c600836e-85d9-4326-8ad8-d523b470634a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:49.415613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c600836e-85d9-4326-8ad8-d523b470634a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:49.416288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c600836e-85d9-4326-8ad8-d523b470634a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:49.416730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c600836e-85d9-4326-8ad8-d523b470634a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:49.417142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c600836e-85d9-4326-8ad8-d523b470634a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:49.544007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c600836e-85d9-4326-8ad8-d523b470634a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:49.552947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c600836e-85d9-4326-8ad8-d523b470634a tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.149331 Aug 31 00:55:49.553508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1507/2961] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:49 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:49.800410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:49.801002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:49.807367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:49.807840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:49.808266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:49.808968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:49.809417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:49.809831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:49.874308 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:49.882937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:49.884387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:49.885548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b66b3142-5c60-4cf6-aaf1-d6dae2dc7c41 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.089056 Aug 31 00:55:49.886099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1455/2962] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:49 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:50.574700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67b558ce-7bf5-4552-b9ac-bd69075e619c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:50.575343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-67b558ce-7bf5-4552-b9ac-bd69075e619c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:50.582233 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67b558ce-7bf5-4552-b9ac-bd69075e619c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:50.582718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67b558ce-7bf5-4552-b9ac-bd69075e619c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:50.583216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67b558ce-7bf5-4552-b9ac-bd69075e619c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:50.583904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67b558ce-7bf5-4552-b9ac-bd69075e619c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:50.584357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67b558ce-7bf5-4552-b9ac-bd69075e619c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:50.584782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67b558ce-7bf5-4552-b9ac-bd69075e619c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:50.716089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67b558ce-7bf5-4552-b9ac-bd69075e619c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:50.725267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67b558ce-7bf5-4552-b9ac-bd69075e619c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.154554 Aug 31 00:55:50.725837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1508/2963] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:50 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:50.909005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:50.909638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:50.916047 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:50.916530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:50.916954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:50.917634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:50.918079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:50.918494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:50.982103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:50.990788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:50.992234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:50.993367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3153bc10-cbb2-48e5-8fa1-49824d368e0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.088872 Aug 31 00:55:50.993913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1456/2964] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:50 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:51.746983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3bb30349-0724-4c63-9a81-1e222084823f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:51.747619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3bb30349-0724-4c63-9a81-1e222084823f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:51.754728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb30349-0724-4c63-9a81-1e222084823f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:51.755249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb30349-0724-4c63-9a81-1e222084823f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:51.755685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb30349-0724-4c63-9a81-1e222084823f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:51.756372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb30349-0724-4c63-9a81-1e222084823f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:51.756826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb30349-0724-4c63-9a81-1e222084823f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:51.757248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bb30349-0724-4c63-9a81-1e222084823f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:51.759806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:51.903937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3bb30349-0724-4c63-9a81-1e222084823f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:51.912222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3bb30349-0724-4c63-9a81-1e222084823f tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.169245 Aug 31 00:55:51.912787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1509/2965] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:51 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:52.015873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:52.016474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:52.022867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:52.023371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:52.023800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:52.024473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:52.024920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:52.025591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:52.087386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:52.096960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:52.098451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:52.099625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-66cb873a-07db-474c-9b11-a4ef3878445b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087787 Aug 31 00:55:52.100184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1457/2966] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:52 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:52.933589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3c5f6ae4-cb0e-4558-b249-80987b2ec849 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:52.934217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3c5f6ae4-cb0e-4558-b249-80987b2ec849 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:52.941088 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c5f6ae4-cb0e-4558-b249-80987b2ec849 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:52.941568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c5f6ae4-cb0e-4558-b249-80987b2ec849 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:52.941999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c5f6ae4-cb0e-4558-b249-80987b2ec849 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:52.942676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c5f6ae4-cb0e-4558-b249-80987b2ec849 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:52.943151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c5f6ae4-cb0e-4558-b249-80987b2ec849 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:52.943570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3c5f6ae4-cb0e-4558-b249-80987b2ec849 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:53.069528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3c5f6ae4-cb0e-4558-b249-80987b2ec849 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:53.077787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3c5f6ae4-cb0e-4558-b249-80987b2ec849 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.148039 Aug 31 00:55:53.078352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1510/2967] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:52 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:53.121747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:53.122333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:53.128792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:53.129259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:53.129680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:53.130346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:53.130783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:53.131222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:53.193162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:53.201635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:53.203693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:53.204835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3ee5a981-611e-4e20-97e4-a6b5845c5df5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.086926 Aug 31 00:55:53.205391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1458/2968] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:53 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:54.099512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b34b5a1f-548d-417c-9018-86a36b0a30db tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:54.100141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b34b5a1f-548d-417c-9018-86a36b0a30db tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:54.106565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b34b5a1f-548d-417c-9018-86a36b0a30db tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:54.107061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b34b5a1f-548d-417c-9018-86a36b0a30db tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:54.107508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b34b5a1f-548d-417c-9018-86a36b0a30db tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:54.108745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b34b5a1f-548d-417c-9018-86a36b0a30db tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:54.109204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b34b5a1f-548d-417c-9018-86a36b0a30db tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:54.109725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b34b5a1f-548d-417c-9018-86a36b0a30db tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:54.228234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:54.228853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:54.236911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:54.236911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:54.237255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:54.237958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:54.238421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:54.238624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b34b5a1f-548d-417c-9018-86a36b0a30db tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:54.238847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:54.243010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:55:54.247436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b34b5a1f-548d-417c-9018-86a36b0a30db tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.151932 Aug 31 00:55:54.247993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1511/2969] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:54 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:54.300795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:54.309269 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:54.310697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:54.312054 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-63a4593d-a73b-4ed6-8925-ba4f441b1f0c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.087558 Aug 31 00:55:54.312615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1459/2970] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:54 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:55:55.268802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3128ddd5-3b9a-4c9e-9893-0c1a3ab0b991 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:55.269360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3128ddd5-3b9a-4c9e-9893-0c1a3ab0b991 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:55.275842 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3128ddd5-3b9a-4c9e-9893-0c1a3ab0b991 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:55.276321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3128ddd5-3b9a-4c9e-9893-0c1a3ab0b991 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:55.276749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3128ddd5-3b9a-4c9e-9893-0c1a3ab0b991 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:55.277428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3128ddd5-3b9a-4c9e-9893-0c1a3ab0b991 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:55.277874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3128ddd5-3b9a-4c9e-9893-0c1a3ab0b991 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:55.278292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3128ddd5-3b9a-4c9e-9893-0c1a3ab0b991 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:55.336396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:55.337134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:55.343892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:55.344608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:55.345046 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:55.346009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:55.346460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:55.346926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:55.427654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:55.431670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3128ddd5-3b9a-4c9e-9893-0c1a3ab0b991 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:55.436485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:55.438715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:55.439911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5115e01b-d824-4ba6-9f3a-60c93a4a1ed5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.107520 Aug 31 00:55:55.440671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1460/2971] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:55 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:55:55.440811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3128ddd5-3b9a-4c9e-9893-0c1a3ab0b991 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.175814 Aug 31 00:55:55.441064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1512/2972] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:55 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:56.461388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8ed347c5-5765-427a-ae63-6f0b8ab90254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:56.462025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:56.462407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8ed347c5-5765-427a-ae63-6f0b8ab90254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:56.462528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:56.469554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:56.469801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ed347c5-5765-427a-ae63-6f0b8ab90254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:56.470035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:56.470166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ed347c5-5765-427a-ae63-6f0b8ab90254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:56.470466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:56.470842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ed347c5-5765-427a-ae63-6f0b8ab90254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:56.471433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:56.471561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ed347c5-5765-427a-ae63-6f0b8ab90254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:56.471882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:56.472012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ed347c5-5765-427a-ae63-6f0b8ab90254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:56.472302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ed347c5-5765-427a-ae63-6f0b8ab90254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:56.472427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:56.559304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:56.568261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:56.570352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:56.571529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-37d91d96-2ff7-4ad4-9ddb-f2ee4fd3b1ab tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.113890 Aug 31 00:55:56.572097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1513/2973] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:56 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:55:56.628968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8ed347c5-5765-427a-ae63-6f0b8ab90254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:56.637656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8ed347c5-5765-427a-ae63-6f0b8ab90254 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.180173 Aug 31 00:55:56.638303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1461/2974] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:56 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:57.596209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:57.596835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:57.603256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:57.603732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:57.604169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:57.604840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:57.605287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:57.605701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:57.658874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b0c5ad11-ba86-4502-8358-b39e4056ffa9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:57.659529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b0c5ad11-ba86-4502-8358-b39e4056ffa9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:57.665939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0c5ad11-ba86-4502-8358-b39e4056ffa9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:57.666430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0c5ad11-ba86-4502-8358-b39e4056ffa9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:57.666865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0c5ad11-ba86-4502-8358-b39e4056ffa9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:57.667582 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0c5ad11-ba86-4502-8358-b39e4056ffa9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:57.668035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0c5ad11-ba86-4502-8358-b39e4056ffa9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:57.668460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b0c5ad11-ba86-4502-8358-b39e4056ffa9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:57.672899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:57.681404 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:57.682848 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:57.684014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-045847e3-8175-4fcc-8aae-3fbbc9047dda tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.092130 Aug 31 00:55:57.684581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1514/2975] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:57 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:55:57.806549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b0c5ad11-ba86-4502-8358-b39e4056ffa9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:57.815184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b0c5ad11-ba86-4502-8358-b39e4056ffa9 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.160501 Aug 31 00:55:57.815747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1462/2976] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:57 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:55:58.708312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:58.708856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:58.716276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:58.716770 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:58.717197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:58.717864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:58.718346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:58.718761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:58.781278 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:58.792003 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:58.793500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:58.794622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0ca20e1d-733c-4ec7-a89c-38ad44829fb8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.090309 Aug 31 00:55:58.795325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1515/2977] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:58 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:55:58.836584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e12c24d0-4cb0-47ec-98b9-217305a0d9aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:58.837193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e12c24d0-4cb0-47ec-98b9-217305a0d9aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:58.843946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e12c24d0-4cb0-47ec-98b9-217305a0d9aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:58.844474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e12c24d0-4cb0-47ec-98b9-217305a0d9aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:58.844912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e12c24d0-4cb0-47ec-98b9-217305a0d9aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:58.845862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e12c24d0-4cb0-47ec-98b9-217305a0d9aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:58.846313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e12c24d0-4cb0-47ec-98b9-217305a0d9aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:58.846738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e12c24d0-4cb0-47ec-98b9-217305a0d9aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:58.974439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e12c24d0-4cb0-47ec-98b9-217305a0d9aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:58.982739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e12c24d0-4cb0-47ec-98b9-217305a0d9aa tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.150003 Aug 31 00:55:58.983327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1463/2978] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:58 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:55:59.863998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:55:59.864640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:55:59.870526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:59.871006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:59.871487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:59.872171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:55:59.872651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:55:59.873076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:55:59.933691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:59.943250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:59.944691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:55:59.945823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-954036eb-d1e9-443e-b8a9-883418529e88 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.132110 Aug 31 00:55:59.946385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1516/2979] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:55:59 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:00.004931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b9572e94-4534-401b-869b-350671c7f4cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:00.005573 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b9572e94-4534-401b-869b-350671c7f4cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:00.011972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9572e94-4534-401b-869b-350671c7f4cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:00.012460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9572e94-4534-401b-869b-350671c7f4cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:00.012896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9572e94-4534-401b-869b-350671c7f4cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:00.013609 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9572e94-4534-401b-869b-350671c7f4cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:00.014061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9572e94-4534-401b-869b-350671c7f4cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:00.014486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9572e94-4534-401b-869b-350671c7f4cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:00.149629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b9572e94-4534-401b-869b-350671c7f4cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:00.158334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b9572e94-4534-401b-869b-350671c7f4cc tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.157563 Aug 31 00:56:00.158913 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1464/2980] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:55:59 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:56:00.969115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:00.969924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:00.976792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:00.977274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:00.977708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:00.978500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:00.978951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:00.979474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:01.044594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:01.053887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:01.055346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:01.056501 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2952f37c-d90f-43a9-91d6-68fa400c9b92 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 200 len: 1445 microversion: 2.20 time: 0.091911 Aug 31 00:56:01.057046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1517/2981] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:00 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:01.079001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b90097b8-da8e-4ce1-9e20-7431a81fdb67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '.version_select at 0x7fa7ef994430>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:01.101752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b90097b8-da8e-4ce1-9e20-7431a81fdb67 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413754213" status: 204 len: 0 microversion: 2.20 time: 0.027069 Aug 31 00:56:01.102310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1465/2982] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 31 00:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413754213 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 00:56:01.181853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9ec08209-e3c7-404f-a3e6-32509dfce36d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:01.182331 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9ec08209-e3c7-404f-a3e6-32509dfce36d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:01.188644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec08209-e3c7-404f-a3e6-32509dfce36d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:01.189133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec08209-e3c7-404f-a3e6-32509dfce36d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:01.189566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec08209-e3c7-404f-a3e6-32509dfce36d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:01.190263 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec08209-e3c7-404f-a3e6-32509dfce36d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:01.190716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec08209-e3c7-404f-a3e6-32509dfce36d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:01.191166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ec08209-e3c7-404f-a3e6-32509dfce36d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:01.583353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9ec08209-e3c7-404f-a3e6-32509dfce36d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:01.592933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9ec08209-e3c7-404f-a3e6-32509dfce36d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43" status: 200 len: 1735 microversion: 2.1 time: 0.415411 Aug 31 00:56:01.593524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1518/2983] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:56:01 2022] GET /compute/v2.1/servers/2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 => generated 1735 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:56:01.613457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3a5a4d56-62ee-41f6-a10f-4a8bcbff5336 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '.version_select at 0x7fa7f74c8f70>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:01.633564 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3a5a4d56-62ee-41f6-a10f-4a8bcbff5336 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-658308212" status: 202 len: 0 microversion: 2.1 time: 0.024171 Aug 31 00:56:01.634440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1466/2984] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 31 00:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-658308212 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:56:01.931555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e85a6da9-6c41-4dab-965e-c89758b1f974 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'create', calling method: .version_select at 0x7fa7efe96b80>, body: {"keypair": {"name": "tempest-keypair-1945340034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbHahV61RiJM3/td0wkfN6vqSgybiFBor0XdGfcMf5EPYTYxcvnMBJHHXOmTl6MplqrPjwPT6Va4cv2tAtKsaodcneBurnjF3OYQ2SAH+lMrnw1ZlR1j7vO2WqunyIQuw=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:56:01.948181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-e85a6da9-6c41-4dab-965e-c89758b1f974 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Getting quotas for project 5694aa9e83804fe19311f97ed6af1152. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:56:01.952185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-e85a6da9-6c41-4dab-965e-c89758b1f974 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Getting quotas for user 7d7582f9cdd646f39404f7adc99ad9ac and project 5694aa9e83804fe19311f97ed6af1152. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:56:01.978274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e85a6da9-6c41-4dab-965e-c89758b1f974 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050784 Aug 31 00:56:01.979255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1519/2985] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 31 00:56:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 00:56:02.588961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-e92c4210-b691-44a1-9f65-3c86ae118a15 req-d2097e1d-764d-4352-9936-74b77488931e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d43efc3-0d4e-4f0c-9242-7d5cf206ae43", "tag": "b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:56:02.601662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e92c4210-b691-44a1-9f65-3c86ae118a15 req-d2097e1d-764d-4352-9936-74b77488931e service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:02.602069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e92c4210-b691-44a1-9f65-3c86ae118a15 req-d2097e1d-764d-4352-9936-74b77488931e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:02.602523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e92c4210-b691-44a1-9f65-3c86ae118a15 req-d2097e1d-764d-4352-9936-74b77488931e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:02.615993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-e92c4210-b691-44a1-9f65-3c86ae118a15 req-d2097e1d-764d-4352-9936-74b77488931e service nova] Creating event network-changed:b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a for instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 on hv-cinder-85506 Aug 31 00:56:02.624393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-e92c4210-b691-44a1-9f65-3c86ae118a15 req-d2097e1d-764d-4352-9936-74b77488931e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038601 Aug 31 00:56:02.626015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1467/2986] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:56:03.356052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1349834827", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea586570-88f9-4102-abb0-4f2d89e46acd"}], "security_groups": [{"name": "tempest-securitygroup--114559822"}], "key_name": "tempest-keypair-1945340034", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:56:03.470374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] validate_networks() for [('ea586570-88f9-4102-abb0-4f2d89e46acd', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:56:03.865184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:56:03.865628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:56:03.866095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:56:03.866494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:56:03.866895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:56:03.876546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:03.877016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:03.877443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:03.878149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:03.878596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:03.879009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:03.896450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Getting quotas for project 5694aa9e83804fe19311f97ed6af1152. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:56:03.900515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Getting quotas for user 7d7582f9cdd646f39404f7adc99ad9ac and project 5694aa9e83804fe19311f97ed6af1152. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:56:03.911550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:56:03.913849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:56:03.966829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e90a2c57-8f0b-460e-98a2-418a3d978dd9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.616282 Aug 31 00:56:03.967769 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1520/2987] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 31 00:56:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 00:56:03.979699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a7a0cc25-7804-41fa-8cc6-dead86475099 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:03.980398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a7a0cc25-7804-41fa-8cc6-dead86475099 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:03.982527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:56:03.982856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 00:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 (ip 10.222.0.67) !!! Aug 31 00:56:04.040237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a7a0cc25-7804-41fa-8cc6-dead86475099 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:04.048674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a7a0cc25-7804-41fa-8cc6-dead86475099 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:04.050112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a7a0cc25-7804-41fa-8cc6-dead86475099 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:04.051225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a7a0cc25-7804-41fa-8cc6-dead86475099 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1282 microversion: 2.20 time: 0.075705 Aug 31 00:56:04.051777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1468/2988] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:03 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:56:05.074330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:05.074942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:05.083295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:05.083783 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:05.084221 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:05.084912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:05.085373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:05.085796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:05.148136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:05.158169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:05.160259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:05.161374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d82d36df-411d-43be-83fd-f3ba5052c59c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1334 microversion: 2.20 time: 0.092091 Aug 31 00:56:05.161983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1521/2989] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:05 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:06.185516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:06.186768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:06.195772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:06.196889 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:06.197414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:06.198216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:06.198697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:06.199148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:06.408539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:06.416894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:06.418337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:06.419457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8897138e-1592-4381-85ee-7df536a4c3ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1407 microversion: 2.20 time: 0.238084 Aug 31 00:56:06.420012 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1469/2990] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:06 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:06.715701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-60a7676b-8b29-4f70-bd3d-d401b52e88ac req-32b5258e-0940-4722-9227-b2f80ed6a13f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84565566-bd8b-456c-8e83-ffcf92c75eb6", "tag": "58c975ff-15b0-4244-9b51-c1f72d71088c"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:56:06.726371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-60a7676b-8b29-4f70-bd3d-d401b52e88ac req-32b5258e-0940-4722-9227-b2f80ed6a13f service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:06.726787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-60a7676b-8b29-4f70-bd3d-d401b52e88ac req-32b5258e-0940-4722-9227-b2f80ed6a13f service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:06.727336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-60a7676b-8b29-4f70-bd3d-d401b52e88ac req-32b5258e-0940-4722-9227-b2f80ed6a13f service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:06.738442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-60a7676b-8b29-4f70-bd3d-d401b52e88ac req-32b5258e-0940-4722-9227-b2f80ed6a13f service nova] Creating event network-changed:58c975ff-15b0-4244-9b51-c1f72d71088c for instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 on hv-cinder-85506 Aug 31 00:56:06.743497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-60a7676b-8b29-4f70-bd3d-d401b52e88ac req-32b5258e-0940-4722-9227-b2f80ed6a13f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031552 Aug 31 00:56:06.744093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1522/2991] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:56:07.443199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:07.443796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:07.450407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:07.450874 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:07.451326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:07.451998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:07.452438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:07.453482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:07.586666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:07.595147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:07.596883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:07.597985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5905affd-e7c9-4163-8e79-7487af15792a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1407 microversion: 2.20 time: 0.158742 Aug 31 00:56:07.598554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1470/2992] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:07 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:56:08.620904 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:08.621589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:08.628332 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:08.628859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:08.629295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:08.629971 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:08.630484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:08.630906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:08.764806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:08.773131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:08.774579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:08.775715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e5ab667d-6094-4814-be17-ae89d85601ad tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1407 microversion: 2.20 time: 0.159609 Aug 31 00:56:08.776271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1523/2993] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:08 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:09.799111 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:09.799715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:09.805916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:09.806487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:09.806927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:09.807640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:09.808090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:09.808509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:09.934835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:09.942852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:09.944321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:09.945412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-18793e2e-fe24-4bb5-b720-fce18b56b668 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1407 microversion: 2.20 time: 0.151011 Aug 31 00:56:09.945970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1471/2994] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:09 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:10.967647 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:10.968284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:10.974871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:10.975374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:10.975803 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:10.976485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:10.976937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:10.977353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:11.106174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:11.114907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:11.116371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:11.117494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-037773e7-25d9-40fa-b70a-5af8af969e43 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1407 microversion: 2.20 time: 0.153732 Aug 31 00:56:11.118049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1524/2995] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:10 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:12.139949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:12.141520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:12.143973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:12.151108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:12.151849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:12.152318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:12.153021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:12.153475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:12.153925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:12.287084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:12.295771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:12.297292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:12.298391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-961be274-1b64-4373-bd95-7a5f8b578f99 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1407 microversion: 2.20 time: 0.162349 Aug 31 00:56:12.298950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1472/2996] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:12 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:13.321654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:13.322291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:13.329735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:13.330206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:13.330631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:13.331338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:13.331785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:13.332199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:13.462613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:13.471490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:13.472934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:13.474126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a1dd4e76-74e0-48fd-b821-a67479c20192 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1407 microversion: 2.20 time: 0.156351 Aug 31 00:56:13.474603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1525/2997] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:13 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:13.631327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-3455f4c9-4a61-4f26-93b1-c63e890ef856 req-6f3cea19-ab5f-4de7-92f3-7f20cc1ecd0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84565566-bd8b-456c-8e83-ffcf92c75eb6", "name": "network-vif-plugged", "status": "completed", "tag": "58c975ff-15b0-4244-9b51-c1f72d71088c"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:56:13.642873 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3455f4c9-4a61-4f26-93b1-c63e890ef856 req-6f3cea19-ab5f-4de7-92f3-7f20cc1ecd0d service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:13.644187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3455f4c9-4a61-4f26-93b1-c63e890ef856 req-6f3cea19-ab5f-4de7-92f3-7f20cc1ecd0d service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:13.644638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3455f4c9-4a61-4f26-93b1-c63e890ef856 req-6f3cea19-ab5f-4de7-92f3-7f20cc1ecd0d service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:13.657427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-3455f4c9-4a61-4f26-93b1-c63e890ef856 req-6f3cea19-ab5f-4de7-92f3-7f20cc1ecd0d service nova] Creating event network-vif-plugged:58c975ff-15b0-4244-9b51-c1f72d71088c for instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 on hv-cinder-85506 Aug 31 00:56:13.663399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-3455f4c9-4a61-4f26-93b1-c63e890ef856 req-6f3cea19-ab5f-4de7-92f3-7f20cc1ecd0d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035279 Aug 31 00:56:13.664185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1473/2998] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:56:14.497944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:14.498573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:14.500655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:14.501543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=10 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:14.507619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:14.508093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:14.508517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:14.509190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:14.509629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:14.510044 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:14.639167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:14.654121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:14.657589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:14.659658 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-320bfe6e-c8d7-4ac2-9079-b2026423402c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1407 microversion: 2.20 time: 0.165301 Aug 31 00:56:14.660686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1526/2999] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:14 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:15.688488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:15.689191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:15.691224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:15.696947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:15.697433 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:15.697871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:15.698554 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:15.699005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:15.699517 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:15.862156 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:15.870481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:15.871943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:15.873042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dc8a4347-e995-45c6-82b7-a13340dd6093 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1407 microversion: 2.20 time: 0.189700 Aug 31 00:56:15.873600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1474/3000] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:15 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:16.896886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:16.897503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:16.903997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:16.904478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:16.904913 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:16.906277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:16.906744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:16.907203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:17.040646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:17.054408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:17.055867 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:56:17.057012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-06943e54-fc81-4361-8106-da707e9e7b51 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1599 microversion: 2.20 time: 0.164349 Aug 31 00:56:17.057569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1527/3001] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:56:16 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:56:17.079350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3a329cf2-6199-43c2-8ae8-461015a56032 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:56:17.079895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3a329cf2-6199-43c2-8ae8-461015a56032 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:56:17.086174 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a329cf2-6199-43c2-8ae8-461015a56032 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:17.086652 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a329cf2-6199-43c2-8ae8-461015a56032 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:17.087109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a329cf2-6199-43c2-8ae8-461015a56032 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:17.087789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a329cf2-6199-43c2-8ae8-461015a56032 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:17.088236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a329cf2-6199-43c2-8ae8-461015a56032 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:17.088654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3a329cf2-6199-43c2-8ae8-461015a56032 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:17.163372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3a329cf2-6199-43c2-8ae8-461015a56032 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087982 Aug 31 00:56:17.164010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1475/3002] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 31 00:56:17 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:56:18.102157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-925912e2-5ac9-42e1-8dd0-08d458706a5c req-c7296130-0f6e-483d-9abd-eb7b4165aca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84565566-bd8b-456c-8e83-ffcf92c75eb6", "tag": "58c975ff-15b0-4244-9b51-c1f72d71088c"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:56:18.112994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-925912e2-5ac9-42e1-8dd0-08d458706a5c req-c7296130-0f6e-483d-9abd-eb7b4165aca3 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:56:18.113561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-925912e2-5ac9-42e1-8dd0-08d458706a5c req-c7296130-0f6e-483d-9abd-eb7b4165aca3 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:56:18.114076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-925912e2-5ac9-42e1-8dd0-08d458706a5c req-c7296130-0f6e-483d-9abd-eb7b4165aca3 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:56:18.117895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:56:18.126022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-925912e2-5ac9-42e1-8dd0-08d458706a5c req-c7296130-0f6e-483d-9abd-eb7b4165aca3 service nova] Creating event network-changed:58c975ff-15b0-4244-9b51-c1f72d71088c for instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 on hv-cinder-85506 Aug 31 00:56:18.131144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-925912e2-5ac9-42e1-8dd0-08d458706a5c req-c7296130-0f6e-483d-9abd-eb7b4165aca3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032598 Aug 31 00:56:18.131824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1528/3003] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:57:30.107818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=7 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:30.108566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=73 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:30.112887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c7af5707-ccd4-4b8e-9d1e-2a228d9830a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:57:30.113373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c7af5707-ccd4-4b8e-9d1e-2a228d9830a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:57:30.120974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7af5707-ccd4-4b8e-9d1e-2a228d9830a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:57:30.121454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7af5707-ccd4-4b8e-9d1e-2a228d9830a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:57:30.121888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7af5707-ccd4-4b8e-9d1e-2a228d9830a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:57:30.122579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7af5707-ccd4-4b8e-9d1e-2a228d9830a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:57:30.123018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7af5707-ccd4-4b8e-9d1e-2a228d9830a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:57:30.123460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7af5707-ccd4-4b8e-9d1e-2a228d9830a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:57:30.150502 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c7af5707-ccd4-4b8e-9d1e-2a228d9830a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/ips" status: 200 len: 152 microversion: 2.20 time: 0.044587 Aug 31 00:57:30.151095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1476/3004] 10.222.0.67 () {60 vars in 1289 bytes} [Wed Aug 31 00:57:30 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:57:57.161118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df60b97a-555e-48e1-9889-ad3e834c9e75] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 00:57:57.162598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:57.164875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:57:57.171022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e980111f-fe46-44c5-a520-e3cd3ae50e7f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d7b11de-a137-4ac4-bb64-c7fc45402bf7"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:57:57.173312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e980111f-fe46-44c5-a520-e3cd3ae50e7f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:57:57.181978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e980111f-fe46-44c5-a520-e3cd3ae50e7f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:57:57.182317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e980111f-fe46-44c5-a520-e3cd3ae50e7f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:57:57.182743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e980111f-fe46-44c5-a520-e3cd3ae50e7f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:57:57.183457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e980111f-fe46-44c5-a520-e3cd3ae50e7f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:57:57.183908 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e980111f-fe46-44c5-a520-e3cd3ae50e7f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:57:57.184325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e980111f-fe46-44c5-a520-e3cd3ae50e7f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:57:58.171568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] [df60b97a-555e-48e1-9889-ad3e834c9e75] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40678. Aug 31 00:58:01.709741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e980111f-fe46-44c5-a520-e3cd3ae50e7f tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "POST /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.549984 Aug 31 00:58:01.716646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1529/3005] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 00:57:57 2022] POST /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments => generated 194 bytes in 4558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:03.857287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:03.859402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:03.940416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a794d8a7-85cf-44bf-aeba-93d1eb2b340c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:03.941351 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a794d8a7-85cf-44bf-aeba-93d1eb2b340c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:03.949925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a794d8a7-85cf-44bf-aeba-93d1eb2b340c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:03.952033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a794d8a7-85cf-44bf-aeba-93d1eb2b340c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:03.953927 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a794d8a7-85cf-44bf-aeba-93d1eb2b340c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:03.955655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a794d8a7-85cf-44bf-aeba-93d1eb2b340c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:03.957028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a794d8a7-85cf-44bf-aeba-93d1eb2b340c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:03.957560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a794d8a7-85cf-44bf-aeba-93d1eb2b340c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:04.015684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a794d8a7-85cf-44bf-aeba-93d1eb2b340c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:58:04.079788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-c02340b6-d30e-4361-8c3f-94786ae22a9b req-c15ec64d-dfd9-440c-a2f7-6ed4c9ea133a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d43efc3-0d4e-4f0c-9242-7d5cf206ae43", "name": "network-vif-deleted", "tag": "b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:04.091536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c02340b6-d30e-4361-8c3f-94786ae22a9b req-c15ec64d-dfd9-440c-a2f7-6ed4c9ea133a service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:04.092055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c02340b6-d30e-4361-8c3f-94786ae22a9b req-c15ec64d-dfd9-440c-a2f7-6ed4c9ea133a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:04.092546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c02340b6-d30e-4361-8c3f-94786ae22a9b req-c15ec64d-dfd9-440c-a2f7-6ed4c9ea133a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:04.108579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-c02340b6-d30e-4361-8c3f-94786ae22a9b req-c15ec64d-dfd9-440c-a2f7-6ed4c9ea133a service nova] Creating event network-vif-deleted:b3ed4ce3-6ea4-4c50-baf1-03a1ceb7467a for instance 2d43efc3-0d4e-4f0c-9242-7d5cf206ae43 on hv-cinder-85506 Aug 31 00:58:04.115990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-c02340b6-d30e-4361-8c3f-94786ae22a9b req-c15ec64d-dfd9-440c-a2f7-6ed4c9ea133a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266303 Aug 31 00:58:04.116991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1477/3006] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:04.136896 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a794d8a7-85cf-44bf-aeba-93d1eb2b340c tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 204 len: 0 microversion: 2.1 time: 0.201569 Aug 31 00:58:04.137954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1530/3007] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:58:03 2022] DELETE /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:58:04.148104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ed0736ea-da33-45c6-bf0b-a8fd5d8812ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:04.149815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ed0736ea-da33-45c6-bf0b-a8fd5d8812ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:04.156741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed0736ea-da33-45c6-bf0b-a8fd5d8812ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:04.157302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed0736ea-da33-45c6-bf0b-a8fd5d8812ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:04.158015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed0736ea-da33-45c6-bf0b-a8fd5d8812ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:04.158796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed0736ea-da33-45c6-bf0b-a8fd5d8812ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:04.159342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed0736ea-da33-45c6-bf0b-a8fd5d8812ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:04.159834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed0736ea-da33-45c6-bf0b-a8fd5d8812ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:04.299380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ed0736ea-da33-45c6-bf0b-a8fd5d8812ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:04.309245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ed0736ea-da33-45c6-bf0b-a8fd5d8812ae tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1507 microversion: 2.1 time: 0.165999 Aug 31 00:58:04.310890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1478/3008] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:04 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:58:04.681012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3797b856-d8ba-450b-94e8-da8c289b95ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:04.681613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3797b856-d8ba-450b-94e8-da8c289b95ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:04.687950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3797b856-d8ba-450b-94e8-da8c289b95ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:04.688430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3797b856-d8ba-450b-94e8-da8c289b95ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:04.688866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3797b856-d8ba-450b-94e8-da8c289b95ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:04.689546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3797b856-d8ba-450b-94e8-da8c289b95ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:04.689995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3797b856-d8ba-450b-94e8-da8c289b95ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:04.690416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3797b856-d8ba-450b-94e8-da8c289b95ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:04.714510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-3797b856-d8ba-450b-94e8-da8c289b95ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'flavor' on Instance uuid 84565566-bd8b-456c-8e83-ffcf92c75eb6 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:58:04.889768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3797b856-d8ba-450b-94e8-da8c289b95ac tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/action" status: 202 len: 0 microversion: 2.20 time: 0.213839 Aug 31 00:58:04.890360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1531/3009] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 31 00:58:04 2022] POST /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:58:04.898542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:04.899165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:04.905619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:04.906120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:04.906608 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:04.907313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:04.907761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:04.908180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:05.043864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:05.052175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:05.053588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:05.055427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ca85158d-1a2e-402e-89b2-72a20c414aed tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.160082 Aug 31 00:58:05.055972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1479/3010] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:04 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:05.331000 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-87713142-f0bd-4c11-9b3e-067066a4e113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:05.331717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-87713142-f0bd-4c11-9b3e-067066a4e113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:05.339740 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87713142-f0bd-4c11-9b3e-067066a4e113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:05.340225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87713142-f0bd-4c11-9b3e-067066a4e113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:05.340660 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87713142-f0bd-4c11-9b3e-067066a4e113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:05.341344 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87713142-f0bd-4c11-9b3e-067066a4e113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:05.341791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87713142-f0bd-4c11-9b3e-067066a4e113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:05.342214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-87713142-f0bd-4c11-9b3e-067066a4e113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:05.480737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-87713142-f0bd-4c11-9b3e-067066a4e113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:05.488716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-87713142-f0bd-4c11-9b3e-067066a4e113 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1507 microversion: 2.1 time: 0.161843 Aug 31 00:58:05.489283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1532/3011] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:05 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:06.078504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:06.079122 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:06.085583 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:06.086752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:06.087243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:06.087916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:06.088399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:06.088794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:06.245414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:06.253367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:06.254793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:06.255968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2659768c-a9df-44ad-b351-e180d8ef92a6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.181355 Aug 31 00:58:06.256530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1480/3012] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:06 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:06.511159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-772aeb69-b00f-4d64-b3e9-5adac2e34fc1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:06.511761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-772aeb69-b00f-4d64-b3e9-5adac2e34fc1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:06.518136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-772aeb69-b00f-4d64-b3e9-5adac2e34fc1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:06.518612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-772aeb69-b00f-4d64-b3e9-5adac2e34fc1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:06.519067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-772aeb69-b00f-4d64-b3e9-5adac2e34fc1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:06.519745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-772aeb69-b00f-4d64-b3e9-5adac2e34fc1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:06.520190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-772aeb69-b00f-4d64-b3e9-5adac2e34fc1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:06.520612 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-772aeb69-b00f-4d64-b3e9-5adac2e34fc1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:06.652021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-772aeb69-b00f-4d64-b3e9-5adac2e34fc1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:06.660583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-772aeb69-b00f-4d64-b3e9-5adac2e34fc1 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1507 microversion: 2.1 time: 0.154739 Aug 31 00:58:06.661230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1533/3013] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:06 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:07.279466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:07.280963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:07.287767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:07.288460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:07.289535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:07.290338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:07.291013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:07.291703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:07.485325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-7eb1ea7b-50d3-4320-b4da-bba842932bfb req-12d2c693-cd12-436a-a676-5e96736c81ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503c21ab-7fcf-41a4-b1b6-58109d0217f3", "name": "network-vif-deleted", "tag": "43e4584a-4643-4ff9-9dac-df3280e4a165"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:07.499250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:07.500341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-7eb1ea7b-50d3-4320-b4da-bba842932bfb req-12d2c693-cd12-436a-a676-5e96736c81ed service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:07.501020 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-7eb1ea7b-50d3-4320-b4da-bba842932bfb req-12d2c693-cd12-436a-a676-5e96736c81ed service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:07.501631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-7eb1ea7b-50d3-4320-b4da-bba842932bfb req-12d2c693-cd12-436a-a676-5e96736c81ed service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:07.515232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:07.517049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:07.519338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9813ed6f-ef42-4877-a9d0-3d624410133d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.244004 Aug 31 00:58:07.520516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1481/3014] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:07 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:07.525869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-88c70f20-b438-49f5-acd1-ddde751c1bc0 req-80586a8e-ac04-4b84-9798-4977d7ef011e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9b4929-5c16-4d39-a447-5ae948ff989e", "name": "network-vif-deleted", "tag": "9363258d-4cf4-4748-ab99-6897c4cd2de3"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:07.529702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-7eb1ea7b-50d3-4320-b4da-bba842932bfb req-12d2c693-cd12-436a-a676-5e96736c81ed service nova] Creating event network-vif-deleted:43e4584a-4643-4ff9-9dac-df3280e4a165 for instance 503c21ab-7fcf-41a4-b1b6-58109d0217f3 on hv-cinder-85506 Aug 31 00:58:07.535174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-7eb1ea7b-50d3-4320-b4da-bba842932bfb req-12d2c693-cd12-436a-a676-5e96736c81ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135538 Aug 31 00:58:07.536241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1534/3015] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:58:07.541332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-88c70f20-b438-49f5-acd1-ddde751c1bc0 req-80586a8e-ac04-4b84-9798-4977d7ef011e service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:07.541815 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-88c70f20-b438-49f5-acd1-ddde751c1bc0 req-80586a8e-ac04-4b84-9798-4977d7ef011e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:07.542239 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-88c70f20-b438-49f5-acd1-ddde751c1bc0 req-80586a8e-ac04-4b84-9798-4977d7ef011e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:07.554796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-88c70f20-b438-49f5-acd1-ddde751c1bc0 req-80586a8e-ac04-4b84-9798-4977d7ef011e service nova] Creating event network-vif-deleted:9363258d-4cf4-4748-ab99-6897c4cd2de3 for instance ff9b4929-5c16-4d39-a447-5ae948ff989e on hv-cinder-85506 Aug 31 00:58:07.561578 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-88c70f20-b438-49f5-acd1-ddde751c1bc0 req-80586a8e-ac04-4b84-9798-4977d7ef011e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039553 Aug 31 00:58:07.562371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1482/3016] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:07.683148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3671109a-a44e-4a8e-8fda-9ca0b6c3e35d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:07.683797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3671109a-a44e-4a8e-8fda-9ca0b6c3e35d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:07.689957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3671109a-a44e-4a8e-8fda-9ca0b6c3e35d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:07.690437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3671109a-a44e-4a8e-8fda-9ca0b6c3e35d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:07.690865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3671109a-a44e-4a8e-8fda-9ca0b6c3e35d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:07.691579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3671109a-a44e-4a8e-8fda-9ca0b6c3e35d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:07.692027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3671109a-a44e-4a8e-8fda-9ca0b6c3e35d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:07.692441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3671109a-a44e-4a8e-8fda-9ca0b6c3e35d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:07.761843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3671109a-a44e-4a8e-8fda-9ca0b6c3e35d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:07.772573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3671109a-a44e-4a8e-8fda-9ca0b6c3e35d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1465 microversion: 2.1 time: 0.091803 Aug 31 00:58:07.786779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1535/3017] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:07 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1465 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:08.396934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-41c44167-a2d7-433b-97fd-9f366c842fcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:08.399716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-41c44167-a2d7-433b-97fd-9f366c842fcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:08.406747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41c44167-a2d7-433b-97fd-9f366c842fcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:08.407267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41c44167-a2d7-433b-97fd-9f366c842fcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:08.407703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41c44167-a2d7-433b-97fd-9f366c842fcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:08.408383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41c44167-a2d7-433b-97fd-9f366c842fcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:08.408831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41c44167-a2d7-433b-97fd-9f366c842fcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:08.409250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41c44167-a2d7-433b-97fd-9f366c842fcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:08.439029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-41c44167-a2d7-433b-97fd-9f366c842fcc tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Aug 31 00:58:08.439838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1483/3018] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:58:08 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:58:08.450203 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-54b4f67d-a0fb-4896-8845-75b83b2c5d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:08.450695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-54b4f67d-a0fb-4896-8845-75b83b2c5d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:08.456576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54b4f67d-a0fb-4896-8845-75b83b2c5d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:08.457056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54b4f67d-a0fb-4896-8845-75b83b2c5d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:08.457488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54b4f67d-a0fb-4896-8845-75b83b2c5d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:08.458165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54b4f67d-a0fb-4896-8845-75b83b2c5d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:08.458613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54b4f67d-a0fb-4896-8845-75b83b2c5d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:08.459030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54b4f67d-a0fb-4896-8845-75b83b2c5d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:08.489174 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-54b4f67d-a0fb-4896-8845-75b83b2c5d8a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments/5d7b11de-a137-4ac4-bb64-c7fc45402bf7" status: 200 len: 194 microversion: 2.1 time: 0.042794 Aug 31 00:58:08.489756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1536/3019] 10.222.0.67 () {58 vars in 1413 bytes} [Wed Aug 31 00:58:08 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments/5d7b11de-a137-4ac4-bb64-c7fc45402bf7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:08.543757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:08.544922 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:08.550903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:08.551418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:08.551844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:08.552521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:08.552990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:08.553405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:08.703714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:08.714612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:08.716238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:08.717888 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ff4129e2-0288-4fcf-939c-cefc392ec074 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.179820 Aug 31 00:58:08.737078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1484/3020] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:08 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:08.801052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:08.803355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:08.817637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:08.818139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:08.818570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:08.819291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:08.819739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:08.820929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:08.862225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:08.863449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:08.864021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:08.864492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lazy-loading 'fault' on Instance uuid ff9b4929-5c16-4d39-a447-5ae948ff989e {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:58:08.908736 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:08.917431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d44216b8-9d88-4cb6-bba2-9eceb0fa3660 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 200 len: 1312 microversion: 2.1 time: 0.126125 Aug 31 00:58:08.918027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1537/3021] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:08 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 1312 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:09.744489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:09.745124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:09.751658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:09.752143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:09.752586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:09.753265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:09.753716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:09.754596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:09.859396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d393843e-6859-4471-a3c8-15afff2392d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80db1ed4-2c0f-44a2-bec1-107dc05d3ef4"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:09.861920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d393843e-6859-4471-a3c8-15afff2392d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:09.870718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d393843e-6859-4471-a3c8-15afff2392d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:09.871406 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d393843e-6859-4471-a3c8-15afff2392d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:09.871853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d393843e-6859-4471-a3c8-15afff2392d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:09.872671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d393843e-6859-4471-a3c8-15afff2392d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:09.873271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d393843e-6859-4471-a3c8-15afff2392d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:09.873910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d393843e-6859-4471-a3c8-15afff2392d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:09.896723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:09.910492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:09.911960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:09.913231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-80921582-375b-4114-a2b3-7f7d87e557a8 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.172717 Aug 31 00:58:09.913836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1485/3022] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:09 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:09.939220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:09.939824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: ff9b4929-5c16-4d39-a447-5ae948ff989e] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:09.946968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:09.947479 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:09.947914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:09.948606 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:09.949057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:09.949481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:09.965902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Instance ff9b4929-5c16-4d39-a447-5ae948ff989e could not be found. Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e HTTP/1.1 Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:58:09.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance ff9b4929-5c16-4d39-a447-5ae948ff989e could not be found. Aug 31 00:58:09.970183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'ff9b4929-5c16-4d39-a447-5ae948ff989e'} Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9b4929-5c16-4d39-a447-5ae948ff989e could not be found. Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:58:09.971407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9b4929-5c16-4d39-a447-5ae948ff989e could not be found. Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9b4929-5c16-4d39-a447-5ae948ff989e could not be found. Aug 31 00:58:09.973053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:09.974612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 404 to user: Instance ff9b4929-5c16-4d39-a447-5ae948ff989e could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:58:09.974612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7d2d0663-bdd7-4043-bb8e-7b6b8cf1a7af tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e" status: 404 len: 111 microversion: 2.1 time: 0.034933 Aug 31 00:58:09.974612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1486/3023] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:09 2022] GET /compute/v2.1/servers/ff9b4929-5c16-4d39-a447-5ae948ff989e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:58:09.982883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-765cb694-b49a-4477-be4b-545c6f743739 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:09.983406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-765cb694-b49a-4477-be4b-545c6f743739 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:09.991765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-765cb694-b49a-4477-be4b-545c6f743739 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:09.993596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-765cb694-b49a-4477-be4b-545c6f743739 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:09.993596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-765cb694-b49a-4477-be4b-545c6f743739 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:09.994273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-765cb694-b49a-4477-be4b-545c6f743739 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:09.994726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-765cb694-b49a-4477-be4b-545c6f743739 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:09.995121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-765cb694-b49a-4477-be4b-545c6f743739 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:10.026399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-765cb694-b49a-4477-be4b-545c6f743739 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:58:10.117745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-765cb694-b49a-4477-be4b-545c6f743739 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "DELETE /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 204 len: 0 microversion: 2.1 time: 0.137691 Aug 31 00:58:10.118800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1487/3024] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:58:09 2022] DELETE /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:58:10.129230 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-85c0e6a0-bd47-4a94-b74a-9896af5ac19d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:10.130072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-85c0e6a0-bd47-4a94-b74a-9896af5ac19d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:10.137158 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85c0e6a0-bd47-4a94-b74a-9896af5ac19d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:10.137732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85c0e6a0-bd47-4a94-b74a-9896af5ac19d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:10.138262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85c0e6a0-bd47-4a94-b74a-9896af5ac19d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:10.139223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85c0e6a0-bd47-4a94-b74a-9896af5ac19d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:10.139744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85c0e6a0-bd47-4a94-b74a-9896af5ac19d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:10.140234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85c0e6a0-bd47-4a94-b74a-9896af5ac19d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:10.233716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d393843e-6859-4471-a3c8-15afff2392d4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "POST /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378448 Aug 31 00:58:10.234328 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1538/3025] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 00:58:09 2022] POST /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:58:10.286862 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-85c0e6a0-bd47-4a94-b74a-9896af5ac19d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:10.295284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-85c0e6a0-bd47-4a94-b74a-9896af5ac19d tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.170902 Aug 31 00:58:10.295835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1488/3026] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:10 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:10.936762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:10.937477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:10.944046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:10.944535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:10.944953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:10.946231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:10.946687 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:10.947131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:10.969700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:11.131594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:11.140572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:11.142034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:11.143220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a3f2c25a-0fdc-4ea3-b9ed-b380039cfde2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.210952 Aug 31 00:58:11.143776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1539/3027] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:10 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:11.318856 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4ffcf7eb-b36f-4e75-9a69-479ae1f9e054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:11.319645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4ffcf7eb-b36f-4e75-9a69-479ae1f9e054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:11.328266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ffcf7eb-b36f-4e75-9a69-479ae1f9e054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:11.329272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ffcf7eb-b36f-4e75-9a69-479ae1f9e054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:11.329805 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ffcf7eb-b36f-4e75-9a69-479ae1f9e054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:11.330601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ffcf7eb-b36f-4e75-9a69-479ae1f9e054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:11.331227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ffcf7eb-b36f-4e75-9a69-479ae1f9e054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:11.331736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4ffcf7eb-b36f-4e75-9a69-479ae1f9e054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:11.542555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4ffcf7eb-b36f-4e75-9a69-479ae1f9e054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff39cd0e766400f9d25e3ad465c4faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d75f50b854a909607941db6debb87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:11.550553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4ffcf7eb-b36f-4e75-9a69-479ae1f9e054 tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 200 len: 1521 microversion: 2.1 time: 0.235734 Aug 31 00:58:11.551133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1489/3028] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:11 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:11.652130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-e105f19c-58da-4a65-9808-ce990ad02115 req-6f3bfcf7-3d03-47f1-8677-1aca992968a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82098e98-ab74-415b-9d57-1e55a9524ce1", "name": "network-vif-deleted", "tag": "46c132f8-c4f9-45c0-83ee-0c904d4196b0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:11.662377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-e105f19c-58da-4a65-9808-ce990ad02115 req-6f3bfcf7-3d03-47f1-8677-1aca992968a1 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:11.662907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-e105f19c-58da-4a65-9808-ce990ad02115 req-6f3bfcf7-3d03-47f1-8677-1aca992968a1 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:11.663359 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-e105f19c-58da-4a65-9808-ce990ad02115 req-6f3bfcf7-3d03-47f1-8677-1aca992968a1 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:11.676155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-e105f19c-58da-4a65-9808-ce990ad02115 req-6f3bfcf7-3d03-47f1-8677-1aca992968a1 service nova] Creating event network-vif-deleted:46c132f8-c4f9-45c0-83ee-0c904d4196b0 for instance 82098e98-ab74-415b-9d57-1e55a9524ce1 on hv-cinder-85506 Aug 31 00:58:11.682077 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-e105f19c-58da-4a65-9808-ce990ad02115 req-6f3bfcf7-3d03-47f1-8677-1aca992968a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033707 Aug 31 00:58:11.682785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1540/3029] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:12.167756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:12.168351 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:12.175317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:12.175951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:12.176492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:12.177469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:12.178132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:12.178662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:12.573291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:12.573992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] [instance: 82098e98-ab74-415b-9d57-1e55a9524ce1] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:12.579724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:12.580310 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:12.580799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:12.581232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:12.581926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:12.582376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:12.582799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:12.588591 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:12.590108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:12.591389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-69900576-9e0c-4adc-9fcd-f3878520c4a9 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.427943 Aug 31 00:58:12.592024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1490/3030] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:12 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:12.597371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] HTTP exception thrown: Instance 82098e98-ab74-415b-9d57-1e55a9524ce1 could not be found. Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Request method failure captured: Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 HTTP/1.1 Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlfhTXmN345zj0cinQDu0fBujFtIKCdVxwHuVxq_tcoJj8v5LN11TB62zoqXa7ikV9la8UpX3X9HCcv6vvIXpXICzIMH5qj41nNt0MVq7hgimyfqP_4GA2KJnH11GAX_r8bMcqZOSRMsye7v48VnCXmJZHs_6PGOH9T6fY8MAv8A3M Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:58:12.599016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6a4d75f50b854a909607941db6debb87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6a4d75f50b854a909607941db6debb87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6a4d75f50b854a909607941db6debb87", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6a4d75f50b854a909607941db6debb87 Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1777046845 Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 3ff39cd0e766400f9d25e3ad465c4faf Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1777046845-project Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance 82098e98-ab74-415b-9d57-1e55a9524ce1 could not be found. Aug 31 00:58:12.600627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': '82098e98-ab74-415b-9d57-1e55a9524ce1'} Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82098e98-ab74-415b-9d57-1e55a9524ce1 could not be found. Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:58:12.602063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82098e98-ab74-415b-9d57-1e55a9524ce1 could not be found. Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82098e98-ab74-415b-9d57-1e55a9524ce1 could not be found. Aug 31 00:58:12.604958 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:12.607611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] Returning 404 to user: Instance 82098e98-ab74-415b-9d57-1e55a9524ce1 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:58:12.607611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-74ac5588-f062-4bad-af8b-e1f5753c5cbe tempest-ServerRescueNegativeTestJSON-1777046845 tempest-ServerRescueNegativeTestJSON-1777046845-project] 10.222.0.67 "GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1" status: 404 len: 111 microversion: 2.1 time: 0.032242 Aug 31 00:58:12.607611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1541/3031] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:12 2022] GET /compute/v2.1/servers/82098e98-ab74-415b-9d57-1e55a9524ce1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:58:13.621362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:13.622009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:13.629704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:13.630678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:13.631169 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:13.632077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:13.633770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:13.634215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:13.782098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:13.792002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:13.793864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:13.795360 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8fd2054c-eada-4ee5-99aa-20fc4fb38b3f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.182396 Aug 31 00:58:13.796436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1491/3032] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:13 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:14.819305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:14.819889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:14.827444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:14.828562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:14.828996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:14.829688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:14.830136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:14.830553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:15.081441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:15.098108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:15.100216 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:15.108829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e173e070-6c36-4de0-bdd0-303001c7b566 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.293376 Aug 31 00:58:15.109821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1542/3033] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:14 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:16.133449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:16.134576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:16.143356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:16.144338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:16.145030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:16.146112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:16.146787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:16.151302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:16.312668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:16.321972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:16.323547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:16.324897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ed7c1ff4-50b6-4d50-8a96-fc23b957969c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.196532 Aug 31 00:58:16.339699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1492/3034] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:16 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:17.350610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:17.352361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:17.360602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:17.361294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:17.361951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:17.362784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:17.363437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:17.363856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:17.546619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:17.558965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:17.562452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:17.564106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-34bbfac2-1fac-4520-94f9-56a30c8e175c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.220280 Aug 31 00:58:17.564624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1543/3035] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:17 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:18.589415 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:18.590267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:18.597007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:18.597771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:18.598405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:18.600146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:18.601802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:18.604908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:18.855756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:18.860673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:18.870080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:18.872939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:18.874496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2e8f63d6-0a27-4e07-8923-c49667f713f4 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.291049 Aug 31 00:58:18.876013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1493/3036] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:18 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:18.995768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-243741e1-2c1d-4349-a9b8-620964347e53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:19.000213 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-243741e1-2c1d-4349-a9b8-620964347e53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:19.007460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-243741e1-2c1d-4349-a9b8-620964347e53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:19.009478 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-243741e1-2c1d-4349-a9b8-620964347e53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:19.010109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-243741e1-2c1d-4349-a9b8-620964347e53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:19.011312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-243741e1-2c1d-4349-a9b8-620964347e53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:19.011944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-243741e1-2c1d-4349-a9b8-620964347e53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:19.012542 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-243741e1-2c1d-4349-a9b8-620964347e53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:19.055865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-243741e1-2c1d-4349-a9b8-620964347e53 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.065086 Aug 31 00:58:19.063505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1544/3037] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:58:18 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:19.205947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d84aa205-92ab-4f73-9711-1fc193d136a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:19.206825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d84aa205-92ab-4f73-9711-1fc193d136a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:19.216819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d84aa205-92ab-4f73-9711-1fc193d136a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:19.217421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d84aa205-92ab-4f73-9711-1fc193d136a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:19.217935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d84aa205-92ab-4f73-9711-1fc193d136a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:19.218707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d84aa205-92ab-4f73-9711-1fc193d136a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:19.219831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d84aa205-92ab-4f73-9711-1fc193d136a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:19.220487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d84aa205-92ab-4f73-9711-1fc193d136a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:19.256451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d84aa205-92ab-4f73-9711-1fc193d136a8 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments/5d7b11de-a137-4ac4-bb64-c7fc45402bf7" status: 200 len: 194 microversion: 2.1 time: 0.054828 Aug 31 00:58:19.257167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1494/3038] 10.222.0.67 () {58 vars in 1413 bytes} [Wed Aug 31 00:58:19 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments/5d7b11de-a137-4ac4-bb64-c7fc45402bf7 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:19.268408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c09399b8-f6e5-4625-808f-9dcdfbb1fb50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:19.268899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c09399b8-f6e5-4625-808f-9dcdfbb1fb50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:19.275838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09399b8-f6e5-4625-808f-9dcdfbb1fb50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:19.276329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09399b8-f6e5-4625-808f-9dcdfbb1fb50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:19.276763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09399b8-f6e5-4625-808f-9dcdfbb1fb50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:19.277460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09399b8-f6e5-4625-808f-9dcdfbb1fb50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:19.277910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09399b8-f6e5-4625-808f-9dcdfbb1fb50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:19.278380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c09399b8-f6e5-4625-808f-9dcdfbb1fb50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:19.378149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-c09399b8-f6e5-4625-808f-9dcdfbb1fb50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lazy-loading 'services' on Instance uuid a0b03f73-ff98-42f0-afb1-547a36f8ed55 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:58:19.468952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c09399b8-f6e5-4625-808f-9dcdfbb1fb50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments/5d7b11de-a137-4ac4-bb64-c7fc45402bf7" status: 202 len: 0 microversion: 2.1 time: 0.204356 Aug 31 00:58:19.470432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1545/3039] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:58:19 2022] DELETE /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments/5d7b11de-a137-4ac4-bb64-c7fc45402bf7 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:58:19.899021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:19.899673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:19.908799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:19.909297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:19.909733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:19.911685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:19.913368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:19.915179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:20.160499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:20.189401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:20.192514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:20.193954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d5e5f2b0-d622-4eb0-8cc9-40417a8ec510 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.299012 Aug 31 00:58:20.195715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1495/3040] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:19 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:21.218903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:21.219920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:21.233948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:21.240120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:21.240120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:21.240571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:21.242268 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:21.244402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:21.447835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:21.464643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:21.467400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:21.469173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1d5d4a25-1be2-4dfe-b8d1-c15dc72b18cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.254625 Aug 31 00:58:21.470247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1546/3041] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:21 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:21.817377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-614c512a-707e-4948-a0d3-d902562a649c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:21.818099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-614c512a-707e-4948-a0d3-d902562a649c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:21.837196 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-614c512a-707e-4948-a0d3-d902562a649c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:21.838630 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-614c512a-707e-4948-a0d3-d902562a649c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:21.840178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-614c512a-707e-4948-a0d3-d902562a649c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:21.842320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-614c512a-707e-4948-a0d3-d902562a649c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:21.844118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-614c512a-707e-4948-a0d3-d902562a649c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:21.844914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-614c512a-707e-4948-a0d3-d902562a649c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:21.896140 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-614c512a-707e-4948-a0d3-d902562a649c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments/80db1ed4-2c0f-44a2-bec1-107dc05d3ef4" status: 200 len: 194 microversion: 2.1 time: 0.091613 Aug 31 00:58:21.897472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1496/3042] 10.222.0.67 () {58 vars in 1413 bytes} [Wed Aug 31 00:58:21 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments/80db1ed4-2c0f-44a2-bec1-107dc05d3ef4 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:21.909352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-62ba5f1c-622e-4ede-a9cb-8b8f320754d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:21.909851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-62ba5f1c-622e-4ede-a9cb-8b8f320754d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:21.920859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62ba5f1c-622e-4ede-a9cb-8b8f320754d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:21.921352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62ba5f1c-622e-4ede-a9cb-8b8f320754d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:21.923829 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62ba5f1c-622e-4ede-a9cb-8b8f320754d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:21.926739 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62ba5f1c-622e-4ede-a9cb-8b8f320754d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:21.927418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62ba5f1c-622e-4ede-a9cb-8b8f320754d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:21.928095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62ba5f1c-622e-4ede-a9cb-8b8f320754d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:22.086759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-62ba5f1c-622e-4ede-a9cb-8b8f320754d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lazy-loading 'services' on Instance uuid a0b03f73-ff98-42f0-afb1-547a36f8ed55 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:58:22.236903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-62ba5f1c-622e-4ede-a9cb-8b8f320754d6 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments/80db1ed4-2c0f-44a2-bec1-107dc05d3ef4" status: 202 len: 0 microversion: 2.1 time: 0.331214 Aug 31 00:58:22.239878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1547/3043] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 00:58:21 2022] DELETE /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments/80db1ed4-2c0f-44a2-bec1-107dc05d3ef4 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:58:22.511204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:22.512057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:22.518689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:22.520629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:22.521403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:22.522072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:22.522526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:22.522981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:22.770529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:22.782005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:22.784495 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:22.786973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b5999d73-39ce-495c-b83c-5c9adfe20827 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.282692 Aug 31 00:58:22.788066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1497/3044] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:22 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:23.515633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c8ae87a8-ef2a-4bf3-8934-e17e97255527 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:23.518963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c8ae87a8-ef2a-4bf3-8934-e17e97255527 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:23.528008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8ae87a8-ef2a-4bf3-8934-e17e97255527 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:23.528872 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8ae87a8-ef2a-4bf3-8934-e17e97255527 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:23.529729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8ae87a8-ef2a-4bf3-8934-e17e97255527 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:23.530814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8ae87a8-ef2a-4bf3-8934-e17e97255527 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:23.531517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8ae87a8-ef2a-4bf3-8934-e17e97255527 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:23.532367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8ae87a8-ef2a-4bf3-8934-e17e97255527 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:23.581910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c8ae87a8-ef2a-4bf3-8934-e17e97255527 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074343 Aug 31 00:58:23.583112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1548/3045] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:58:23 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:58:23.748931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1534d686-8501-4173-b0be-0554e611e4f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:23.753268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1534d686-8501-4173-b0be-0554e611e4f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:23.766747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1534d686-8501-4173-b0be-0554e611e4f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:23.767282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1534d686-8501-4173-b0be-0554e611e4f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:23.769514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1534d686-8501-4173-b0be-0554e611e4f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:23.771526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1534d686-8501-4173-b0be-0554e611e4f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:23.774161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1534d686-8501-4173-b0be-0554e611e4f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:23.776255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1534d686-8501-4173-b0be-0554e611e4f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:23.813635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:23.814285 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:23.824485 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:23.825245 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:23.825942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:23.826820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1534d686-8501-4173-b0be-0554e611e4f4 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082350 Aug 31 00:58:23.828224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:23.830068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:23.830690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:23.836417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1498/3046] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 00:58:23 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:58:23.956596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b5c6973e-ecdd-4a96-a76b-9008118b7829 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:23.956596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b5c6973e-ecdd-4a96-a76b-9008118b7829 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:23.958592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5c6973e-ecdd-4a96-a76b-9008118b7829 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:23.959383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5c6973e-ecdd-4a96-a76b-9008118b7829 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:23.960058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5c6973e-ecdd-4a96-a76b-9008118b7829 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:23.961171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5c6973e-ecdd-4a96-a76b-9008118b7829 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:23.962148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5c6973e-ecdd-4a96-a76b-9008118b7829 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:23.963083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b5c6973e-ecdd-4a96-a76b-9008118b7829 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:24.059710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b5c6973e-ecdd-4a96-a76b-9008118b7829 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:58:24.102317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:24.113041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:24.118276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:24.122125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-21170c38-ffa8-458f-aafd-e0217909150e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.312835 Aug 31 00:58:24.124211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1549/3047] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:23 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:58:24.202766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b5c6973e-ecdd-4a96-a76b-9008118b7829 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 204 len: 0 microversion: 2.1 time: 0.256635 Aug 31 00:58:24.207669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1499/3048] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:58:23 2022] DELETE /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:58:24.212950 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cfa56e87-fdfe-47ac-b04c-1ecbb7655a18 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:24.213554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cfa56e87-fdfe-47ac-b04c-1ecbb7655a18 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:24.228704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa56e87-fdfe-47ac-b04c-1ecbb7655a18 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:24.231749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa56e87-fdfe-47ac-b04c-1ecbb7655a18 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:24.235570 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa56e87-fdfe-47ac-b04c-1ecbb7655a18 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:24.237675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa56e87-fdfe-47ac-b04c-1ecbb7655a18 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:24.238126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa56e87-fdfe-47ac-b04c-1ecbb7655a18 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:24.240931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfa56e87-fdfe-47ac-b04c-1ecbb7655a18 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:24.592599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cfa56e87-fdfe-47ac-b04c-1ecbb7655a18 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:24.604628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cfa56e87-fdfe-47ac-b04c-1ecbb7655a18 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1674 microversion: 2.1 time: 0.395608 Aug 31 00:58:24.620225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1550/3049] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:24 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1674 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:58:25.154985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:25.155718 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:25.163354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:25.165032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:25.165771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:25.166981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:25.167634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:25.168231 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:25.627081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7a55581e-488a-41d9-b94d-dae9763eda2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:25.627672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7a55581e-488a-41d9-b94d-dae9763eda2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:25.640418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7a55581e-488a-41d9-b94d-dae9763eda2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:25.640928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7a55581e-488a-41d9-b94d-dae9763eda2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:25.641367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7a55581e-488a-41d9-b94d-dae9763eda2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:25.651961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7a55581e-488a-41d9-b94d-dae9763eda2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:25.652460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7a55581e-488a-41d9-b94d-dae9763eda2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:25.652903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7a55581e-488a-41d9-b94d-dae9763eda2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:25.841355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:25.865884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:25.875984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:25.888840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dca8bfe9-6621-4153-b379-d75c03227a95 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.738633 Aug 31 00:58:25.890598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1500/3050] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:25 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:26.140009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7a55581e-488a-41d9-b94d-dae9763eda2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:26.152582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7a55581e-488a-41d9-b94d-dae9763eda2c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1674 microversion: 2.1 time: 0.529275 Aug 31 00:58:26.154576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1551/3051] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:25 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1674 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:58:26.918087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:26.918869 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:26.946989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:26.947891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:26.948551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:26.950514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:26.952885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:26.953852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:27.176817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d62ab306-1c56-4961-a8d6-48c731558b50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:27.177714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d62ab306-1c56-4961-a8d6-48c731558b50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:27.191214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d62ab306-1c56-4961-a8d6-48c731558b50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:27.192282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d62ab306-1c56-4961-a8d6-48c731558b50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:27.193097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d62ab306-1c56-4961-a8d6-48c731558b50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:27.194089 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d62ab306-1c56-4961-a8d6-48c731558b50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:27.195801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d62ab306-1c56-4961-a8d6-48c731558b50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:27.196618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d62ab306-1c56-4961-a8d6-48c731558b50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:27.358539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d62ab306-1c56-4961-a8d6-48c731558b50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:27.371208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d62ab306-1c56-4961-a8d6-48c731558b50 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1606 microversion: 2.1 time: 0.198212 Aug 31 00:58:27.372196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1552/3052] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:27 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1606 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:58:27.501717 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:27.512817 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:27.516414 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:27.522146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5dc1943d-15dd-46ee-bccd-5fdc35ac7685 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1745 microversion: 2.20 time: 0.609088 Aug 31 00:58:27.524466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1501/3053] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:26 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1745 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:27.893560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-83ac4e0b-43ca-40e9-9877-a392e89dfaa8 req-1f9fe6ee-6518-4565-8a70-2e99e3201d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b03f73-ff98-42f0-afb1-547a36f8ed55", "name": "network-vif-deleted", "tag": "024e5992-1376-4fb8-89fd-344e227c9100"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:27.904460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:27.907428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-83ac4e0b-43ca-40e9-9877-a392e89dfaa8 req-1f9fe6ee-6518-4565-8a70-2e99e3201d84 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:27.908168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-83ac4e0b-43ca-40e9-9877-a392e89dfaa8 req-1f9fe6ee-6518-4565-8a70-2e99e3201d84 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:27.908997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-83ac4e0b-43ca-40e9-9877-a392e89dfaa8 req-1f9fe6ee-6518-4565-8a70-2e99e3201d84 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:27.930705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-83ac4e0b-43ca-40e9-9877-a392e89dfaa8 req-1f9fe6ee-6518-4565-8a70-2e99e3201d84 service nova] Creating event network-vif-deleted:024e5992-1376-4fb8-89fd-344e227c9100 for instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 on hv-cinder-85506 Aug 31 00:58:27.937204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-83ac4e0b-43ca-40e9-9877-a392e89dfaa8 req-1f9fe6ee-6518-4565-8a70-2e99e3201d84 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052391 Aug 31 00:58:27.937961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1553/3054] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:28.405855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:28.407316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:28.423741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:28.424548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:28.425253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:28.426029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:28.426496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:28.427015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:28.514286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:28.514766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:28.515245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:28.515866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lazy-loading 'fault' on Instance uuid a0b03f73-ff98-42f0-afb1-547a36f8ed55 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:58:28.550891 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:28.552823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:28.572035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:28.581743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:28.583889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:28.588329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:28.593983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:28.594968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:28.608535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1a15d59d5d476ca6e0ab5176d310cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885b952a63b34e1ba97215831cffc58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:28.619999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b88c9b1b-2a77-4495-b4a7-fc54c01b76cf tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 200 len: 1326 microversion: 2.1 time: 0.218402 Aug 31 00:58:28.621104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1502/3055] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:28 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 1326 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:28.853948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:28.872684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:28.874238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:28.875500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9c8f367e-b839-48f1-8fc0-9fc921f9f330 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1745 microversion: 2.20 time: 0.330712 Aug 31 00:58:28.878319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1554/3056] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:28 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1745 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:29.112496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7313c22e-e873-4ae4-8129-a27f6f5f3e74 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Action: 'create', calling method: .version_select at 0x7fa7f7543a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1983975222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHhlLpWfy4IMt0YkoDD0WvVjELbxHICes73u++2laVMeVIzyr+sdoxWtqILiTdKqfqCFh1NZ4q/rbV8bJ9SZmAc+QRyG98uJN5rx9k2F0bXCUapNojyU0cFwipA4nOyog=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:29.132794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-7313c22e-e873-4ae4-8129-a27f6f5f3e74 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Getting quotas for project e5fdc920045d4fabac1e51adb944ff3f. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:58:29.138382 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-7313c22e-e873-4ae4-8129-a27f6f5f3e74 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Getting quotas for user d69d5ca56a8e43ca9d91920684f2dac8 and project e5fdc920045d4fabac1e51adb944ff3f. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:58:29.184508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7313c22e-e873-4ae4-8129-a27f6f5f3e74 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.365613 Aug 31 00:58:29.185612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1503/3057] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 31 00:58:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:29.654354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:29.655863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:29.678774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:29.680005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:29.680474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:29.681217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:29.681644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:29.682055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:29.728931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] HTTP exception thrown: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Request method failure captured: Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 HTTP/1.1 Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqla1823IsHqblpILgjWre92kyOiDOyRf31-PkmKjck0ZUSBHguOSTip752czBTm5TzgY6FbNh2-awxFZL81JDx09BWuNVtnmSeXEbHALtQezEIvBWebOYmQJkBJimVWXTeZcjog2PnoEgqQUntmulnBMEK61Hc8khpJ-hanLP8CeQk Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 885b952a63b34e1ba97215831cffc58e Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:58:29.732215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_885b952a63b34e1ba97215831cffc58e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 885b952a63b34e1ba97215831cffc58e Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeTestJSON-1646910086-project Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 6d1a15d59d5d476ca6e0ab5176d310cd Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeTestJSON-1646910086-project Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:29.733924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': 'a0b03f73-ff98-42f0-afb1-547a36f8ed55'} Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:58:29.735161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:29.737227 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:29.739191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Returning 404 to user: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:58:29.739191 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-56eacad5-7477-4598-92a5-5eea9b2ba09a tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 404 len: 111 microversion: 2.1 time: 0.095417 Aug 31 00:58:29.742966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1555/3058] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:29 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:58:29.747833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c7d5a979-dddc-489d-801d-7a7c6af9f898 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '.version_select at 0x7fa7f74c8670>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:29.811204 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c7d5a979-dddc-489d-801d-7a7c6af9f898 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-945975288" status: 202 len: 0 microversion: 2.1 time: 0.067082 Aug 31 00:58:29.811917 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1504/3059] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 31 00:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-945975288 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:58:29.900959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:29.901578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:29.916729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:29.917236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:29.921142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:29.921955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:29.922749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:29.923251 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:30.215619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:30.228474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:30.232212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:30.233436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fa708006-a3be-4cdf-a5e9-49d6bce11b74 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1745 microversion: 2.20 time: 0.338407 Aug 31 00:58:30.234321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1556/3060] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:29 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1745 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:30.955808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-7b4318ae-5996-4118-92ef-5216b035372a req-e6a5dce6-1294-4a67-969c-62ce01c4f619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84565566-bd8b-456c-8e83-ffcf92c75eb6", "name": "network-vif-plugged", "status": "completed", "tag": "58c975ff-15b0-4244-9b51-c1f72d71088c"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:30.969799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7b4318ae-5996-4118-92ef-5216b035372a req-e6a5dce6-1294-4a67-969c-62ce01c4f619 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:30.970556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7b4318ae-5996-4118-92ef-5216b035372a req-e6a5dce6-1294-4a67-969c-62ce01c4f619 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:30.971263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7b4318ae-5996-4118-92ef-5216b035372a req-e6a5dce6-1294-4a67-969c-62ce01c4f619 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:30.989065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-7b4318ae-5996-4118-92ef-5216b035372a req-e6a5dce6-1294-4a67-969c-62ce01c4f619 service nova] Creating event network-vif-plugged:58c975ff-15b0-4244-9b51-c1f72d71088c for instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 on hv-cinder-85506 Aug 31 00:58:30.996637 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-7b4318ae-5996-4118-92ef-5216b035372a req-e6a5dce6-1294-4a67-969c-62ce01c4f619 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.469728 Aug 31 00:58:31.002323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1505/3061] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:31.258164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:31.259745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:31.268498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:31.268987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:31.269627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:31.270363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:31.270871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:31.271460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:31.292562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:31.438098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:31.448302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:31.450288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:31.451813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0b1fda70-0ca4-47f0-88be-0645838e9bca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1745 microversion: 2.20 time: 0.198490 Aug 31 00:58:31.452427 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1557/3062] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:31 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1745 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:32.481217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:32.482510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:32.496088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:32.496887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:32.497476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:32.498597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:32.499842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:32.500504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:32.728944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:32.740505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:32.742822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:32.744475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1c824508-d51f-4db8-95f2-4b7192357110 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.269623 Aug 31 00:58:32.763354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1506/3063] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:32 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:33.456809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:33.457695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:33.466843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:33.468459 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:33.469097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:33.470563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:33.471378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:33.472087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:33.514547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] HTTP exception thrown: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Request method failure captured: Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 HTTP/1.1 Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqla1823IsHqblpILgjWre92kyOiDOyRf31-PkmKjck0ZUSBHguOSTip752czBTm5TzgY6FbNh2-awxFZL81JDx09BWuNVtnmSeXEbHALtQezEIvBWebOYmQJkBJimVWXTeZcjog2PnoEgqQUntmulnBMEK61Hc8khpJ-hanLP8CeQk Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 885b952a63b34e1ba97215831cffc58e Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:58:33.517469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_885b952a63b34e1ba97215831cffc58e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 885b952a63b34e1ba97215831cffc58e Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeTestJSON-1646910086-project Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 6d1a15d59d5d476ca6e0ab5176d310cd Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeTestJSON-1646910086-project Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:33.518982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': 'a0b03f73-ff98-42f0-afb1-547a36f8ed55'} Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:58:33.519905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:33.521563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:33.528330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Returning 404 to user: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:58:33.536274 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f66d664a-9d8f-457d-a77f-4ada6fa7723c tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 404 len: 111 microversion: 2.1 time: 0.084342 Aug 31 00:58:33.539639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1558/3064] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:58:33 2022] DELETE /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:58:33.552681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:33.553298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: a0b03f73-ff98-42f0-afb1-547a36f8ed55] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:33.573901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:33.574404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:33.574848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:33.575594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:33.581328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:33.581774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:33.626695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] HTTP exception thrown: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Request method failure captured: Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 HTTP/1.1 Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqla1823IsHqblpILgjWre92kyOiDOyRf31-PkmKjck0ZUSBHguOSTip752czBTm5TzgY6FbNh2-awxFZL81JDx09BWuNVtnmSeXEbHALtQezEIvBWebOYmQJkBJimVWXTeZcjog2PnoEgqQUntmulnBMEK61Hc8khpJ-hanLP8CeQk Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 885b952a63b34e1ba97215831cffc58e Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:58:33.637266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_885b952a63b34e1ba97215831cffc58e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 885b952a63b34e1ba97215831cffc58e Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeTestJSON-1646910086-project Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 6d1a15d59d5d476ca6e0ab5176d310cd Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeTestJSON-1646910086-project Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:33.638926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'a0b03f73-ff98-42f0-afb1-547a36f8ed55'} Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:58:33.639843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. Aug 31 00:58:33.641331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:33.642646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Returning 404 to user: Instance a0b03f73-ff98-42f0-afb1-547a36f8ed55 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:58:33.642646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-19f84481-713a-4586-abc9-9884de7131f7 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55" status: 404 len: 111 microversion: 2.1 time: 0.096956 Aug 31 00:58:33.642646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1507/3065] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:33 2022] GET /compute/v2.1/servers/a0b03f73-ff98-42f0-afb1-547a36f8ed55 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:58:33.771640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:33.772431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:33.791865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:33.792426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:33.792863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:33.796430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:33.796920 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:33.801207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:34.088443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:34.098223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:34.099706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:34.101435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-849be666-3008-4dd7-b385-95a48e5bd32e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.335067 Aug 31 00:58:34.102176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1559/3066] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:33 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:34.864389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:34.865087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:34.871132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:34.902028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:34.902824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:34.903475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:34.904434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:34.905545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:34.907538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:34.946009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] HTTP exception thrown: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Request method failure captured: Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 HTTP/1.1 Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqla1823IsHqblpILgjWre92kyOiDOyRf31-PkmKjck0ZUSBHguOSTip752czBTm5TzgY6FbNh2-awxFZL81JDx09BWuNVtnmSeXEbHALtQezEIvBWebOYmQJkBJimVWXTeZcjog2PnoEgqQUntmulnBMEK61Hc8khpJ-hanLP8CeQk Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 885b952a63b34e1ba97215831cffc58e Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 00:58:34.957879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_885b952a63b34e1ba97215831cffc58e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 885b952a63b34e1ba97215831cffc58e Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeTestJSON-1646910086-project Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 6d1a15d59d5d476ca6e0ab5176d310cd Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeTestJSON-1646910086-project Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. Aug 31 00:58:34.959741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'e7854a5f-0fae-40f3-a7d2-a2bdb829e851'} Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:58:34.960791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. Aug 31 00:58:34.962465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 00:58:34.964563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Returning 404 to user: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:58:34.964563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8f722fb1-0885-47c7-9197-cf3083204ed0 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 404 len: 111 microversion: 2.1 time: 0.098967 Aug 31 00:58:34.968948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:34.969821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] [instance: e7854a5f-0fae-40f3-a7d2-a2bdb829e851] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:34.978497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:34.978983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:34.979877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1508/3067] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 00:58:34 2022] DELETE /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:58:34.980014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:34.980640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:34.981099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:34.981523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:35.000668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] HTTP exception thrown: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Request method failure captured: Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 HTTP/1.1 Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqla1823IsHqblpILgjWre92kyOiDOyRf31-PkmKjck0ZUSBHguOSTip752czBTm5TzgY6FbNh2-awxFZL81JDx09BWuNVtnmSeXEbHALtQezEIvBWebOYmQJkBJimVWXTeZcjog2PnoEgqQUntmulnBMEK61Hc8khpJ-hanLP8CeQk Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 885b952a63b34e1ba97215831cffc58e Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 00:58:35.002758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/885b952a63b34e1ba97215831cffc58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_885b952a63b34e1ba97215831cffc58e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 885b952a63b34e1ba97215831cffc58e Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1646910086 Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeTestJSON-1646910086-project Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 6d1a15d59d5d476ca6e0ab5176d310cd Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeTestJSON-1646910086-project Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. Aug 31 00:58:35.004835 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': 'e7854a5f-0fae-40f3-a7d2-a2bdb829e851'} Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:58:35.006028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. Aug 31 00:58:35.008266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 00:58:35.010050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] Returning 404 to user: Instance e7854a5f-0fae-40f3-a7d2-a2bdb829e851 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:58:35.010050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b3f2cc4d-bdcc-468c-a117-a5616fadd6c1 tempest-AttachVolumeTestJSON-1646910086 tempest-AttachVolumeTestJSON-1646910086-project] 10.222.0.67 "GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851" status: 404 len: 111 microversion: 2.1 time: 0.039066 Aug 31 00:58:35.022295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1560/3068] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:34 2022] GET /compute/v2.1/servers/e7854a5f-0fae-40f3-a7d2-a2bdb829e851 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:58:35.140604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:35.141217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:35.151083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:35.151570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:35.152256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:35.153092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:35.153544 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:35.153962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:35.362795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:35.381288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:35.383920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:35.386138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e506ad78-c130-4d24-830c-77ee108185cb tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.249833 Aug 31 00:58:35.387962 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1509/3069] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:35 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:36.418878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:36.419529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:36.434938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:36.435465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:36.440857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:36.441611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:36.451808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:36.452568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:36.781712 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:36.807619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:36.818994 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:36.820969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-96506637-2eb4-46ff-9e13-676dcf758e13 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.407365 Aug 31 00:58:36.821677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1561/3070] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:36 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:37.846090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:37.846677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:37.862553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:37.863849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:37.864589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:37.865477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:37.866145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:37.867575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:38.172074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:38.189346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:38.191324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:38.192848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7256dd09-306b-41ab-ac80-24df993b7730 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.351539 Aug 31 00:58:38.204058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1510/3071] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:37 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:39.220883 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:39.221470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:39.228981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:39.229469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:39.229900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:39.230629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:39.231608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:39.232379 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:39.615209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:39.625900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:39.629654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:39.631954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-50d22057-f7dc-4c34-8e53-8e55d73f1f4e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.415225 Aug 31 00:58:39.633074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1562/3072] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:39 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:40.662299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:40.664015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:40.666622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:40.677132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:40.679773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:40.682131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:40.684161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:40.685881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:40.686553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:41.135446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:41.154189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:41.156595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:41.158200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3cecb4e-b9ce-40e0-bc46-06ce61dfab17 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.501329 Aug 31 00:58:41.176685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1511/3073] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:40 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:42.185052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:42.187160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:42.197086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:42.198169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:42.199006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:42.200238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:42.201050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:42.201753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:42.378538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:42.388429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:42.390289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:42.391728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ea8010ed-f9fe-4017-88bc-6c2e1878493f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.213060 Aug 31 00:58:42.392487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1563/3074] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:42 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:43.425745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:43.427168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:43.435442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:43.436178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:43.437443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:43.438342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:43.438964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:43.439585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:43.464003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:43.613632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:43.627592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:43.629628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:43.630936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-37cde739-21e7-4e51-8414-d4b646f40e79 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.218430 Aug 31 00:58:43.631595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1512/3075] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:43 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:44.660881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:44.661600 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:44.672032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:44.672987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:44.673607 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:44.674320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:44.674778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:44.675228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:44.970103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:44.982540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:44.985989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:44.987841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-98bac0fc-0ad1-4185-8d9d-9998a1ded0be tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.331093 Aug 31 00:58:45.005143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1564/3076] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:44 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:46.017079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:46.017865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:46.028185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:46.031190 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:46.031793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:46.032611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:46.034569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:46.035143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:46.293442 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:46.309703 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:46.311592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:46.313357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2df0cc45-c640-489d-a9d2-8e4df9c7d816 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.300460 Aug 31 00:58:46.314114 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1513/3077] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:46 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:47.343211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:47.344830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:47.365980 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:47.367080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:47.374786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:47.375565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:47.376219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:47.376655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:47.608231 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:47.621026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:47.624497 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:47.630313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5f139090-e0e3-41e5-adc0-ddd4b59e91d5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1740 microversion: 2.20 time: 0.290696 Aug 31 00:58:47.631965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1565/3078] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:47 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:48.658342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:48.659490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:48.671738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:48.672255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:48.672690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:48.673461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:48.675766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:48.676187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:48.847396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:48.857298 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:48.859467 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:48.863029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8b1f8ebd-1a1a-42f0-b583-2bd8c1147955 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1722 microversion: 2.20 time: 0.210464 Aug 31 00:58:48.877026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1514/3079] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:48 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:49.074756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f7bd289e-a4cb-49e9-b760-be7ef9b0f931 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: .version_select at 0x7fa7f40965e0>, body: {"keypair": {"name": "tempest-keypair-516519146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVj2wufGBGnMr67Ic43y7H3IrJpBdYgh61Txd0bhwI7LqmbRTP65q6MuQBy0oJbi+GFXpcJpgPAVSxvOz2BfMSwOV2E5l7BuOqbE6Mf0j048+4G/TzDOv4Ostty8Jtl/w=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:49.091611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-f7bd289e-a4cb-49e9-b760-be7ef9b0f931 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for project 6b67e536fd414591b859c1a89808e1a6. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:58:49.096886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-f7bd289e-a4cb-49e9-b760-be7ef9b0f931 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for user 26826ddf92124c95835a5356e13040bf and project 6b67e536fd414591b859c1a89808e1a6. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:58:49.119960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f7bd289e-a4cb-49e9-b760-be7ef9b0f931 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.175892 Aug 31 00:58:49.120775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1566/3080] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 31 00:58:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:49.889998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:49.891401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:49.898598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:49.899464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:49.900118 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:49.901253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:49.901898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:49.902585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:50.191129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:50.201727 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:50.203842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:50.205041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-85457820-2e8d-4dcb-b35d-cedd2cde1432 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1722 microversion: 2.20 time: 0.319906 Aug 31 00:58:50.205596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1515/3081] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:49 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:50.600122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-fa6ea136-c2e9-4ef9-9b6a-d91382a444b0 req-c2d9d0b7-afb0-49c2-95e6-4618fe5cd619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84565566-bd8b-456c-8e83-ffcf92c75eb6", "name": "network-vif-unplugged", "status": "completed", "tag": "58c975ff-15b0-4244-9b51-c1f72d71088c"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:50.612474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fa6ea136-c2e9-4ef9-9b6a-d91382a444b0 req-c2d9d0b7-afb0-49c2-95e6-4618fe5cd619 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:50.613280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fa6ea136-c2e9-4ef9-9b6a-d91382a444b0 req-c2d9d0b7-afb0-49c2-95e6-4618fe5cd619 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:50.613925 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fa6ea136-c2e9-4ef9-9b6a-d91382a444b0 req-c2d9d0b7-afb0-49c2-95e6-4618fe5cd619 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:50.637864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-fa6ea136-c2e9-4ef9-9b6a-d91382a444b0 req-c2d9d0b7-afb0-49c2-95e6-4618fe5cd619 service nova] Creating event network-vif-unplugged:58c975ff-15b0-4244-9b51-c1f72d71088c for instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 on hv-cinder-85506 Aug 31 00:58:50.646545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-fa6ea136-c2e9-4ef9-9b6a-d91382a444b0 req-c2d9d0b7-afb0-49c2-95e6-4618fe5cd619 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049288 Aug 31 00:58:50.648144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1567/3082] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:50.818136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1909342381", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84755e79-134e-460d-be79-1943a8a099f4"}], "security_groups": [{"name": "tempest-securitygroup--773238889"}], "key_name": "tempest-keypair-516519146", "user_data": "}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:50.961604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] validate_networks() for [('84755e79-134e-460d-be79-1943a8a099f4', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:58:51.229641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:51.230761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:51.239564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:51.240849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:51.242664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:51.243650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:51.244295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:51.244886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:51.481648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:51.493028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:51.494766 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:51.496433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-42a8e144-9f59-4fc1-8c79-9086c04f0753 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1725 microversion: 2.20 time: 0.271768 Aug 31 00:58:51.498270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1568/3083] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:51 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:51.521353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c7ca35ed-27b2-4c5a-ab13-6ca0a4494786 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddf4d968-89e4-4afa-a2fd-c05f5cb9b575"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:51.524098 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c7ca35ed-27b2-4c5a-ab13-6ca0a4494786 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:51.550175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ca35ed-27b2-4c5a-ab13-6ca0a4494786 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:51.552820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ca35ed-27b2-4c5a-ab13-6ca0a4494786 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:51.553272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ca35ed-27b2-4c5a-ab13-6ca0a4494786 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:51.556028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ca35ed-27b2-4c5a-ab13-6ca0a4494786 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:51.556499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ca35ed-27b2-4c5a-ab13-6ca0a4494786 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:51.556924 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c7ca35ed-27b2-4c5a-ab13-6ca0a4494786 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:51.760238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:58:51.760666 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:58:51.761134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:58:51.761538 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:58:51.762023 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:58:51.797218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:51.797378 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:51.797989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:51.798851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:51.799765 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:51.800192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:51.836021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for project 6b67e536fd414591b859c1a89808e1a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:58:51.845110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for user 26826ddf92124c95835a5356e13040bf and project 6b67e536fd414591b859c1a89808e1a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:58:51.876872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:58:51.879511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:58:51.972687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5c342178-6954-4799-a0aa-e7e46d08ed09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.157524 Aug 31 00:58:51.980225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1516/3084] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:58:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:58:52.000468 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-23bf4f1d-8ce6-42e3-b8c0-40a768985476 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:52.001519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-23bf4f1d-8ce6-42e3-b8c0-40a768985476 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:52.152691 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c7ca35ed-27b2-4c5a-ab13-6ca0a4494786 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.635277 Aug 31 00:58:52.153887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1569/3085] 10.222.0.67 () {62 vars in 1364 bytes} [Wed Aug 31 00:58:51 2022] POST /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/os-volume_attachments => generated 188 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:58:52.416655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-07d23cc5-dcbe-4cf7-ac48-5fb03d16d78f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:52.417155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-07d23cc5-dcbe-4cf7-ac48-5fb03d16d78f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:52.425846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07d23cc5-dcbe-4cf7-ac48-5fb03d16d78f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:52.426345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07d23cc5-dcbe-4cf7-ac48-5fb03d16d78f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:52.426791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07d23cc5-dcbe-4cf7-ac48-5fb03d16d78f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:52.433050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07d23cc5-dcbe-4cf7-ac48-5fb03d16d78f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:52.433917 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07d23cc5-dcbe-4cf7-ac48-5fb03d16d78f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:52.436119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07d23cc5-dcbe-4cf7-ac48-5fb03d16d78f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:52.500219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-23bf4f1d-8ce6-42e3-b8c0-40a768985476 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:52.511221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-23bf4f1d-8ce6-42e3-b8c0-40a768985476 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1241 microversion: 2.1 time: 0.528674 Aug 31 00:58:52.511802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1517/3086] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:51 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1241 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:52.798711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-07d23cc5-dcbe-4cf7-ac48-5fb03d16d78f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/os-volume_attachments/ddf4d968-89e4-4afa-a2fd-c05f5cb9b575" status: 202 len: 0 microversion: 2.20 time: 0.386274 Aug 31 00:58:52.799807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1570/3087] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 31 00:58:52 2022] DELETE /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/os-volume_attachments/ddf4d968-89e4-4afa-a2fd-c05f5cb9b575 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:58:52.867496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-74f1d021-bbe6-4ee1-9c51-3dc5f057c32f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:52.868425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-74f1d021-bbe6-4ee1-9c51-3dc5f057c32f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:52.877907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74f1d021-bbe6-4ee1-9c51-3dc5f057c32f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:52.878755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74f1d021-bbe6-4ee1-9c51-3dc5f057c32f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:52.880937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74f1d021-bbe6-4ee1-9c51-3dc5f057c32f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:52.881656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74f1d021-bbe6-4ee1-9c51-3dc5f057c32f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:52.884177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74f1d021-bbe6-4ee1-9c51-3dc5f057c32f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:52.884177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74f1d021-bbe6-4ee1-9c51-3dc5f057c32f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:52.939978 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-74f1d021-bbe6-4ee1-9c51-3dc5f057c32f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126976) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:58:53.047934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-74f1d021-bbe6-4ee1-9c51-3dc5f057c32f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "POST /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/action" status: 202 len: 0 microversion: 2.20 time: 0.184263 Aug 31 00:58:53.053024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1518/3088] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 31 00:58:52 2022] POST /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:58:53.062078 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:53.062940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:53.083802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:53.084556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:53.085738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:53.095350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:53.095831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:53.096543 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:53.256063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:53.268915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:53.270716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:53.273060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-74896d39-93bf-4c19-8d1f-0f2b45775c0a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1673 microversion: 2.20 time: 0.217354 Aug 31 00:58:53.283760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1571/3089] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:53 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1673 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:53.543166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cb675547-ec15-4706-b53f-6e2fd6d7e78b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:53.544241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cb675547-ec15-4706-b53f-6e2fd6d7e78b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:53.550462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb675547-ec15-4706-b53f-6e2fd6d7e78b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:53.551245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb675547-ec15-4706-b53f-6e2fd6d7e78b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:53.552245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb675547-ec15-4706-b53f-6e2fd6d7e78b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:53.552944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb675547-ec15-4706-b53f-6e2fd6d7e78b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:53.554160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb675547-ec15-4706-b53f-6e2fd6d7e78b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:53.554696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cb675547-ec15-4706-b53f-6e2fd6d7e78b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:53.637773 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cb675547-ec15-4706-b53f-6e2fd6d7e78b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:53.648253 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cb675547-ec15-4706-b53f-6e2fd6d7e78b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1293 microversion: 2.1 time: 0.115250 Aug 31 00:58:53.659241 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1519/3090] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:53 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:54.297551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:54.298156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:54.305201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:54.305690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:54.306124 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:54.306815 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:54.307296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:54.307720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:54.310434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:54.515595 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:54.526569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:54.528778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:54.530316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c1b4c0be-b866-4ded-bc78-ee8f2f966948 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1673 microversion: 2.20 time: 0.236649 Aug 31 00:58:54.531652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1572/3091] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:54 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:54.674304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e0bc7bba-3ab2-42e8-917e-fe126b2c1480 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:54.674902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e0bc7bba-3ab2-42e8-917e-fe126b2c1480 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:54.682383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0bc7bba-3ab2-42e8-917e-fe126b2c1480 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:54.682863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0bc7bba-3ab2-42e8-917e-fe126b2c1480 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:54.683324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0bc7bba-3ab2-42e8-917e-fe126b2c1480 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:54.684010 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0bc7bba-3ab2-42e8-917e-fe126b2c1480 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:54.684457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0bc7bba-3ab2-42e8-917e-fe126b2c1480 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:54.684884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0bc7bba-3ab2-42e8-917e-fe126b2c1480 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:54.904839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e0bc7bba-3ab2-42e8-917e-fe126b2c1480 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:54.915983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e0bc7bba-3ab2-42e8-917e-fe126b2c1480 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.245435 Aug 31 00:58:54.920406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1520/3092] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:54 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:55.443911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-86671015-369a-43f2-b2c0-a53db19372d7 req-0e2c98b3-e690-4de2-85bc-ca928cacbe4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b121863b-98ef-451b-be2a-2f3f615e4456", "tag": "fc9e7855-130f-49c9-944c-e779446adb05"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:55.457410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-86671015-369a-43f2-b2c0-a53db19372d7 req-0e2c98b3-e690-4de2-85bc-ca928cacbe4b service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:55.457967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-86671015-369a-43f2-b2c0-a53db19372d7 req-0e2c98b3-e690-4de2-85bc-ca928cacbe4b service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:55.459308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-86671015-369a-43f2-b2c0-a53db19372d7 req-0e2c98b3-e690-4de2-85bc-ca928cacbe4b service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:55.486031 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-86671015-369a-43f2-b2c0-a53db19372d7 req-0e2c98b3-e690-4de2-85bc-ca928cacbe4b service nova] Creating event network-changed:fc9e7855-130f-49c9-944c-e779446adb05 for instance b121863b-98ef-451b-be2a-2f3f615e4456 on hv-cinder-85506 Aug 31 00:58:55.495741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-86671015-369a-43f2-b2c0-a53db19372d7 req-0e2c98b3-e690-4de2-85bc-ca928cacbe4b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052001 Aug 31 00:58:55.496375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1573/3093] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:58:55.555903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:55.556536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:55.562751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:55.563189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:55.563615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:55.564294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:55.564741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:55.565155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:55.800423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:55.809760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:55.811511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:55.812742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-499fe152-1fbd-484a-add1-94793a1a5a32 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1673 microversion: 2.20 time: 0.261622 Aug 31 00:58:55.813838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1521/3094] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:55 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1673 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:55.943105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf6349e0-7b5e-4b6a-9e14-a20d5a1e233f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:55.943789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf6349e0-7b5e-4b6a-9e14-a20d5a1e233f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:55.950792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6349e0-7b5e-4b6a-9e14-a20d5a1e233f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:55.951389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6349e0-7b5e-4b6a-9e14-a20d5a1e233f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:55.951826 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6349e0-7b5e-4b6a-9e14-a20d5a1e233f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:55.952515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6349e0-7b5e-4b6a-9e14-a20d5a1e233f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:55.952965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6349e0-7b5e-4b6a-9e14-a20d5a1e233f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:55.953385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf6349e0-7b5e-4b6a-9e14-a20d5a1e233f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:56.110804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bf6349e0-7b5e-4b6a-9e14-a20d5a1e233f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:56.120001 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf6349e0-7b5e-4b6a-9e14-a20d5a1e233f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.181079 Aug 31 00:58:56.120719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1574/3095] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:55 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:56.836602 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:56.837227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:56.843756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:56.844504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:56.844934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:56.845619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:56.846067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:56.846488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:56.985594 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:56.997011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:56.998411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:56.999600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b9d82534-dff2-4893-a281-4da011dc9bba tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1673 microversion: 2.20 time: 0.167176 Aug 31 00:58:57.000187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1522/3096] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:56 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:57.143180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9b3436af-79df-44e9-8db5-d09e29c0ef2c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:57.143821 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9b3436af-79df-44e9-8db5-d09e29c0ef2c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:57.160909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3436af-79df-44e9-8db5-d09e29c0ef2c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:57.161401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3436af-79df-44e9-8db5-d09e29c0ef2c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:57.161832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3436af-79df-44e9-8db5-d09e29c0ef2c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:57.162584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3436af-79df-44e9-8db5-d09e29c0ef2c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:57.162990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3436af-79df-44e9-8db5-d09e29c0ef2c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:57.164236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b3436af-79df-44e9-8db5-d09e29c0ef2c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:57.355960 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9b3436af-79df-44e9-8db5-d09e29c0ef2c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:57.364199 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9b3436af-79df-44e9-8db5-d09e29c0ef2c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.225488 Aug 31 00:58:57.364859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1575/3097] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:57 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:58.026729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:58.028500 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:58.036511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:58.037067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:58.037572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:58.038927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:58.039412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:58.040195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:58.215616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:58.226056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:58.227584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:58.228811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4fcfa296-2a11-4cc2-b8fb-3b668eebb8e2 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1673 microversion: 2.20 time: 0.207613 Aug 31 00:58:58.229373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1523/3098] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:58 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:58:58.386884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-86553548-2f6f-4ddf-94b4-e6a9164638ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:58.388090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-86553548-2f6f-4ddf-94b4-e6a9164638ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:58.390291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:58.396318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86553548-2f6f-4ddf-94b4-e6a9164638ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:58.396851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86553548-2f6f-4ddf-94b4-e6a9164638ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:58.397316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86553548-2f6f-4ddf-94b4-e6a9164638ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:58.398425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86553548-2f6f-4ddf-94b4-e6a9164638ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:58.398901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86553548-2f6f-4ddf-94b4-e6a9164638ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:58.399364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86553548-2f6f-4ddf-94b4-e6a9164638ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:58.531681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-86553548-2f6f-4ddf-94b4-e6a9164638ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:58.540355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-86553548-2f6f-4ddf-94b4-e6a9164638ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.158837 Aug 31 00:58:58.541416 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1576/3099] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:58 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:58:58.817826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-638617286", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1983975222", "security_groups": [{"name": "tempest-secgroup-smoke-513902528"}], "networks": [{"uuid": "1444cd28-ba72-4ce0-a02f-d166ce40b4da"}], "block_device_mapping_v2": [{"uuid": "08863dd0-5f8e-4930-90ae-3c4824030045", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:58:58.940968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] validate_networks() for [('1444cd28-ba72-4ce0-a02f-d166ce40b4da', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:58:59.252644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:59.253258 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:59.255302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=4 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:58:59.270885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:59.271418 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:59.271939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:59.273475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:59.274357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:59.274975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:59.585694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:58:59.586612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:58:59.587648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:58:59.588200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:58:59.588747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:58:59.602343 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:59.604387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:59.604968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:59.606175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:59.607224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:59.608219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:59.626398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Getting quotas for project e5fdc920045d4fabac1e51adb944ff3f. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:58:59.630530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Getting quotas for user d69d5ca56a8e43ca9d91920684f2dac8 and project e5fdc920045d4fabac1e51adb944ff3f. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:58:59.633373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:59.642788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:59.644800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:58:59.646102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-70b4bd64-6b20-4edd-ab14-86600c8f645a tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1675 microversion: 2.20 time: 0.397374 Aug 31 00:58:59.646757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1577/3100] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:58:59 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1675 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:58:59.652388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-12f838dd-a62c-4dd8-9bed-5bf39b1917a0 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:59.653094 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-12f838dd-a62c-4dd8-9bed-5bf39b1917a0 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:59.668323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12f838dd-a62c-4dd8-9bed-5bf39b1917a0 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:59.669126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12f838dd-a62c-4dd8-9bed-5bf39b1917a0 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:59.669851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12f838dd-a62c-4dd8-9bed-5bf39b1917a0 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:59.670810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12f838dd-a62c-4dd8-9bed-5bf39b1917a0 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:58:59.671515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12f838dd-a62c-4dd8-9bed-5bf39b1917a0 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:58:59.672257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-12f838dd-a62c-4dd8-9bed-5bf39b1917a0 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:58:59.697876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:58:59.699948 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08863dd0-5f8e-4930-90ae-3c4824030045',volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:58:59.871296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c74f7eda-3560-428e-bcbf-b8374f86577b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.057150 Aug 31 00:58:59.872123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1524/3101] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 00:58:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:58:59.888783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d4e6f6c4-d477-4ec4-90f3-6198a1afa599 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:58:59.889734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d4e6f6c4-d477-4ec4-90f3-6198a1afa599 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:58:59.998850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-12f838dd-a62c-4dd8-9bed-5bf39b1917a0 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:00.012704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-12f838dd-a62c-4dd8-9bed-5bf39b1917a0 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.363728 Aug 31 00:59:00.013812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1578/3102] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:59 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:00.034049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d4e6f6c4-d477-4ec4-90f3-6198a1afa599 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:00.043296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d4e6f6c4-d477-4ec4-90f3-6198a1afa599 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1088 microversion: 2.1 time: 0.162463 Aug 31 00:59:00.043803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1525/3103] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:58:59 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1088 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:00.670728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:00.671400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:00.689084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:00.689588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:00.690113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:00.690836 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:00.691391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:00.691890 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:00.916092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:00.926806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:00.929055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:00.930733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-44e3e23c-ff77-4c39-8755-3b0206950168 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.264046 Aug 31 00:59:00.935192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1579/3104] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:00 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:01.036167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c60d81e5-2e42-4394-98a0-7a369b85c1e7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:01.036777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c60d81e5-2e42-4394-98a0-7a369b85c1e7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:01.046696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c60d81e5-2e42-4394-98a0-7a369b85c1e7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:01.047212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c60d81e5-2e42-4394-98a0-7a369b85c1e7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:01.047644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c60d81e5-2e42-4394-98a0-7a369b85c1e7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:01.048344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c60d81e5-2e42-4394-98a0-7a369b85c1e7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:01.048832 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c60d81e5-2e42-4394-98a0-7a369b85c1e7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:01.049256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c60d81e5-2e42-4394-98a0-7a369b85c1e7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:01.065431 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-feb87822-f553-4dd2-a920-1c83dbd03e06 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:01.065981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-feb87822-f553-4dd2-a920-1c83dbd03e06 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:01.073279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb87822-f553-4dd2-a920-1c83dbd03e06 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:01.073759 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb87822-f553-4dd2-a920-1c83dbd03e06 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:01.074189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb87822-f553-4dd2-a920-1c83dbd03e06 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:01.075138 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb87822-f553-4dd2-a920-1c83dbd03e06 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:01.075591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb87822-f553-4dd2-a920-1c83dbd03e06 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:01.076008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb87822-f553-4dd2-a920-1c83dbd03e06 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:01.158405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-feb87822-f553-4dd2-a920-1c83dbd03e06 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:01.170812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-feb87822-f553-4dd2-a920-1c83dbd03e06 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.109523 Aug 31 00:59:01.171436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1580/3105] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:01 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:01.238751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c60d81e5-2e42-4394-98a0-7a369b85c1e7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:01.249886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c60d81e5-2e42-4394-98a0-7a369b85c1e7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.216232 Aug 31 00:59:01.250662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1526/3106] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:01 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:01.953968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:01.954614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:01.963383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:01.963480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:01.963851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:01.964619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:01.965013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:01.965437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:02.193963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c29bbfc4-3e93-4041-b84c-141623fa76f3 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:02.196008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c29bbfc4-3e93-4041-b84c-141623fa76f3 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:02.203234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29bbfc4-3e93-4041-b84c-141623fa76f3 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:02.211148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29bbfc4-3e93-4041-b84c-141623fa76f3 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:02.211991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29bbfc4-3e93-4041-b84c-141623fa76f3 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:02.212715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29bbfc4-3e93-4041-b84c-141623fa76f3 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:02.213179 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29bbfc4-3e93-4041-b84c-141623fa76f3 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:02.213636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c29bbfc4-3e93-4041-b84c-141623fa76f3 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:02.324806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c29bbfc4-3e93-4041-b84c-141623fa76f3 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:02.349049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c29bbfc4-3e93-4041-b84c-141623fa76f3 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.157415 Aug 31 00:59:02.364867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1527/3107] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:02 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:59:02.370791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-86565035-bd2a-4c46-a970-79756d33475e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:02.371662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-86565035-bd2a-4c46-a970-79756d33475e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:02.379761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86565035-bd2a-4c46-a970-79756d33475e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:02.380629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86565035-bd2a-4c46-a970-79756d33475e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:02.381222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86565035-bd2a-4c46-a970-79756d33475e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:02.382486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86565035-bd2a-4c46-a970-79756d33475e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:02.383260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86565035-bd2a-4c46-a970-79756d33475e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:02.383893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86565035-bd2a-4c46-a970-79756d33475e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:02.564401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:02.574995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:02.583942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:02.587349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-441c2b2a-6f76-4aa9-bad7-20a3ace29d0f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.636212 Aug 31 00:59:02.588099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1581/3108] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:01 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:02.660530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-86565035-bd2a-4c46-a970-79756d33475e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:02.673680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-86565035-bd2a-4c46-a970-79756d33475e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.318834 Aug 31 00:59:02.674809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1528/3109] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:02 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:02.809477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-15882b15-b441-4128-b1fe-490646022ecb req-531cdbdf-18b2-410e-9ad1-b0d29904d4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b121863b-98ef-451b-be2a-2f3f615e4456", "name": "network-vif-plugged", "status": "completed", "tag": "fc9e7855-130f-49c9-944c-e779446adb05"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:59:02.832364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-15882b15-b441-4128-b1fe-490646022ecb req-531cdbdf-18b2-410e-9ad1-b0d29904d4fa service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:02.832843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-15882b15-b441-4128-b1fe-490646022ecb req-531cdbdf-18b2-410e-9ad1-b0d29904d4fa service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:02.833354 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-15882b15-b441-4128-b1fe-490646022ecb req-531cdbdf-18b2-410e-9ad1-b0d29904d4fa service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:02.851052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-15882b15-b441-4128-b1fe-490646022ecb req-531cdbdf-18b2-410e-9ad1-b0d29904d4fa service nova] Creating event network-vif-plugged:fc9e7855-130f-49c9-944c-e779446adb05 for instance b121863b-98ef-451b-be2a-2f3f615e4456 on hv-cinder-85506 Aug 31 00:59:02.860584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-15882b15-b441-4128-b1fe-490646022ecb req-531cdbdf-18b2-410e-9ad1-b0d29904d4fa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054698 Aug 31 00:59:02.861972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1582/3110] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:59:03.373121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-91daf4aa-59c6-4606-991c-39554fedd861 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:03.373757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-91daf4aa-59c6-4606-991c-39554fedd861 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:03.381471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-91daf4aa-59c6-4606-991c-39554fedd861 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:03.382168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-91daf4aa-59c6-4606-991c-39554fedd861 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:03.382629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-91daf4aa-59c6-4606-991c-39554fedd861 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:03.383460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-91daf4aa-59c6-4606-991c-39554fedd861 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:03.384070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-91daf4aa-59c6-4606-991c-39554fedd861 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:03.384936 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-91daf4aa-59c6-4606-991c-39554fedd861 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:03.489073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-91daf4aa-59c6-4606-991c-39554fedd861 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:03.497061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-91daf4aa-59c6-4606-991c-39554fedd861 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.127652 Aug 31 00:59:03.497692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1529/3111] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:03 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:03.614617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:03.615340 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:03.623361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:03.624072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:03.624681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:03.625520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:03.626168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:03.626722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:03.703077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4a1a9690-e2d4-476a-a635-ecb27fcd45f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:03.704610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4a1a9690-e2d4-476a-a635-ecb27fcd45f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:03.716033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a1a9690-e2d4-476a-a635-ecb27fcd45f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:03.716539 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a1a9690-e2d4-476a-a635-ecb27fcd45f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:03.717108 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a1a9690-e2d4-476a-a635-ecb27fcd45f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:03.717816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a1a9690-e2d4-476a-a635-ecb27fcd45f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:03.718673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a1a9690-e2d4-476a-a635-ecb27fcd45f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:03.719505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4a1a9690-e2d4-476a-a635-ecb27fcd45f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:03.831417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:03.841462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:03.843322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:03.844930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a28ce556-dc93-4466-9eaf-d9f2c8fd0b0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.234665 Aug 31 00:59:03.845659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1583/3112] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:03 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:03.918367 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4a1a9690-e2d4-476a-a635-ecb27fcd45f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:03.926084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4a1a9690-e2d4-476a-a635-ecb27fcd45f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.229799 Aug 31 00:59:03.926687 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1530/3113] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:03 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:04.518855 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-58365b42-df3d-4f7e-b009-caeaffd84010 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:04.519492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-58365b42-df3d-4f7e-b009-caeaffd84010 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:04.530630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58365b42-df3d-4f7e-b009-caeaffd84010 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:04.531568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58365b42-df3d-4f7e-b009-caeaffd84010 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:04.532183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58365b42-df3d-4f7e-b009-caeaffd84010 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:04.533039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58365b42-df3d-4f7e-b009-caeaffd84010 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:04.533792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58365b42-df3d-4f7e-b009-caeaffd84010 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:04.534428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58365b42-df3d-4f7e-b009-caeaffd84010 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:04.613788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-58365b42-df3d-4f7e-b009-caeaffd84010 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:04.623343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-58365b42-df3d-4f7e-b009-caeaffd84010 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.108188 Aug 31 00:59:04.627176 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1584/3114] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:04 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:04.870527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:04.871154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:04.881977 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:04.883005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:04.883813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:04.884701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:04.885498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:04.886143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:04.916116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:04.950626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4bbcb88c-9028-4bd4-b480-4f2a2510b1ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:04.951445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4bbcb88c-9028-4bd4-b480-4f2a2510b1ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:04.959330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bbcb88c-9028-4bd4-b480-4f2a2510b1ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:04.959983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bbcb88c-9028-4bd4-b480-4f2a2510b1ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:04.960700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bbcb88c-9028-4bd4-b480-4f2a2510b1ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:04.961401 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bbcb88c-9028-4bd4-b480-4f2a2510b1ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:04.961850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bbcb88c-9028-4bd4-b480-4f2a2510b1ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:04.962267 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bbcb88c-9028-4bd4-b480-4f2a2510b1ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:05.175970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4bbcb88c-9028-4bd4-b480-4f2a2510b1ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:05.185197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4bbcb88c-9028-4bd4-b480-4f2a2510b1ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.241534 Aug 31 00:59:05.185778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1585/3115] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:04 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:05.197279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:05.205294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:05.206723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:05.207896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5f8dc779-fe1a-4891-ac42-d65f3ad5525d tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.341277 Aug 31 00:59:05.208449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1531/3116] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:04 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:05.644573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aa14aaa6-4f89-4559-a41f-4cd41182f523 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:05.645175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aa14aaa6-4f89-4559-a41f-4cd41182f523 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:05.652645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa14aaa6-4f89-4559-a41f-4cd41182f523 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:05.653127 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa14aaa6-4f89-4559-a41f-4cd41182f523 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:05.653683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa14aaa6-4f89-4559-a41f-4cd41182f523 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:05.654378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa14aaa6-4f89-4559-a41f-4cd41182f523 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:05.654825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa14aaa6-4f89-4559-a41f-4cd41182f523 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:05.655272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa14aaa6-4f89-4559-a41f-4cd41182f523 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:05.720965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aa14aaa6-4f89-4559-a41f-4cd41182f523 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:05.729599 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aa14aaa6-4f89-4559-a41f-4cd41182f523 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.088967 Aug 31 00:59:05.730263 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1586/3117] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:05 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:06.207863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6774b9ca-4d27-438c-98ee-81bf242d3ad3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:06.208512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6774b9ca-4d27-438c-98ee-81bf242d3ad3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:06.212903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:06.217273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6774b9ca-4d27-438c-98ee-81bf242d3ad3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:06.217754 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6774b9ca-4d27-438c-98ee-81bf242d3ad3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:06.218185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6774b9ca-4d27-438c-98ee-81bf242d3ad3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:06.218908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6774b9ca-4d27-438c-98ee-81bf242d3ad3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:06.219647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6774b9ca-4d27-438c-98ee-81bf242d3ad3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:06.220064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6774b9ca-4d27-438c-98ee-81bf242d3ad3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:06.232271 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:06.232988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:06.239222 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:06.244308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:06.244852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:06.247395 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:06.247952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:06.251494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:06.703281 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6774b9ca-4d27-438c-98ee-81bf242d3ad3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:06.712906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6774b9ca-4d27-438c-98ee-81bf242d3ad3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.508855 Aug 31 00:59:06.727493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1532/3118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:06 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:06.729290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:06.737886 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:06.743190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:06.743190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0cb40f23-a63c-4717-8d2c-af351863c6d1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.513485 Aug 31 00:59:06.743190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1587/3119] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:06 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:06.751725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bb85537d-5f6b-4d63-b5b0-07c48832d746 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:06.752603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bb85537d-5f6b-4d63-b5b0-07c48832d746 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:06.761397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb85537d-5f6b-4d63-b5b0-07c48832d746 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:06.762410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb85537d-5f6b-4d63-b5b0-07c48832d746 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:06.763079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb85537d-5f6b-4d63-b5b0-07c48832d746 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:06.763994 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb85537d-5f6b-4d63-b5b0-07c48832d746 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:06.764515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb85537d-5f6b-4d63-b5b0-07c48832d746 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:06.765181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb85537d-5f6b-4d63-b5b0-07c48832d746 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:06.834456 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bb85537d-5f6b-4d63-b5b0-07c48832d746 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:06.842593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bb85537d-5f6b-4d63-b5b0-07c48832d746 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.094864 Aug 31 00:59:06.843447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1533/3120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:06 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:07.739728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2da893ec-ca7a-451a-9f6c-1c3c6b629bfd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:07.740381 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2da893ec-ca7a-451a-9f6c-1c3c6b629bfd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:07.747149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2da893ec-ca7a-451a-9f6c-1c3c6b629bfd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:07.747628 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2da893ec-ca7a-451a-9f6c-1c3c6b629bfd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:07.748056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2da893ec-ca7a-451a-9f6c-1c3c6b629bfd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:07.748742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2da893ec-ca7a-451a-9f6c-1c3c6b629bfd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:07.749181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2da893ec-ca7a-451a-9f6c-1c3c6b629bfd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:07.749776 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2da893ec-ca7a-451a-9f6c-1c3c6b629bfd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:07.765968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:07.766569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:07.775078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:07.775568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:07.776110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:07.776854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:07.777528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:07.778243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:07.974792 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2da893ec-ca7a-451a-9f6c-1c3c6b629bfd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:07.986711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2da893ec-ca7a-451a-9f6c-1c3c6b629bfd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.250982 Aug 31 00:59:07.993247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:07.994315 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1588/3121] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:07 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:08.000352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-afef6c52-4ba3-4735-a506-9f89b894a277 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:08.001572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-afef6c52-4ba3-4735-a506-9f89b894a277 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:08.008954 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:08.010396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afef6c52-4ba3-4735-a506-9f89b894a277 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:08.010529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:08.010715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afef6c52-4ba3-4735-a506-9f89b894a277 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:08.011200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afef6c52-4ba3-4735-a506-9f89b894a277 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:08.011905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afef6c52-4ba3-4735-a506-9f89b894a277 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:08.012363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afef6c52-4ba3-4735-a506-9f89b894a277 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:08.012787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afef6c52-4ba3-4735-a506-9f89b894a277 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:08.013089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-21400f55-3fe7-41bb-991f-b77346d0ae0b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.250653 Aug 31 00:59:08.023983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1534/3122] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:07 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:59:08.094493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-afef6c52-4ba3-4735-a506-9f89b894a277 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:08.104280 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-afef6c52-4ba3-4735-a506-9f89b894a277 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.108782 Aug 31 00:59:08.104861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1589/3123] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:07 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:09.015824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c12a6009-5561-4435-9067-a1160a84dbfb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:09.017425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c12a6009-5561-4435-9067-a1160a84dbfb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:09.025110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c12a6009-5561-4435-9067-a1160a84dbfb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:09.025663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c12a6009-5561-4435-9067-a1160a84dbfb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:09.026164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c12a6009-5561-4435-9067-a1160a84dbfb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:09.027150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c12a6009-5561-4435-9067-a1160a84dbfb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:09.027698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c12a6009-5561-4435-9067-a1160a84dbfb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:09.028184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c12a6009-5561-4435-9067-a1160a84dbfb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:09.039870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:09.041718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:09.048428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:09.049196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:09.049921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:09.050650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:09.051290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:09.051711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:09.056734 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:09.232397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c12a6009-5561-4435-9067-a1160a84dbfb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:09.241109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c12a6009-5561-4435-9067-a1160a84dbfb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.228998 Aug 31 00:59:09.253993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1535/3124] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:09 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:09.257825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:09.258720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-52abe22f-387c-40f4-8c60-51843e2e9f70 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:09.259349 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-52abe22f-387c-40f4-8c60-51843e2e9f70 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:09.269086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:09.270519 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:09.271689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e8adde31-f67f-4241-89ed-d8342a3ec602 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.236933 Aug 31 00:59:09.272837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1590/3125] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:09 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:59:09.276693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52abe22f-387c-40f4-8c60-51843e2e9f70 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:09.277182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52abe22f-387c-40f4-8c60-51843e2e9f70 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:09.277603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52abe22f-387c-40f4-8c60-51843e2e9f70 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:09.278451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52abe22f-387c-40f4-8c60-51843e2e9f70 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:09.278895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52abe22f-387c-40f4-8c60-51843e2e9f70 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:09.279341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-52abe22f-387c-40f4-8c60-51843e2e9f70 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:09.342411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-52abe22f-387c-40f4-8c60-51843e2e9f70 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:09.350206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-52abe22f-387c-40f4-8c60-51843e2e9f70 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.095378 Aug 31 00:59:09.350778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1536/3126] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:09 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:10.261825 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cd1f97c9-a90f-405d-9fc3-8a82af9e5327 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:10.262429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cd1f97c9-a90f-405d-9fc3-8a82af9e5327 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:10.268900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd1f97c9-a90f-405d-9fc3-8a82af9e5327 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:10.269377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd1f97c9-a90f-405d-9fc3-8a82af9e5327 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:10.269807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd1f97c9-a90f-405d-9fc3-8a82af9e5327 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:10.270488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd1f97c9-a90f-405d-9fc3-8a82af9e5327 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:10.271134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd1f97c9-a90f-405d-9fc3-8a82af9e5327 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:10.271780 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd1f97c9-a90f-405d-9fc3-8a82af9e5327 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:10.296259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:10.296899 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:10.298927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:10.300589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=16 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:10.311377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:10.312061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:10.312686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:10.313627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:10.314217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:10.314807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:10.475118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cd1f97c9-a90f-405d-9fc3-8a82af9e5327 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:10.483494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cd1f97c9-a90f-405d-9fc3-8a82af9e5327 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.225401 Aug 31 00:59:10.484183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1591/3127] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:10 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:10.490698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cd46760f-d18d-4456-8176-a35c36d315f1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:10.491592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cd46760f-d18d-4456-8176-a35c36d315f1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:10.499547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd46760f-d18d-4456-8176-a35c36d315f1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:10.500327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd46760f-d18d-4456-8176-a35c36d315f1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:10.500755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd46760f-d18d-4456-8176-a35c36d315f1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:10.501609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd46760f-d18d-4456-8176-a35c36d315f1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:10.502101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd46760f-d18d-4456-8176-a35c36d315f1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:10.502551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cd46760f-d18d-4456-8176-a35c36d315f1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:10.504119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:10.513542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:10.515240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:10.516534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ac28851e-eb02-4278-a19d-e19319268012 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.224910 Aug 31 00:59:10.517584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1537/3128] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:10 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:10.566281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cd46760f-d18d-4456-8176-a35c36d315f1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:10.574983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cd46760f-d18d-4456-8176-a35c36d315f1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.089733 Aug 31 00:59:10.575615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1592/3129] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:10 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:11.505091 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f566ef45-9f07-4de5-9d9a-f8942696869f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:11.505699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f566ef45-9f07-4de5-9d9a-f8942696869f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:11.513705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f566ef45-9f07-4de5-9d9a-f8942696869f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:11.513825 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f566ef45-9f07-4de5-9d9a-f8942696869f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:11.514439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f566ef45-9f07-4de5-9d9a-f8942696869f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:11.515175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f566ef45-9f07-4de5-9d9a-f8942696869f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:11.515627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f566ef45-9f07-4de5-9d9a-f8942696869f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:11.516068 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f566ef45-9f07-4de5-9d9a-f8942696869f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:11.543027 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:11.544995 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:11.551721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:11.552195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:11.552616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:11.554106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:11.554745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:11.555197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:11.735939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f566ef45-9f07-4de5-9d9a-f8942696869f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:11.739944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:11.744146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f566ef45-9f07-4de5-9d9a-f8942696869f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.242928 Aug 31 00:59:11.744804 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1538/3130] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:11 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:11.748644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:11.749713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a6f4133d-cf7c-45ed-b0ac-9b500ff8ffe4 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:11.750108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:11.750425 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a6f4133d-cf7c-45ed-b0ac-9b500ff8ffe4 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:11.751279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e6a58917-a764-4443-95b3-728b389741cf tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.213405 Aug 31 00:59:11.751831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1593/3131] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:11 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:11.757014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6f4133d-cf7c-45ed-b0ac-9b500ff8ffe4 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:11.757733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6f4133d-cf7c-45ed-b0ac-9b500ff8ffe4 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:11.757733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6f4133d-cf7c-45ed-b0ac-9b500ff8ffe4 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:11.758823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6f4133d-cf7c-45ed-b0ac-9b500ff8ffe4 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:11.759301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6f4133d-cf7c-45ed-b0ac-9b500ff8ffe4 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:11.759778 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6f4133d-cf7c-45ed-b0ac-9b500ff8ffe4 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:11.821151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a6f4133d-cf7c-45ed-b0ac-9b500ff8ffe4 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:11.828774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a6f4133d-cf7c-45ed-b0ac-9b500ff8ffe4 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.082974 Aug 31 00:59:11.829338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1539/3132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:11 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:12.770101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-edee10c4-5e83-45f4-a28b-9a0e5cd54431 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:12.770101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-edee10c4-5e83-45f4-a28b-9a0e5cd54431 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:12.776651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:12.777106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edee10c4-5e83-45f4-a28b-9a0e5cd54431 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:12.777288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:12.777566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edee10c4-5e83-45f4-a28b-9a0e5cd54431 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:12.777992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edee10c4-5e83-45f4-a28b-9a0e5cd54431 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:12.778672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edee10c4-5e83-45f4-a28b-9a0e5cd54431 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:12.779140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edee10c4-5e83-45f4-a28b-9a0e5cd54431 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:12.779554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edee10c4-5e83-45f4-a28b-9a0e5cd54431 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:12.783286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:12.783767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:12.784198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:12.784881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:12.785330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:12.785753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:12.979869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-edee10c4-5e83-45f4-a28b-9a0e5cd54431 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:12.986732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:12.991305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-edee10c4-5e83-45f4-a28b-9a0e5cd54431 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.226683 Aug 31 00:59:12.992428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1594/3133] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:12 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:12.998394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:12.999533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:13.000696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-caba5765-1d10-4c62-8cac-7b7eb6c16df6 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.229498 Aug 31 00:59:13.001272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1540/3134] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:12 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:59:13.005219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c92f0381-004c-4dbd-adb6-208368caa2cb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:13.005820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c92f0381-004c-4dbd-adb6-208368caa2cb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:13.012572 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c92f0381-004c-4dbd-adb6-208368caa2cb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:13.013048 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c92f0381-004c-4dbd-adb6-208368caa2cb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:13.013475 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c92f0381-004c-4dbd-adb6-208368caa2cb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:13.014152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c92f0381-004c-4dbd-adb6-208368caa2cb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:13.014596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c92f0381-004c-4dbd-adb6-208368caa2cb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:13.015008 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c92f0381-004c-4dbd-adb6-208368caa2cb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:13.076190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c92f0381-004c-4dbd-adb6-208368caa2cb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:13.083680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c92f0381-004c-4dbd-adb6-208368caa2cb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1186 microversion: 2.1 time: 0.089792 Aug 31 00:59:13.084228 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1595/3135] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:12 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:14.017686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-69b00649-1b47-4b89-b187-4289656c8b09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:14.018561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-69b00649-1b47-4b89-b187-4289656c8b09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:14.030193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:14.030659 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69b00649-1b47-4b89-b187-4289656c8b09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:14.031018 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:14.031248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69b00649-1b47-4b89-b187-4289656c8b09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:14.031513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69b00649-1b47-4b89-b187-4289656c8b09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:14.032243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69b00649-1b47-4b89-b187-4289656c8b09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:14.032698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69b00649-1b47-4b89-b187-4289656c8b09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:14.033119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69b00649-1b47-4b89-b187-4289656c8b09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:14.038517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:14.039437 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:14.040177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:14.041150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:14.041779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:14.042387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:14.237656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-69b00649-1b47-4b89-b187-4289656c8b09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:14.242123 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:14.246409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-69b00649-1b47-4b89-b187-4289656c8b09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.233993 Aug 31 00:59:14.246996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1541/3136] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:14 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:14.250525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:14.251625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a1d18e45-418d-4a02-b836-545efed0ff5a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:14.252196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:14.252324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a1d18e45-418d-4a02-b836-545efed0ff5a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:14.253426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-152607b2-69c1-4a85-886a-002f026a4d68 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.228881 Aug 31 00:59:14.254050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1596/3137] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:14 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:14.258514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1d18e45-418d-4a02-b836-545efed0ff5a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:14.261224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1d18e45-418d-4a02-b836-545efed0ff5a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:14.261224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1d18e45-418d-4a02-b836-545efed0ff5a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:14.261224 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1d18e45-418d-4a02-b836-545efed0ff5a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:14.261499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1d18e45-418d-4a02-b836-545efed0ff5a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:14.261677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1d18e45-418d-4a02-b836-545efed0ff5a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:14.331933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a1d18e45-418d-4a02-b836-545efed0ff5a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:14.340740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a1d18e45-418d-4a02-b836-545efed0ff5a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1204 microversion: 2.1 time: 0.092779 Aug 31 00:59:14.341304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1542/3138] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:14 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1204 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:15.267730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-28760398-3be6-4ab4-8720-ad7bf1d6d785 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:15.268276 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-28760398-3be6-4ab4-8720-ad7bf1d6d785 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:15.277480 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28760398-3be6-4ab4-8720-ad7bf1d6d785 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:15.278238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28760398-3be6-4ab4-8720-ad7bf1d6d785 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:15.278429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:15.279377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:15.279523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28760398-3be6-4ab4-8720-ad7bf1d6d785 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:15.280699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28760398-3be6-4ab4-8720-ad7bf1d6d785 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:15.281343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28760398-3be6-4ab4-8720-ad7bf1d6d785 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:15.282304 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28760398-3be6-4ab4-8720-ad7bf1d6d785 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:15.285584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:15.285892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:15.286380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:15.287096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:15.287577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:15.288857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:15.512699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-28760398-3be6-4ab4-8720-ad7bf1d6d785 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:15.521058 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-28760398-3be6-4ab4-8720-ad7bf1d6d785 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.257388 Aug 31 00:59:15.521644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1597/3139] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:15 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:15.524822 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:15.526975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ffc707f5-3f59-41a8-8d09-cce7775bfb88 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:15.527617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ffc707f5-3f59-41a8-8d09-cce7775bfb88 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:15.533431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:15.533758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc707f5-3f59-41a8-8d09-cce7775bfb88 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:15.534242 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc707f5-3f59-41a8-8d09-cce7775bfb88 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:15.534683 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc707f5-3f59-41a8-8d09-cce7775bfb88 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:15.535195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:15.535408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc707f5-3f59-41a8-8d09-cce7775bfb88 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:15.535859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc707f5-3f59-41a8-8d09-cce7775bfb88 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:15.536283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ffc707f5-3f59-41a8-8d09-cce7775bfb88 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:15.536605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d51b0c36-4dc9-45a7-8880-e1b69537c351 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.262746 Aug 31 00:59:15.537234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1543/3140] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:15 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:59:15.604525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ffc707f5-3f59-41a8-8d09-cce7775bfb88 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:15.612643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ffc707f5-3f59-41a8-8d09-cce7775bfb88 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1204 microversion: 2.1 time: 0.089735 Aug 31 00:59:15.613202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1598/3141] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:15 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1204 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:16.542211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d10934b6-7d63-474e-84b0-8f808cb89a2f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:16.542830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d10934b6-7d63-474e-84b0-8f808cb89a2f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:16.549184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d10934b6-7d63-474e-84b0-8f808cb89a2f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:16.549660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d10934b6-7d63-474e-84b0-8f808cb89a2f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:16.550093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d10934b6-7d63-474e-84b0-8f808cb89a2f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:16.550780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d10934b6-7d63-474e-84b0-8f808cb89a2f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:16.551374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d10934b6-7d63-474e-84b0-8f808cb89a2f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:16.551808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d10934b6-7d63-474e-84b0-8f808cb89a2f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:16.566510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:16.570142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:16.589701 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:16.590523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:16.592373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:16.593934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:16.597360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:16.598538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:16.950836 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d10934b6-7d63-474e-84b0-8f808cb89a2f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:16.965171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d10934b6-7d63-474e-84b0-8f808cb89a2f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.427278 Aug 31 00:59:16.965952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1544/3142] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:16 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:16.966355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:16.971974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3e476d78-776d-4092-833f-d7a0bc89b765 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:16.973001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3e476d78-776d-4092-833f-d7a0bc89b765 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:16.977827 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:16.979518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:16.980371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e476d78-776d-4092-833f-d7a0bc89b765 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:16.981057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e476d78-776d-4092-833f-d7a0bc89b765 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:16.981172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-48deb1cd-b3ab-40fe-b6a5-19cee786064e tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.424141 Aug 31 00:59:16.981782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e476d78-776d-4092-833f-d7a0bc89b765 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:16.982740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e476d78-776d-4092-833f-d7a0bc89b765 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:16.983516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e476d78-776d-4092-833f-d7a0bc89b765 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:16.984159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e476d78-776d-4092-833f-d7a0bc89b765 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:16.989050 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1599/3143] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:16 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:17.063052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e476d78-776d-4092-833f-d7a0bc89b765 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:17.075368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3e476d78-776d-4092-833f-d7a0bc89b765 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1204 microversion: 2.1 time: 0.107562 Aug 31 00:59:17.076553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1545/3144] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:16 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1204 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:17.993364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-96e30aa3-31fb-4989-9231-15f5dabd5248 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:17.994084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-96e30aa3-31fb-4989-9231-15f5dabd5248 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:18.001561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96e30aa3-31fb-4989-9231-15f5dabd5248 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:18.002130 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96e30aa3-31fb-4989-9231-15f5dabd5248 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:18.002578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96e30aa3-31fb-4989-9231-15f5dabd5248 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:18.003314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96e30aa3-31fb-4989-9231-15f5dabd5248 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:18.005010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96e30aa3-31fb-4989-9231-15f5dabd5248 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:18.005010 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-96e30aa3-31fb-4989-9231-15f5dabd5248 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:18.005192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:18.005772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:18.013915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:18.014368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:18.014808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:18.015526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:18.015982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:18.016406 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:18.212035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-96e30aa3-31fb-4989-9231-15f5dabd5248 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:18.217246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:18.220255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-96e30aa3-31fb-4989-9231-15f5dabd5248 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1366 microversion: 2.1 time: 0.231033 Aug 31 00:59:18.220831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1600/3145] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:17 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:18.225555 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-182c700f-5b3b-41fc-a3ea-ad949e0ea315 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:18.226470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-182c700f-5b3b-41fc-a3ea-ad949e0ea315 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:18.233045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-182c700f-5b3b-41fc-a3ea-ad949e0ea315 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:18.233750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-182c700f-5b3b-41fc-a3ea-ad949e0ea315 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:18.234681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-182c700f-5b3b-41fc-a3ea-ad949e0ea315 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:18.235389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-182c700f-5b3b-41fc-a3ea-ad949e0ea315 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:18.235974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-182c700f-5b3b-41fc-a3ea-ad949e0ea315 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:18.236730 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-182c700f-5b3b-41fc-a3ea-ad949e0ea315 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:18.238341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:18.241981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:18.243229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4b2e0651-a215-4110-8a1a-7cf6ea6c0a08 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.242289 Aug 31 00:59:18.259216 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1546/3146] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:17 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:18.456645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-182c700f-5b3b-41fc-a3ea-ad949e0ea315 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:18.466283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-182c700f-5b3b-41fc-a3ea-ad949e0ea315 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1271 microversion: 2.1 time: 0.244245 Aug 31 00:59:18.467220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1601/3147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:18 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:18.761273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-4155fd15-e140-4ce9-a86d-bbea7cd8c876 req-11a3b251-96a4-4967-b930-f92c3bdc04e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84565566-bd8b-456c-8e83-ffcf92c75eb6", "name": "network-vif-plugged", "status": "completed", "tag": "58c975ff-15b0-4244-9b51-c1f72d71088c"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:59:18.774484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-4155fd15-e140-4ce9-a86d-bbea7cd8c876 req-11a3b251-96a4-4967-b930-f92c3bdc04e1 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:18.775366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-4155fd15-e140-4ce9-a86d-bbea7cd8c876 req-11a3b251-96a4-4967-b930-f92c3bdc04e1 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:18.776027 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-4155fd15-e140-4ce9-a86d-bbea7cd8c876 req-11a3b251-96a4-4967-b930-f92c3bdc04e1 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:18.790003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-4155fd15-e140-4ce9-a86d-bbea7cd8c876 req-11a3b251-96a4-4967-b930-f92c3bdc04e1 service nova] Creating event network-vif-plugged:58c975ff-15b0-4244-9b51-c1f72d71088c for instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 on hv-cinder-85506 Aug 31 00:59:18.803776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-4155fd15-e140-4ce9-a86d-bbea7cd8c876 req-11a3b251-96a4-4967-b930-f92c3bdc04e1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040860 Aug 31 00:59:18.803776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1547/3148] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:59:18.941488 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-4a630a64-664b-462d-9fc0-1d66b48d0623 req-790fa5b7-c4cc-47cb-bc7d-739c77b6c602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4dd3781-9c72-4d8d-9cd8-114d0aead4db", "tag": "28bd9e08-7e14-43fc-9b70-0737bc3a18e9"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:59:18.960141 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-4a630a64-664b-462d-9fc0-1d66b48d0623 req-790fa5b7-c4cc-47cb-bc7d-739c77b6c602 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:18.960845 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-4a630a64-664b-462d-9fc0-1d66b48d0623 req-790fa5b7-c4cc-47cb-bc7d-739c77b6c602 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:18.961499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-4a630a64-664b-462d-9fc0-1d66b48d0623 req-790fa5b7-c4cc-47cb-bc7d-739c77b6c602 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:18.976247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-4a630a64-664b-462d-9fc0-1d66b48d0623 req-790fa5b7-c4cc-47cb-bc7d-739c77b6c602 service nova] Creating event network-changed:28bd9e08-7e14-43fc-9b70-0737bc3a18e9 for instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db on hv-cinder-85506 Aug 31 00:59:18.981426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-4a630a64-664b-462d-9fc0-1d66b48d0623 req-790fa5b7-c4cc-47cb-bc7d-739c77b6c602 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043731 Aug 31 00:59:18.982180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1602/3149] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:59:19.243248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-37a52366-e8cc-40c3-9ea8-63c717206315 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:19.244001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-37a52366-e8cc-40c3-9ea8-63c717206315 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:19.250766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a52366-e8cc-40c3-9ea8-63c717206315 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:19.251270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a52366-e8cc-40c3-9ea8-63c717206315 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:19.254940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a52366-e8cc-40c3-9ea8-63c717206315 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:19.256053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a52366-e8cc-40c3-9ea8-63c717206315 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:19.257310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a52366-e8cc-40c3-9ea8-63c717206315 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:19.257896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37a52366-e8cc-40c3-9ea8-63c717206315 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:19.268535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:19.269809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:19.285244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:19.286040 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:19.286707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:19.288380 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:19.289160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:19.289788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:19.522362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-37a52366-e8cc-40c3-9ea8-63c717206315 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:19.526843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:19.532296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-37a52366-e8cc-40c3-9ea8-63c717206315 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1555 microversion: 2.1 time: 0.294468 Aug 31 00:59:19.533042 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1548/3150] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:19 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1555 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:19.551105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:19.555671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-787c7e11-9a1e-42cc-8de0-c6f072b18f55 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:19.556188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-787c7e11-9a1e-42cc-8de0-c6f072b18f55 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:19.561840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:19.563318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:19.564471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b2c82198-5aaf-453e-85c5-352d7d7385a7 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.300788 Aug 31 00:59:19.565033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1603/3151] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:19 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:19.575403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b53d0d39-6a37-49df-b45c-8f13b7aa1bae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:19.577283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-787c7e11-9a1e-42cc-8de0-c6f072b18f55 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:19.578175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-787c7e11-9a1e-42cc-8de0-c6f072b18f55 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:19.578610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-787c7e11-9a1e-42cc-8de0-c6f072b18f55 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:19.579354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-787c7e11-9a1e-42cc-8de0-c6f072b18f55 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:19.579790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-787c7e11-9a1e-42cc-8de0-c6f072b18f55 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:19.580207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-787c7e11-9a1e-42cc-8de0-c6f072b18f55 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:19.585581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b53d0d39-6a37-49df-b45c-8f13b7aa1bae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:19.592918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b53d0d39-6a37-49df-b45c-8f13b7aa1bae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:19.593606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b53d0d39-6a37-49df-b45c-8f13b7aa1bae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:19.595140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b53d0d39-6a37-49df-b45c-8f13b7aa1bae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:19.595877 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b53d0d39-6a37-49df-b45c-8f13b7aa1bae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:19.596335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b53d0d39-6a37-49df-b45c-8f13b7aa1bae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:19.596748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b53d0d39-6a37-49df-b45c-8f13b7aa1bae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:19.741422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b53d0d39-6a37-49df-b45c-8f13b7aa1bae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170779 Aug 31 00:59:19.742594 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1604/3152] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 31 00:59:19 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:59:19.789542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-787c7e11-9a1e-42cc-8de0-c6f072b18f55 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:19.797596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-787c7e11-9a1e-42cc-8de0-c6f072b18f55 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.263392 Aug 31 00:59:19.798146 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1549/3153] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:19 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:20.590275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:20.591553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:20.598718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:20.599282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:20.600345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:20.601071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:20.602502 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:20.603111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:20.747732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:20.756168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:20.757589 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:20.758741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-80528f2b-d97b-4332-a645-f241827ee5af tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.173437 Aug 31 00:59:20.759343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1605/3154] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:20 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:20.819563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be456d83-3781-4bae-820b-4ca3cf076b9e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:20.820322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-be456d83-3781-4bae-820b-4ca3cf076b9e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:20.827178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be456d83-3781-4bae-820b-4ca3cf076b9e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:20.827938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be456d83-3781-4bae-820b-4ca3cf076b9e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:20.828438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be456d83-3781-4bae-820b-4ca3cf076b9e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:20.829202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be456d83-3781-4bae-820b-4ca3cf076b9e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:20.829871 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be456d83-3781-4bae-820b-4ca3cf076b9e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:20.830800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be456d83-3781-4bae-820b-4ca3cf076b9e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:20.985324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be456d83-3781-4bae-820b-4ca3cf076b9e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:20.995139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-be456d83-3781-4bae-820b-4ca3cf076b9e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.179555 Aug 31 00:59:20.996053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1550/3155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:20 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:21.016787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-c9c503ba-88aa-428d-ac9c-831f2c99d2be req-12f74e01-6ca2-42b2-b7c2-af646be9a66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b121863b-98ef-451b-be2a-2f3f615e4456", "tag": "fc9e7855-130f-49c9-944c-e779446adb05"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:59:21.031851 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-c9c503ba-88aa-428d-ac9c-831f2c99d2be req-12f74e01-6ca2-42b2-b7c2-af646be9a66a service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:21.032481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-c9c503ba-88aa-428d-ac9c-831f2c99d2be req-12f74e01-6ca2-42b2-b7c2-af646be9a66a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:21.033004 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-c9c503ba-88aa-428d-ac9c-831f2c99d2be req-12f74e01-6ca2-42b2-b7c2-af646be9a66a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:21.045673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-c9c503ba-88aa-428d-ac9c-831f2c99d2be req-12f74e01-6ca2-42b2-b7c2-af646be9a66a service nova] Creating event network-changed:fc9e7855-130f-49c9-944c-e779446adb05 for instance b121863b-98ef-451b-be2a-2f3f615e4456 on hv-cinder-85506 Aug 31 00:59:21.051214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-c9c503ba-88aa-428d-ac9c-831f2c99d2be req-12f74e01-6ca2-42b2-b7c2-af646be9a66a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046470 Aug 31 00:59:21.052051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1606/3156] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:59:21.781975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:21.782579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:21.789623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:21.790107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:21.790534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:21.791246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:21.791683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:21.792397 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:21.952958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:21.962528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:21.964102 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:21.965243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-879a50ce-676f-47e1-b611-0c299a9690c1 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1731 microversion: 2.20 time: 0.187284 Aug 31 00:59:21.965790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1551/3157] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:21 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:22.019775 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-82e0d182-fb81-4e98-8b60-32c091bea469 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:22.020617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-82e0d182-fb81-4e98-8b60-32c091bea469 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:22.027183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82e0d182-fb81-4e98-8b60-32c091bea469 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:22.027662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82e0d182-fb81-4e98-8b60-32c091bea469 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:22.028092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82e0d182-fb81-4e98-8b60-32c091bea469 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:22.028768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82e0d182-fb81-4e98-8b60-32c091bea469 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:22.029217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82e0d182-fb81-4e98-8b60-32c091bea469 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:22.029758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-82e0d182-fb81-4e98-8b60-32c091bea469 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:22.163314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-82e0d182-fb81-4e98-8b60-32c091bea469 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:22.171065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-82e0d182-fb81-4e98-8b60-32c091bea469 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.157300 Aug 31 00:59:22.171640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1607/3158] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:22 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:22.991243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:22.992215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:23.010738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:23.012396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:23.013105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:23.014864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:23.016025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:23.016668 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:23.169396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:23.177753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:23.179669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:23.180878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e77a58f3-0b41-4bba-868f-ede472ef6d91 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1718 microversion: 2.20 time: 0.194107 Aug 31 00:59:23.181441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1552/3159] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 00:59:22 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1718 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:59:23.195818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2fa58728-6834-4ebc-a077-a3af2d11656d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:23.197097 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2fa58728-6834-4ebc-a077-a3af2d11656d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:23.204454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fa58728-6834-4ebc-a077-a3af2d11656d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:23.204998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fa58728-6834-4ebc-a077-a3af2d11656d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:23.205620 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fa58728-6834-4ebc-a077-a3af2d11656d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:23.206392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fa58728-6834-4ebc-a077-a3af2d11656d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:23.206912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fa58728-6834-4ebc-a077-a3af2d11656d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:23.207421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fa58728-6834-4ebc-a077-a3af2d11656d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:23.225772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:23.401707 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2fa58728-6834-4ebc-a077-a3af2d11656d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:23.409684 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2fa58728-6834-4ebc-a077-a3af2d11656d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.220921 Aug 31 00:59:23.410241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1608/3160] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:23 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:24.431424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c849216e-4b80-4bd2-b54d-cdc368dbf106 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:24.432028 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c849216e-4b80-4bd2-b54d-cdc368dbf106 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:24.438387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c849216e-4b80-4bd2-b54d-cdc368dbf106 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:24.438863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c849216e-4b80-4bd2-b54d-cdc368dbf106 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:24.439477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c849216e-4b80-4bd2-b54d-cdc368dbf106 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:24.440150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c849216e-4b80-4bd2-b54d-cdc368dbf106 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:24.440596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c849216e-4b80-4bd2-b54d-cdc368dbf106 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:24.441008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c849216e-4b80-4bd2-b54d-cdc368dbf106 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:24.583371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c849216e-4b80-4bd2-b54d-cdc368dbf106 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:24.591839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c849216e-4b80-4bd2-b54d-cdc368dbf106 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.164418 Aug 31 00:59:24.592505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1553/3161] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:24 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:25.613476 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4aed13a6-a334-4e18-aaa0-454ae670b024 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:25.614076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4aed13a6-a334-4e18-aaa0-454ae670b024 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:25.621223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4aed13a6-a334-4e18-aaa0-454ae670b024 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:25.621699 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4aed13a6-a334-4e18-aaa0-454ae670b024 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:25.622128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4aed13a6-a334-4e18-aaa0-454ae670b024 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:25.622813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4aed13a6-a334-4e18-aaa0-454ae670b024 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:25.623294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4aed13a6-a334-4e18-aaa0-454ae670b024 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:25.623733 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4aed13a6-a334-4e18-aaa0-454ae670b024 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:25.754052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4aed13a6-a334-4e18-aaa0-454ae670b024 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:25.762022 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4aed13a6-a334-4e18-aaa0-454ae670b024 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.152521 Aug 31 00:59:25.762586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1609/3162] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:25 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:26.783313 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5d539cf9-0fc6-4e77-907f-96a614edd418 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:26.783925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5d539cf9-0fc6-4e77-907f-96a614edd418 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:26.791334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d539cf9-0fc6-4e77-907f-96a614edd418 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:26.791819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d539cf9-0fc6-4e77-907f-96a614edd418 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:26.792254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d539cf9-0fc6-4e77-907f-96a614edd418 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:26.792942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d539cf9-0fc6-4e77-907f-96a614edd418 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:26.793391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d539cf9-0fc6-4e77-907f-96a614edd418 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:26.793812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d539cf9-0fc6-4e77-907f-96a614edd418 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:26.925151 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5d539cf9-0fc6-4e77-907f-96a614edd418 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:26.933612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5d539cf9-0fc6-4e77-907f-96a614edd418 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.154264 Aug 31 00:59:26.934186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1554/3163] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:26 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:27.953731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7268f1a4-646e-4cc9-8c61-c32f3a1ae64d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:27.954325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7268f1a4-646e-4cc9-8c61-c32f3a1ae64d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:27.961486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7268f1a4-646e-4cc9-8c61-c32f3a1ae64d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:27.961959 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7268f1a4-646e-4cc9-8c61-c32f3a1ae64d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:27.962382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7268f1a4-646e-4cc9-8c61-c32f3a1ae64d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:27.963076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7268f1a4-646e-4cc9-8c61-c32f3a1ae64d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:27.963524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7268f1a4-646e-4cc9-8c61-c32f3a1ae64d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:27.963947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7268f1a4-646e-4cc9-8c61-c32f3a1ae64d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:28.107133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7268f1a4-646e-4cc9-8c61-c32f3a1ae64d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:28.115185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7268f1a4-646e-4cc9-8c61-c32f3a1ae64d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.165262 Aug 31 00:59:28.116436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1610/3164] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:27 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:29.135537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-edf8d0d7-af0c-47ba-a23f-b5148b147688 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:29.136170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-edf8d0d7-af0c-47ba-a23f-b5148b147688 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:29.142577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edf8d0d7-af0c-47ba-a23f-b5148b147688 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:29.143071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edf8d0d7-af0c-47ba-a23f-b5148b147688 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:29.143507 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edf8d0d7-af0c-47ba-a23f-b5148b147688 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:29.144184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edf8d0d7-af0c-47ba-a23f-b5148b147688 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:29.144626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edf8d0d7-af0c-47ba-a23f-b5148b147688 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:29.145034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edf8d0d7-af0c-47ba-a23f-b5148b147688 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:29.277172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-edf8d0d7-af0c-47ba-a23f-b5148b147688 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:29.284734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-edf8d0d7-af0c-47ba-a23f-b5148b147688 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.153283 Aug 31 00:59:29.285286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1555/3165] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:29 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:30.306577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d2ce2ef-be33-488f-af63-3c9e1832f35a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:30.307153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d2ce2ef-be33-488f-af63-3c9e1832f35a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:30.309178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=70 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:30.314568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d2ce2ef-be33-488f-af63-3c9e1832f35a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:30.315063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d2ce2ef-be33-488f-af63-3c9e1832f35a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:30.315507 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d2ce2ef-be33-488f-af63-3c9e1832f35a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:30.316193 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d2ce2ef-be33-488f-af63-3c9e1832f35a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:30.316743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d2ce2ef-be33-488f-af63-3c9e1832f35a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:30.317166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d2ce2ef-be33-488f-af63-3c9e1832f35a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:30.451409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8d2ce2ef-be33-488f-af63-3c9e1832f35a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:30.458974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d2ce2ef-be33-488f-af63-3c9e1832f35a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.157026 Aug 31 00:59:30.459563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1611/3166] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:30 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:31.481366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b442885e-4b20-44ff-ac32-3cd0742d45b5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:31.482200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b442885e-4b20-44ff-ac32-3cd0742d45b5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:31.488715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b442885e-4b20-44ff-ac32-3cd0742d45b5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:31.489193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b442885e-4b20-44ff-ac32-3cd0742d45b5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:31.489619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b442885e-4b20-44ff-ac32-3cd0742d45b5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:31.490295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b442885e-4b20-44ff-ac32-3cd0742d45b5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:31.490744 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b442885e-4b20-44ff-ac32-3cd0742d45b5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:31.491854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b442885e-4b20-44ff-ac32-3cd0742d45b5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:31.627082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b442885e-4b20-44ff-ac32-3cd0742d45b5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:31.635103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b442885e-4b20-44ff-ac32-3cd0742d45b5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.158010 Aug 31 00:59:31.635671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1556/3167] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:31 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:59:32.656650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-798ae72d-2dd5-4721-834f-dd70c6c3812f tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:32.657291 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-798ae72d-2dd5-4721-834f-dd70c6c3812f tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:32.664183 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-798ae72d-2dd5-4721-834f-dd70c6c3812f tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:32.664668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-798ae72d-2dd5-4721-834f-dd70c6c3812f tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:32.665104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-798ae72d-2dd5-4721-834f-dd70c6c3812f tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:32.665800 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-798ae72d-2dd5-4721-834f-dd70c6c3812f tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:32.666250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-798ae72d-2dd5-4721-834f-dd70c6c3812f tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:32.666672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-798ae72d-2dd5-4721-834f-dd70c6c3812f tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:32.809714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-798ae72d-2dd5-4721-834f-dd70c6c3812f tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:32.817317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-798ae72d-2dd5-4721-834f-dd70c6c3812f tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.164518 Aug 31 00:59:32.817893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1612/3168] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:32 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:33.838961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f5cf725d-d0b4-415f-935d-3b56b68d550b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:33.840143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f5cf725d-d0b4-415f-935d-3b56b68d550b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:33.848199 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf725d-d0b4-415f-935d-3b56b68d550b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:33.848679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf725d-d0b4-415f-935d-3b56b68d550b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:33.849110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf725d-d0b4-415f-935d-3b56b68d550b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:33.849793 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf725d-d0b4-415f-935d-3b56b68d550b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:33.850937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf725d-d0b4-415f-935d-3b56b68d550b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:33.851434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f5cf725d-d0b4-415f-935d-3b56b68d550b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:34.010247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f5cf725d-d0b4-415f-935d-3b56b68d550b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:34.019148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f5cf725d-d0b4-415f-935d-3b56b68d550b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.185037 Aug 31 00:59:34.019902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1557/3169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:33 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:34.754878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-a4510ad6-8879-42cd-88a6-4940a8ceb2fd req-25bea8c2-b8c5-4336-8bbc-90ac1697db54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dd3781-9c72-4d8d-9cd8-114d0aead4db", "name": "network-vif-plugged", "status": "completed", "tag": "28bd9e08-7e14-43fc-9b70-0737bc3a18e9"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:59:34.767617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a4510ad6-8879-42cd-88a6-4940a8ceb2fd req-25bea8c2-b8c5-4336-8bbc-90ac1697db54 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:34.768337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a4510ad6-8879-42cd-88a6-4940a8ceb2fd req-25bea8c2-b8c5-4336-8bbc-90ac1697db54 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:34.768711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a4510ad6-8879-42cd-88a6-4940a8ceb2fd req-25bea8c2-b8c5-4336-8bbc-90ac1697db54 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:34.781838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-a4510ad6-8879-42cd-88a6-4940a8ceb2fd req-25bea8c2-b8c5-4336-8bbc-90ac1697db54 service nova] Creating event network-vif-plugged:28bd9e08-7e14-43fc-9b70-0737bc3a18e9 for instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db on hv-cinder-85506 Aug 31 00:59:34.787327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-a4510ad6-8879-42cd-88a6-4940a8ceb2fd req-25bea8c2-b8c5-4336-8bbc-90ac1697db54 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036518 Aug 31 00:59:34.788630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1613/3170] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:59:35.048451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-40b06cca-9e27-4977-815c-38166d9644f6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:35.049177 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-40b06cca-9e27-4977-815c-38166d9644f6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:35.056120 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40b06cca-9e27-4977-815c-38166d9644f6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:35.056731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40b06cca-9e27-4977-815c-38166d9644f6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:35.057238 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40b06cca-9e27-4977-815c-38166d9644f6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:35.058000 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40b06cca-9e27-4977-815c-38166d9644f6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:35.058530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40b06cca-9e27-4977-815c-38166d9644f6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:35.059024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40b06cca-9e27-4977-815c-38166d9644f6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:35.202776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-40b06cca-9e27-4977-815c-38166d9644f6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:35.211655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-40b06cca-9e27-4977-815c-38166d9644f6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.167030 Aug 31 00:59:35.212235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1558/3171] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:35 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:36.234806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1f9c3aa1-a70c-4b54-83b2-64ed5e03153c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:36.235515 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1f9c3aa1-a70c-4b54-83b2-64ed5e03153c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:36.242226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f9c3aa1-a70c-4b54-83b2-64ed5e03153c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:36.242731 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f9c3aa1-a70c-4b54-83b2-64ed5e03153c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:36.243192 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f9c3aa1-a70c-4b54-83b2-64ed5e03153c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:36.243863 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f9c3aa1-a70c-4b54-83b2-64ed5e03153c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:36.244305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f9c3aa1-a70c-4b54-83b2-64ed5e03153c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:36.244717 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f9c3aa1-a70c-4b54-83b2-64ed5e03153c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:36.377266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1f9c3aa1-a70c-4b54-83b2-64ed5e03153c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:36.385376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1f9c3aa1-a70c-4b54-83b2-64ed5e03153c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.155248 Aug 31 00:59:36.385930 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1614/3172] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:36 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:37.406039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4c921bcc-7884-4a09-a2c7-a25ba0b0a6da tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:37.406641 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4c921bcc-7884-4a09-a2c7-a25ba0b0a6da tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:37.410005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=54 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:59:37.416168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c921bcc-7884-4a09-a2c7-a25ba0b0a6da tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:37.416643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c921bcc-7884-4a09-a2c7-a25ba0b0a6da tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:37.417097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c921bcc-7884-4a09-a2c7-a25ba0b0a6da tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:37.417776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c921bcc-7884-4a09-a2c7-a25ba0b0a6da tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:37.418215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c921bcc-7884-4a09-a2c7-a25ba0b0a6da tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:37.418626 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4c921bcc-7884-4a09-a2c7-a25ba0b0a6da tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:37.552454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4c921bcc-7884-4a09-a2c7-a25ba0b0a6da tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:37.562285 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4c921bcc-7884-4a09-a2c7-a25ba0b0a6da tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1259 microversion: 2.1 time: 0.160351 Aug 31 00:59:37.562861 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1559/3173] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:37 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:38.583490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ab02d61-0f4c-4cb8-b143-2d2c2a46f759 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:38.584120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ab02d61-0f4c-4cb8-b143-2d2c2a46f759 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:38.587499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:59:38.587650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Wed Aug 31 00:59:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db (ip 10.222.0.67) !!! Aug 31 00:59:38.595390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ab02d61-0f4c-4cb8-b143-2d2c2a46f759 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:38.595864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ab02d61-0f4c-4cb8-b143-2d2c2a46f759 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:38.596297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ab02d61-0f4c-4cb8-b143-2d2c2a46f759 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:38.596961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ab02d61-0f4c-4cb8-b143-2d2c2a46f759 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:38.597402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ab02d61-0f4c-4cb8-b143-2d2c2a46f759 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:38.597812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ab02d61-0f4c-4cb8-b143-2d2c2a46f759 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:38.736663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ab02d61-0f4c-4cb8-b143-2d2c2a46f759 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:38.745402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ab02d61-0f4c-4cb8-b143-2d2c2a46f759 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1443 microversion: 2.1 time: 0.165741 Aug 31 00:59:38.745975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1615/3174] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:38 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:59:38.765779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7babb0d3-1f5c-4930-9b1c-d86d5587232d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:59:38.766403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7babb0d3-1f5c-4930-9b1c-d86d5587232d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:59:38.772385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7babb0d3-1f5c-4930-9b1c-d86d5587232d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:38.772857 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7babb0d3-1f5c-4930-9b1c-d86d5587232d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:38.773277 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7babb0d3-1f5c-4930-9b1c-d86d5587232d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:38.773969 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7babb0d3-1f5c-4930-9b1c-d86d5587232d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:38.774409 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7babb0d3-1f5c-4930-9b1c-d86d5587232d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:38.774855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7babb0d3-1f5c-4930-9b1c-d86d5587232d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:38.903525 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7babb0d3-1f5c-4930-9b1c-d86d5587232d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:59:38.911444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7babb0d3-1f5c-4930-9b1c-d86d5587232d tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1443 microversion: 2.1 time: 0.149661 Aug 31 00:59:38.912009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1560/3175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 00:59:38 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:59:40.918011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-c0d5f60c-e570-4f17-a3fb-31902199935c req-4d5709ae-3b27-4b4e-98a8-c5a13671ca78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4dd3781-9c72-4d8d-9cd8-114d0aead4db", "tag": "28bd9e08-7e14-43fc-9b70-0737bc3a18e9"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:59:40.927808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-c0d5f60c-e570-4f17-a3fb-31902199935c req-4d5709ae-3b27-4b4e-98a8-c5a13671ca78 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:59:40.928822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-c0d5f60c-e570-4f17-a3fb-31902199935c req-4d5709ae-3b27-4b4e-98a8-c5a13671ca78 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:59:40.929236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-c0d5f60c-e570-4f17-a3fb-31902199935c req-4d5709ae-3b27-4b4e-98a8-c5a13671ca78 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:59:40.940319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-c0d5f60c-e570-4f17-a3fb-31902199935c req-4d5709ae-3b27-4b4e-98a8-c5a13671ca78 service nova] Creating event network-changed:28bd9e08-7e14-43fc-9b70-0737bc3a18e9 for instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db on hv-cinder-85506 Aug 31 00:59:40.946057 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-c0d5f60c-e570-4f17-a3fb-31902199935c req-4d5709ae-3b27-4b4e-98a8-c5a13671ca78 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031756 Aug 31 00:59:40.947122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1616/3176] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 00:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:00:34.418170 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3f33ff8e-da26-453c-82ee-9807c5c7048c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:34.420440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3f33ff8e-da26-453c-82ee-9807c5c7048c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:34.423402 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:34.424043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=72 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:34.430072 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f33ff8e-da26-453c-82ee-9807c5c7048c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:34.430547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f33ff8e-da26-453c-82ee-9807c5c7048c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:34.431011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f33ff8e-da26-453c-82ee-9807c5c7048c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:34.431731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f33ff8e-da26-453c-82ee-9807c5c7048c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:34.432172 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f33ff8e-da26-453c-82ee-9807c5c7048c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:34.432595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f33ff8e-da26-453c-82ee-9807c5c7048c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:34.463395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3f33ff8e-da26-453c-82ee-9807c5c7048c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049630 Aug 31 01:00:34.463993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1561/3177] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 31 01:00:34 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:00:34.527133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7fa1ff4c-106e-4a2c-a3b1-dbde39987700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:34.527721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7fa1ff4c-106e-4a2c-a3b1-dbde39987700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:34.530049 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=11 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:34.530822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=43 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:34.536915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fa1ff4c-106e-4a2c-a3b1-dbde39987700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:34.537398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fa1ff4c-106e-4a2c-a3b1-dbde39987700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:34.537830 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fa1ff4c-106e-4a2c-a3b1-dbde39987700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:34.538516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fa1ff4c-106e-4a2c-a3b1-dbde39987700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:34.538967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fa1ff4c-106e-4a2c-a3b1-dbde39987700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:34.539422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7fa1ff4c-106e-4a2c-a3b1-dbde39987700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:34.564230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7fa1ff4c-106e-4a2c-a3b1-dbde39987700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:00:34.641955 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7fa1ff4c-106e-4a2c-a3b1-dbde39987700 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 204 len: 0 microversion: 2.20 time: 0.119038 Aug 31 01:00:34.642638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1617/3178] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 31 01:00:34 2022] DELETE /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 01:00:34.652619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:34.653235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:34.659302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:34.659819 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:34.660206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:34.660890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:34.661338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:34.661760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:34.789159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:34.797315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:34.798758 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:34.799939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-db8c0bde-5aba-4d8c-83ee-2367f248f220 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.152217 Aug 31 01:00:34.800496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1562/3179] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 01:00:34 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 01:00:35.824293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:35.824895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:35.831405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:35.831885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:35.832323 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:35.833002 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:35.833450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:35.833868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:35.966470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:35.974847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:35.976320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:35.977461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-27fdfc21-aeee-41dd-a0e3-1d4818d4a9cc tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.158332 Aug 31 01:00:35.978012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1618/3180] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 01:00:35 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:00:37.000723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:37.001463 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:37.008552 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:37.009041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:37.009475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:37.010694 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:37.011523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:37.011953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:37.142974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:37.151870 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:37.153299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:37.154452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-746563b3-a6b1-43c5-9b55-88df52af828c tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1724 microversion: 2.20 time: 0.157794 Aug 31 01:00:37.155005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1563/3181] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 01:00:36 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:00:37.774471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-27e11081-c7b2-4220-afa8-14755a2ba246 req-d0cead33-9afc-446c-8497-e512ce872743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84565566-bd8b-456c-8e83-ffcf92c75eb6", "name": "network-vif-deleted", "tag": "58c975ff-15b0-4244-9b51-c1f72d71088c"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:00:37.786007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-27e11081-c7b2-4220-afa8-14755a2ba246 req-d0cead33-9afc-446c-8497-e512ce872743 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:37.786471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-27e11081-c7b2-4220-afa8-14755a2ba246 req-d0cead33-9afc-446c-8497-e512ce872743 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:37.787047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-27e11081-c7b2-4220-afa8-14755a2ba246 req-d0cead33-9afc-446c-8497-e512ce872743 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:37.800760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-27e11081-c7b2-4220-afa8-14755a2ba246 req-d0cead33-9afc-446c-8497-e512ce872743 service nova] Creating event network-vif-deleted:58c975ff-15b0-4244-9b51-c1f72d71088c for instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 on hv-cinder-85506 Aug 31 01:00:37.805912 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-27e11081-c7b2-4220-afa8-14755a2ba246 req-d0cead33-9afc-446c-8497-e512ce872743 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034982 Aug 31 01:00:37.806339 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1619/3182] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:00:38.177809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:38.178449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:38.185095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:38.185579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:38.186013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:38.186704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:38.187183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:38.187605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:38.221669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:38.222144 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:38.222643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:38.223018 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lazy-loading 'fault' on Instance uuid 84565566-bd8b-456c-8e83-ffcf92c75eb6 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:00:38.264106 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:38.272123 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:38.273574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d7582f9cdd646f39404f7adc99ad9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5694aa9e83804fe19311f97ed6af1152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:00:38.274729 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cc08205d-ec2e-4bfd-aad9-32f46fb5f20f tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 200 len: 1372 microversion: 2.20 time: 0.100887 Aug 31 01:00:38.275332 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1564/3183] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 01:00:38 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 01:00:39.299217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:39.299926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:39.306223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:39.306696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:39.307360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:39.308011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:39.308460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:39.308878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:39.323509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 HTTP/1.1 Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:00:39.325122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:39.326631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': '84565566-bd8b-456c-8e83-ffcf92c75eb6'} Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:00:39.327484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:39.328957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:39.330247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 404 to user: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:00:39.330247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7cd24677-0165-41d5-b4b4-685bbebdeeca tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 404 len: 111 microversion: 2.20 time: 0.032117 Aug 31 01:00:39.330247 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1620/3184] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 01:00:39 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:00:39.335368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b4235472-d4dc-45e5-bd67-036db0fd9719 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '.version_select at 0x7fa7ef95b3a0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:39.354890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b4235472-d4dc-45e5-bd67-036db0fd9719 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945340034" status: 204 len: 0 microversion: 2.20 time: 0.023195 Aug 31 01:00:39.355527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1565/3185] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 31 01:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945340034 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 01:00:41.118343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:41.118840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:41.125468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:41.125947 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:41.126382 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:41.127082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:41.127538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:41.128325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:41.141585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 HTTP/1.1 Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:00:41.143150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:41.144414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': '84565566-bd8b-456c-8e83-ffcf92c75eb6'} Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:00:41.145043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:41.146387 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:41.147774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 404 to user: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:00:41.147774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-be963791-8f9b-4641-a102-318ba9f8d527 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 404 len: 111 microversion: 2.20 time: 0.030115 Aug 31 01:00:41.147774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1621/3186] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 31 01:00:41 2022] DELETE /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:00:41.154142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:41.154695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 84565566-bd8b-456c-8e83-ffcf92c75eb6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:41.161213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:41.161692 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:41.162127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:41.162806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:41.163289 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:41.163713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:41.177818 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 HTTP/1.1 Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:00:41.179526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:41.180844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '84565566-bd8b-456c-8e83-ffcf92c75eb6'} Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:00:41.181524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. Aug 31 01:00:41.182672 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:00:41.183595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 404 to user: Instance 84565566-bd8b-456c-8e83-ffcf92c75eb6 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:00:41.183595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ff8b7059-3bfc-4bcf-9b34-be2fad58b282 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6" status: 404 len: 111 microversion: 2.20 time: 0.031753 Aug 31 01:00:41.183595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1566/3187] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 01:00:41 2022] GET /compute/v2.1/servers/84565566-bd8b-456c-8e83-ffcf92c75eb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:00:42.318084 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:42.318571 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:42.325817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:42.326293 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:42.326723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:42.327443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:42.327893 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:42.328312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:42.344551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 HTTP/1.1 Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:00:42.346491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. Aug 31 01:00:42.347722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': '02e4497e-f74f-4b4e-aac6-88c39ead5f38'} Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:00:42.348333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. Aug 31 01:00:42.349516 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:00:42.350718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 404 to user: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:00:42.350718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9e7cf7b1-d80a-4619-8439-69dbee0d4f7b tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 404 len: 111 microversion: 2.20 time: 0.033838 Aug 31 01:00:42.350718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1622/3188] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 31 01:00:42 2022] DELETE /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:00:42.356752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:42.357356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] [instance: 02e4497e-f74f-4b4e-aac6-88c39ead5f38] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:42.364089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:42.364570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:42.364999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:42.365690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:42.366133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:42.366546 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:42.381844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] HTTP exception thrown: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Request method failure captured: Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 HTTP/1.1 Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDqlf8Igh9sTPbZyrv68REKnWRCIqOiN6BPx3KtEydKcNOQJcOmXRQtBj49Aho1NhCuusgXlEoHiXZ0Na7jk-3YOW4KLNU-FvmNnk6e4ETJqBDg0Njc_Bw2fGa24KCBn_dkOEZzyqnMVDh4HD9P2SljcSBbGcu9lksNQAQK9HIUJzuec Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:00:42.383408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5694aa9e83804fe19311f97ed6af1152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5694aa9e83804fe19311f97ed6af1152", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 5694aa9e83804fe19311f97ed6af1152 Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2078805635 Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 7d7582f9cdd646f39404f7adc99ad9ac Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2078805635-project Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. Aug 31 01:00:42.384999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '02e4497e-f74f-4b4e-aac6-88c39ead5f38'} Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:00:42.386403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. Aug 31 01:00:42.387762 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:00:42.388860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] Returning 404 to user: Instance 02e4497e-f74f-4b4e-aac6-88c39ead5f38 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:00:42.388860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1452be80-67f9-4b3f-8489-941ac6c3dce5 tempest-AttachVolumeShelveTestJSON-2078805635 tempest-AttachVolumeShelveTestJSON-2078805635-project] 10.222.0.67 "GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38" status: 404 len: 111 microversion: 2.20 time: 0.032215 Aug 31 01:00:42.389512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1567/3189] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 31 01:00:42 2022] GET /compute/v2.1/servers/02e4497e-f74f-4b4e-aac6-88c39ead5f38 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:00:50.362957 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8472c73c-415b-4ba0-9b23-c72e83f304bf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:00:50.363598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8472c73c-415b-4ba0-9b23-c72e83f304bf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:50.370810 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8472c73c-415b-4ba0-9b23-c72e83f304bf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:50.371325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8472c73c-415b-4ba0-9b23-c72e83f304bf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:50.371761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8472c73c-415b-4ba0-9b23-c72e83f304bf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:50.372448 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8472c73c-415b-4ba0-9b23-c72e83f304bf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:50.372895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8472c73c-415b-4ba0-9b23-c72e83f304bf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:50.373316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8472c73c-415b-4ba0-9b23-c72e83f304bf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:50.397929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8472c73c-415b-4ba0-9b23-c72e83f304bf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/ips" status: 200 len: 149 microversion: 2.1 time: 0.038900 Aug 31 01:00:50.398505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1623/3190] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 31 01:00:50 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:00:54.930935 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c65113da-afde-42c1-999b-242ed7a3565b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85c33bb8-727f-41d9-954c-dc72746a5083"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:00:54.933950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c65113da-afde-42c1-999b-242ed7a3565b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:00:54.936400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:54.937053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=30 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:00:54.943830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c65113da-afde-42c1-999b-242ed7a3565b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:54.944321 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c65113da-afde-42c1-999b-242ed7a3565b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:54.944759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c65113da-afde-42c1-999b-242ed7a3565b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:54.945493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c65113da-afde-42c1-999b-242ed7a3565b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:00:54.945946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c65113da-afde-42c1-999b-242ed7a3565b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:00:54.946399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c65113da-afde-42c1-999b-242ed7a3565b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:00:55.204116 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c65113da-afde-42c1-999b-242ed7a3565b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276935 Aug 31 01:00:55.204921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1568/3191] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 01:00:54 2022] POST /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:01:02.772749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a2ca8951-5b0d-49e6-be2c-3c2240fa81cd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: .version_select at 0x7fa7efd6f9d0>, body: {"keypair": {"name": "tempest-keypair-368643855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuCBwLnDJQBEeRxVemhUjLrC5f3MHEjrHhFjV6RmJPHBK8DQNVi2RIY3cdD3xVWquUn4YHZLlx5YXN1HKr758spkE/1swp1ynyJoEtWuQfSuLKGcmQgVxGVd3SKVvgCmA=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:01:02.778704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:02.779361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:02.793785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-a2ca8951-5b0d-49e6-be2c-3c2240fa81cd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for project 6b67e536fd414591b859c1a89808e1a6. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:01:02.797562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-a2ca8951-5b0d-49e6-be2c-3c2240fa81cd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for user 26826ddf92124c95835a5356e13040bf and project 6b67e536fd414591b859c1a89808e1a6. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:01:02.825481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a2ca8951-5b0d-49e6-be2c-3c2240fa81cd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056677 Aug 31 01:01:02.826142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1624/3192] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 31 01:01:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:01:04.215236 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-682787944", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84755e79-134e-460d-be79-1943a8a099f4"}], "security_groups": [{"name": "tempest-securitygroup--1933974451"}], "key_name": "tempest-keypair-368643855", "user_data": "}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:01:04.319514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] validate_networks() for [('84755e79-134e-460d-be79-1943a8a099f4', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:01:04.700165 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:01:04.700581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:01:04.701045 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:01:04.701496 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:01:04.701901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:01:04.710593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:04.711083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:04.711505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:04.712207 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:04.712645 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:04.713058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:04.730373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for project 6b67e536fd414591b859c1a89808e1a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:01:04.734245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for user 26826ddf92124c95835a5356e13040bf and project 6b67e536fd414591b859c1a89808e1a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:01:04.746259 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:01:04.749205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:01:04.797598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR oslo.messaging._drivers.impl_rabbit [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [e93ad18d-79d7-40d1-806b-ef8c58924b6a] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 01:01:05.805470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [e93ad18d-79d7-40d1-806b-ef8c58924b6a] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 43002. Aug 31 01:01:05.810515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-10d7175d-678d-4a95-879c-3db23ac99ee2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.600463 Aug 31 01:01:05.811219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1569/3193] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 01:01:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:01:05.822082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67d19ad3-cd26-49a3-b162-47852019ae4b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:05.822685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-67d19ad3-cd26-49a3-b162-47852019ae4b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:05.878079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67d19ad3-cd26-49a3-b162-47852019ae4b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:05.886597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67d19ad3-cd26-49a3-b162-47852019ae4b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1240 microversion: 2.1 time: 0.067740 Aug 31 01:01:05.887182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1625/3194] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:05 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:06.907714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-783e7c0d-e3fb-44ec-8c9f-7091a608878d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:06.908461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-783e7c0d-e3fb-44ec-8c9f-7091a608878d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:06.915618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-783e7c0d-e3fb-44ec-8c9f-7091a608878d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:06.916101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-783e7c0d-e3fb-44ec-8c9f-7091a608878d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:06.916530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-783e7c0d-e3fb-44ec-8c9f-7091a608878d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:06.917791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-783e7c0d-e3fb-44ec-8c9f-7091a608878d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:06.918246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-783e7c0d-e3fb-44ec-8c9f-7091a608878d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:06.918766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-783e7c0d-e3fb-44ec-8c9f-7091a608878d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:06.986393 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-783e7c0d-e3fb-44ec-8c9f-7091a608878d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:06.996377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-783e7c0d-e3fb-44ec-8c9f-7091a608878d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1292 microversion: 2.1 time: 0.092492 Aug 31 01:01:06.997493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1570/3195] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:06 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:08.018209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d56505f1-1846-41db-b9bc-a0eeb4808e0e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:08.019187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d56505f1-1846-41db-b9bc-a0eeb4808e0e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:08.025616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d56505f1-1846-41db-b9bc-a0eeb4808e0e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:08.026091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d56505f1-1846-41db-b9bc-a0eeb4808e0e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:08.026559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d56505f1-1846-41db-b9bc-a0eeb4808e0e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:08.027509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d56505f1-1846-41db-b9bc-a0eeb4808e0e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:08.027964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d56505f1-1846-41db-b9bc-a0eeb4808e0e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:08.028397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d56505f1-1846-41db-b9bc-a0eeb4808e0e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:08.185182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d56505f1-1846-41db-b9bc-a0eeb4808e0e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:08.192932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d56505f1-1846-41db-b9bc-a0eeb4808e0e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1366 microversion: 2.1 time: 0.178547 Aug 31 01:01:08.193528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1626/3196] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:08 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:01:08.525653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-bd5860e6-7ac0-4ca8-aea8-2722b0ea2a46 req-bd00ff8f-f4d6-4c8b-a8ef-4c012974d260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b2858e-c473-44bb-a7f4-5e520c11b66c", "tag": "6ed00551-04dd-4a7c-b069-b1c9e654fbf2"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:01:08.535618 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-bd5860e6-7ac0-4ca8-aea8-2722b0ea2a46 req-bd00ff8f-f4d6-4c8b-a8ef-4c012974d260 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:08.536092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-bd5860e6-7ac0-4ca8-aea8-2722b0ea2a46 req-bd00ff8f-f4d6-4c8b-a8ef-4c012974d260 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:08.536519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-bd5860e6-7ac0-4ca8-aea8-2722b0ea2a46 req-bd00ff8f-f4d6-4c8b-a8ef-4c012974d260 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:08.558967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-bd5860e6-7ac0-4ca8-aea8-2722b0ea2a46 req-bd00ff8f-f4d6-4c8b-a8ef-4c012974d260 service nova] Creating event network-changed:6ed00551-04dd-4a7c-b069-b1c9e654fbf2 for instance 12b2858e-c473-44bb-a7f4-5e520c11b66c on hv-cinder-85506 Aug 31 01:01:08.564383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-bd5860e6-7ac0-4ca8-aea8-2722b0ea2a46 req-bd00ff8f-f4d6-4c8b-a8ef-4c012974d260 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042435 Aug 31 01:01:08.565265 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1571/3197] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:01:09.215564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0264971f-9c1e-4ad2-8212-b20158213234 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:09.216294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0264971f-9c1e-4ad2-8212-b20158213234 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:09.223659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0264971f-9c1e-4ad2-8212-b20158213234 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:09.224153 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0264971f-9c1e-4ad2-8212-b20158213234 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:09.224575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0264971f-9c1e-4ad2-8212-b20158213234 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:09.225425 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0264971f-9c1e-4ad2-8212-b20158213234 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:09.225881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0264971f-9c1e-4ad2-8212-b20158213234 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:09.226296 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0264971f-9c1e-4ad2-8212-b20158213234 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:09.359429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0264971f-9c1e-4ad2-8212-b20158213234 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:09.367215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0264971f-9c1e-4ad2-8212-b20158213234 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1366 microversion: 2.1 time: 0.155959 Aug 31 01:01:09.367777 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1627/3198] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:09 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:10.390249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-472a3a26-f4ca-4f9e-94f3-ff39db978739 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:10.390937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-472a3a26-f4ca-4f9e-94f3-ff39db978739 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:10.397057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-472a3a26-f4ca-4f9e-94f3-ff39db978739 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:10.397586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-472a3a26-f4ca-4f9e-94f3-ff39db978739 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:10.398011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-472a3a26-f4ca-4f9e-94f3-ff39db978739 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:10.398680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-472a3a26-f4ca-4f9e-94f3-ff39db978739 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:10.399141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-472a3a26-f4ca-4f9e-94f3-ff39db978739 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:10.399557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-472a3a26-f4ca-4f9e-94f3-ff39db978739 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:10.536972 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-472a3a26-f4ca-4f9e-94f3-ff39db978739 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:10.545411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-472a3a26-f4ca-4f9e-94f3-ff39db978739 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1366 microversion: 2.1 time: 0.160518 Aug 31 01:01:10.545973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1572/3199] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:10 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:11.566724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2d95722f-488d-4150-9111-c9892c2bb94f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:11.567365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2d95722f-488d-4150-9111-c9892c2bb94f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:11.573875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d95722f-488d-4150-9111-c9892c2bb94f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:11.574511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d95722f-488d-4150-9111-c9892c2bb94f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:11.575013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d95722f-488d-4150-9111-c9892c2bb94f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:11.575748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d95722f-488d-4150-9111-c9892c2bb94f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:11.576196 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d95722f-488d-4150-9111-c9892c2bb94f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:11.576618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d95722f-488d-4150-9111-c9892c2bb94f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:11.716365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2d95722f-488d-4150-9111-c9892c2bb94f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:11.724104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2d95722f-488d-4150-9111-c9892c2bb94f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1366 microversion: 2.1 time: 0.161212 Aug 31 01:01:11.724662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1628/3200] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:11 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:12.745713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0a5224dd-e68f-4c33-baac-2eff9929418a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:12.746440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0a5224dd-e68f-4c33-baac-2eff9929418a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:12.752830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a5224dd-e68f-4c33-baac-2eff9929418a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:12.753300 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a5224dd-e68f-4c33-baac-2eff9929418a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:12.753725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a5224dd-e68f-4c33-baac-2eff9929418a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:12.754399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a5224dd-e68f-4c33-baac-2eff9929418a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:12.754840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a5224dd-e68f-4c33-baac-2eff9929418a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:12.755279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a5224dd-e68f-4c33-baac-2eff9929418a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:12.886505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0a5224dd-e68f-4c33-baac-2eff9929418a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:12.894628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0a5224dd-e68f-4c33-baac-2eff9929418a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1366 microversion: 2.1 time: 0.152751 Aug 31 01:01:12.895542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1573/3201] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:12 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:13.923403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f2815b82-9dc7-4c3c-a2aa-3b4d8a933a40 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:13.924007 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f2815b82-9dc7-4c3c-a2aa-3b4d8a933a40 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:13.930558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2815b82-9dc7-4c3c-a2aa-3b4d8a933a40 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:13.931065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2815b82-9dc7-4c3c-a2aa-3b4d8a933a40 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:13.931493 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2815b82-9dc7-4c3c-a2aa-3b4d8a933a40 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:13.932169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2815b82-9dc7-4c3c-a2aa-3b4d8a933a40 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:13.932601 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2815b82-9dc7-4c3c-a2aa-3b4d8a933a40 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:13.933013 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2815b82-9dc7-4c3c-a2aa-3b4d8a933a40 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:14.068681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f2815b82-9dc7-4c3c-a2aa-3b4d8a933a40 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:14.076914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f2815b82-9dc7-4c3c-a2aa-3b4d8a933a40 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1366 microversion: 2.1 time: 0.157354 Aug 31 01:01:14.077477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1629/3202] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:13 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:15.097921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7d4b4213-da00-49ee-a0ea-c1487ac157bd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:15.098518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7d4b4213-da00-49ee-a0ea-c1487ac157bd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:15.100956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:15.101614 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:15.107430 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d4b4213-da00-49ee-a0ea-c1487ac157bd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:15.107909 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d4b4213-da00-49ee-a0ea-c1487ac157bd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:15.108334 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d4b4213-da00-49ee-a0ea-c1487ac157bd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:15.109006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d4b4213-da00-49ee-a0ea-c1487ac157bd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:15.109450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d4b4213-da00-49ee-a0ea-c1487ac157bd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:15.109893 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d4b4213-da00-49ee-a0ea-c1487ac157bd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:15.242303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7d4b4213-da00-49ee-a0ea-c1487ac157bd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:15.250270 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7d4b4213-da00-49ee-a0ea-c1487ac157bd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1366 microversion: 2.1 time: 0.156379 Aug 31 01:01:15.250770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1574/3203] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:15 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:15.294613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-c7babae1-df76-4de1-bde2-a974a1c38fdc req-618355b1-a99b-49f9-a5b3-99ec70c1968e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b2858e-c473-44bb-a7f4-5e520c11b66c", "name": "network-vif-plugged", "status": "completed", "tag": "6ed00551-04dd-4a7c-b069-b1c9e654fbf2"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:01:15.304850 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-c7babae1-df76-4de1-bde2-a974a1c38fdc req-618355b1-a99b-49f9-a5b3-99ec70c1968e service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:15.305353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-c7babae1-df76-4de1-bde2-a974a1c38fdc req-618355b1-a99b-49f9-a5b3-99ec70c1968e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:15.305782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-c7babae1-df76-4de1-bde2-a974a1c38fdc req-618355b1-a99b-49f9-a5b3-99ec70c1968e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:15.317745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-c7babae1-df76-4de1-bde2-a974a1c38fdc req-618355b1-a99b-49f9-a5b3-99ec70c1968e service nova] Creating event network-vif-plugged:6ed00551-04dd-4a7c-b069-b1c9e654fbf2 for instance 12b2858e-c473-44bb-a7f4-5e520c11b66c on hv-cinder-85506 Aug 31 01:01:15.322669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-c7babae1-df76-4de1-bde2-a974a1c38fdc req-618355b1-a99b-49f9-a5b3-99ec70c1968e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031992 Aug 31 01:01:15.323358 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1630/3204] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:01:16.272711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6559dd69-8eb7-4da3-90e9-128655d302c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:16.273317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6559dd69-8eb7-4da3-90e9-128655d302c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:16.280542 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6559dd69-8eb7-4da3-90e9-128655d302c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:16.281024 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6559dd69-8eb7-4da3-90e9-128655d302c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:16.281457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6559dd69-8eb7-4da3-90e9-128655d302c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:16.282133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6559dd69-8eb7-4da3-90e9-128655d302c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:16.282584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6559dd69-8eb7-4da3-90e9-128655d302c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:16.283004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6559dd69-8eb7-4da3-90e9-128655d302c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:16.430724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6559dd69-8eb7-4da3-90e9-128655d302c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:16.438431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6559dd69-8eb7-4da3-90e9-128655d302c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1366 microversion: 2.1 time: 0.169570 Aug 31 01:01:16.438987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1575/3205] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:16 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:17.457506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=6 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:01:17.462294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-13a3f39d-4acf-44f4-b720-9bce547e38b3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:17.462984 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-13a3f39d-4acf-44f4-b720-9bce547e38b3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:17.469763 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13a3f39d-4acf-44f4-b720-9bce547e38b3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:17.470241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13a3f39d-4acf-44f4-b720-9bce547e38b3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:17.470669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13a3f39d-4acf-44f4-b720-9bce547e38b3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:17.471371 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13a3f39d-4acf-44f4-b720-9bce547e38b3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:17.471818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13a3f39d-4acf-44f4-b720-9bce547e38b3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:17.472235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13a3f39d-4acf-44f4-b720-9bce547e38b3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:17.600303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13a3f39d-4acf-44f4-b720-9bce547e38b3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:17.608951 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-13a3f39d-4acf-44f4-b720-9bce547e38b3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1366 microversion: 2.1 time: 0.152345 Aug 31 01:01:17.609553 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1631/3206] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:17 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:18.629677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-96cfff90-96ca-4b29-a1c4-62859ab3e3d7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:18.630292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-96cfff90-96ca-4b29-a1c4-62859ab3e3d7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:18.636723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96cfff90-96ca-4b29-a1c4-62859ab3e3d7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:18.637195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96cfff90-96ca-4b29-a1c4-62859ab3e3d7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:18.637623 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96cfff90-96ca-4b29-a1c4-62859ab3e3d7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:18.638302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96cfff90-96ca-4b29-a1c4-62859ab3e3d7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:18.638739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96cfff90-96ca-4b29-a1c4-62859ab3e3d7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:18.639182 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96cfff90-96ca-4b29-a1c4-62859ab3e3d7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:18.768617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-96cfff90-96ca-4b29-a1c4-62859ab3e3d7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:01:18.776568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-96cfff90-96ca-4b29-a1c4-62859ab3e3d7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1556 microversion: 2.1 time: 0.150673 Aug 31 01:01:18.778138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1576/3207] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:01:18 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:01:18.799403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-53987ed6-7e03-416b-8a35-304d36d30c52 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:01:18.799937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-53987ed6-7e03-416b-8a35-304d36d30c52 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:01:18.807682 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53987ed6-7e03-416b-8a35-304d36d30c52 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:18.808158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53987ed6-7e03-416b-8a35-304d36d30c52 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:18.808748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53987ed6-7e03-416b-8a35-304d36d30c52 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:18.809472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53987ed6-7e03-416b-8a35-304d36d30c52 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:18.809911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53987ed6-7e03-416b-8a35-304d36d30c52 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:18.810333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53987ed6-7e03-416b-8a35-304d36d30c52 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:18.893661 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-53987ed6-7e03-416b-8a35-304d36d30c52 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097856 Aug 31 01:01:18.894611 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1632/3208] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 31 01:01:18 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:01:20.079307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-8519a94a-769c-4e57-97df-ee9c000d62cb req-63e2514e-8a1c-45d4-aea8-3f6640af165e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b2858e-c473-44bb-a7f4-5e520c11b66c", "tag": "6ed00551-04dd-4a7c-b069-b1c9e654fbf2"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:01:20.089655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8519a94a-769c-4e57-97df-ee9c000d62cb req-63e2514e-8a1c-45d4-aea8-3f6640af165e service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:01:20.090138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8519a94a-769c-4e57-97df-ee9c000d62cb req-63e2514e-8a1c-45d4-aea8-3f6640af165e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:01:20.090567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8519a94a-769c-4e57-97df-ee9c000d62cb req-63e2514e-8a1c-45d4-aea8-3f6640af165e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:01:20.101835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-8519a94a-769c-4e57-97df-ee9c000d62cb req-63e2514e-8a1c-45d4-aea8-3f6640af165e service nova] Creating event network-changed:6ed00551-04dd-4a7c-b069-b1c9e654fbf2 for instance 12b2858e-c473-44bb-a7f4-5e520c11b66c on hv-cinder-85506 Aug 31 01:01:20.107071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-8519a94a-769c-4e57-97df-ee9c000d62cb req-63e2514e-8a1c-45d4-aea8-3f6640af165e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031403 Aug 31 01:01:20.107662 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1577/3209] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:02:18.205079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-95165e41-b918-4852-a954-282cf1b6ff75 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:02:18.205665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-95165e41-b918-4852-a954-282cf1b6ff75 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:18.208281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:18.208914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=36 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:18.215055 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95165e41-b918-4852-a954-282cf1b6ff75 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:18.215528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95165e41-b918-4852-a954-282cf1b6ff75 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:18.215954 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95165e41-b918-4852-a954-282cf1b6ff75 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:18.216629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95165e41-b918-4852-a954-282cf1b6ff75 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:18.217071 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95165e41-b918-4852-a954-282cf1b6ff75 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:18.217486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95165e41-b918-4852-a954-282cf1b6ff75 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:18.242090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-95165e41-b918-4852-a954-282cf1b6ff75 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lazy-loading 'flavor' on Instance uuid e4dd3781-9c72-4d8d-9cd8-114d0aead4db {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:02:18.322207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-95165e41-b918-4852-a954-282cf1b6ff75 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "POST /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db/action" status: 202 len: 0 microversion: 2.1 time: 0.121084 Aug 31 01:02:18.325989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1633/3210] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 01:02:18 2022] POST /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:02:18.330656 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:18.331426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:18.337309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8bc505f9-28af-4c20-a113-b67232de11a6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:18.338014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8bc505f9-28af-4c20-a113-b67232de11a6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:18.348601 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bc505f9-28af-4c20-a113-b67232de11a6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:18.349344 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bc505f9-28af-4c20-a113-b67232de11a6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:18.349781 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bc505f9-28af-4c20-a113-b67232de11a6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:18.350472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bc505f9-28af-4c20-a113-b67232de11a6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:18.350914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bc505f9-28af-4c20-a113-b67232de11a6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:18.351359 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8bc505f9-28af-4c20-a113-b67232de11a6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:18.492032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8bc505f9-28af-4c20-a113-b67232de11a6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:18.500361 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8bc505f9-28af-4c20-a113-b67232de11a6 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.172854 Aug 31 01:02:18.500915 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1578/3211] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:18 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:19.522361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-560aec32-85a8-4017-af3c-01d28d7528de tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:19.523076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-560aec32-85a8-4017-af3c-01d28d7528de tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:19.529509 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560aec32-85a8-4017-af3c-01d28d7528de tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:19.530016 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560aec32-85a8-4017-af3c-01d28d7528de tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:19.530458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560aec32-85a8-4017-af3c-01d28d7528de tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:19.531220 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560aec32-85a8-4017-af3c-01d28d7528de tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:19.531698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560aec32-85a8-4017-af3c-01d28d7528de tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:19.532156 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-560aec32-85a8-4017-af3c-01d28d7528de tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:19.678452 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-560aec32-85a8-4017-af3c-01d28d7528de tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:19.686652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-560aec32-85a8-4017-af3c-01d28d7528de tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.169046 Aug 31 01:02:19.687236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1634/3212] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:19 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:20.707418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b84d75c6-762b-4952-bd69-10093f0b78a7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:20.708049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b84d75c6-762b-4952-bd69-10093f0b78a7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:20.714375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b84d75c6-762b-4952-bd69-10093f0b78a7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:20.714854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b84d75c6-762b-4952-bd69-10093f0b78a7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:20.715312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b84d75c6-762b-4952-bd69-10093f0b78a7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:20.715993 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b84d75c6-762b-4952-bd69-10093f0b78a7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:20.716448 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b84d75c6-762b-4952-bd69-10093f0b78a7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:20.716872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b84d75c6-762b-4952-bd69-10093f0b78a7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:20.862302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b84d75c6-762b-4952-bd69-10093f0b78a7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:20.870017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b84d75c6-762b-4952-bd69-10093f0b78a7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.166449 Aug 31 01:02:20.870593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1579/3213] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:20 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:21.891910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-32dce664-21ea-421d-bc22-baacfeb6e645 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:21.892512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-32dce664-21ea-421d-bc22-baacfeb6e645 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:21.899211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32dce664-21ea-421d-bc22-baacfeb6e645 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:21.899697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32dce664-21ea-421d-bc22-baacfeb6e645 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:21.900158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32dce664-21ea-421d-bc22-baacfeb6e645 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:21.900878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32dce664-21ea-421d-bc22-baacfeb6e645 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:21.901325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32dce664-21ea-421d-bc22-baacfeb6e645 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:21.901771 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-32dce664-21ea-421d-bc22-baacfeb6e645 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:22.035674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-32dce664-21ea-421d-bc22-baacfeb6e645 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:22.043407 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-32dce664-21ea-421d-bc22-baacfeb6e645 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.155643 Aug 31 01:02:22.043967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1635/3214] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:21 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:23.066025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-aaf86851-f783-47f7-9ca7-c8ef8239a3f8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:23.066557 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-aaf86851-f783-47f7-9ca7-c8ef8239a3f8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:23.072986 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aaf86851-f783-47f7-9ca7-c8ef8239a3f8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:23.073464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aaf86851-f783-47f7-9ca7-c8ef8239a3f8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:23.073895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aaf86851-f783-47f7-9ca7-c8ef8239a3f8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:23.074629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aaf86851-f783-47f7-9ca7-c8ef8239a3f8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:23.075025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aaf86851-f783-47f7-9ca7-c8ef8239a3f8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:23.075475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aaf86851-f783-47f7-9ca7-c8ef8239a3f8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:23.212555 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-aaf86851-f783-47f7-9ca7-c8ef8239a3f8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:23.221071 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-aaf86851-f783-47f7-9ca7-c8ef8239a3f8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.159200 Aug 31 01:02:23.221627 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1580/3215] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:23 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:24.243103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0c0169d0-73a1-494d-9e52-3095625593bc tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:24.243709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0c0169d0-73a1-494d-9e52-3095625593bc tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:24.250625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c0169d0-73a1-494d-9e52-3095625593bc tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:24.251144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c0169d0-73a1-494d-9e52-3095625593bc tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:24.251575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c0169d0-73a1-494d-9e52-3095625593bc tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:24.252256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c0169d0-73a1-494d-9e52-3095625593bc tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:24.252709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c0169d0-73a1-494d-9e52-3095625593bc tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:24.253128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c0169d0-73a1-494d-9e52-3095625593bc tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:24.384348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0c0169d0-73a1-494d-9e52-3095625593bc tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:24.393060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0c0169d0-73a1-494d-9e52-3095625593bc tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.153829 Aug 31 01:02:24.393622 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1636/3216] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:24 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:25.414208 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-abaf83c7-af7a-4fff-9b69-b2d66478c979 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:25.414813 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-abaf83c7-af7a-4fff-9b69-b2d66478c979 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:25.421859 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abaf83c7-af7a-4fff-9b69-b2d66478c979 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:25.422331 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abaf83c7-af7a-4fff-9b69-b2d66478c979 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:25.422760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abaf83c7-af7a-4fff-9b69-b2d66478c979 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:25.423457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abaf83c7-af7a-4fff-9b69-b2d66478c979 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:25.423904 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abaf83c7-af7a-4fff-9b69-b2d66478c979 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:25.424324 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-abaf83c7-af7a-4fff-9b69-b2d66478c979 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:25.557577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-abaf83c7-af7a-4fff-9b69-b2d66478c979 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:25.565424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-abaf83c7-af7a-4fff-9b69-b2d66478c979 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.155123 Aug 31 01:02:25.565985 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1581/3217] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:25 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:26.586527 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-10d87f55-8a1d-489e-acd0-c36cf1410736 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:26.587165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-10d87f55-8a1d-489e-acd0-c36cf1410736 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:26.593642 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10d87f55-8a1d-489e-acd0-c36cf1410736 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:26.594385 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10d87f55-8a1d-489e-acd0-c36cf1410736 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:26.594817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10d87f55-8a1d-489e-acd0-c36cf1410736 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:26.595532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10d87f55-8a1d-489e-acd0-c36cf1410736 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:26.595985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10d87f55-8a1d-489e-acd0-c36cf1410736 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:26.596399 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10d87f55-8a1d-489e-acd0-c36cf1410736 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:26.882405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-10d87f55-8a1d-489e-acd0-c36cf1410736 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:26.894443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-10d87f55-8a1d-489e-acd0-c36cf1410736 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.311722 Aug 31 01:02:26.895026 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1637/3218] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:26 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:27.916746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f0c95003-a0dd-4f5d-97b8-619dd7165d9c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:27.917272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f0c95003-a0dd-4f5d-97b8-619dd7165d9c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:27.924777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c95003-a0dd-4f5d-97b8-619dd7165d9c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:27.925260 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c95003-a0dd-4f5d-97b8-619dd7165d9c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:27.925693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c95003-a0dd-4f5d-97b8-619dd7165d9c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:27.926399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c95003-a0dd-4f5d-97b8-619dd7165d9c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:27.926838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c95003-a0dd-4f5d-97b8-619dd7165d9c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:27.927292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f0c95003-a0dd-4f5d-97b8-619dd7165d9c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:28.056288 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f0c95003-a0dd-4f5d-97b8-619dd7165d9c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:28.064389 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f0c95003-a0dd-4f5d-97b8-619dd7165d9c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.151558 Aug 31 01:02:28.064942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1582/3219] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:27 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:02:29.086042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bce2d9a0-d751-4cc2-8ec1-9da22531aef1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:29.086652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bce2d9a0-d751-4cc2-8ec1-9da22531aef1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:29.093816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce2d9a0-d751-4cc2-8ec1-9da22531aef1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:29.094564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce2d9a0-d751-4cc2-8ec1-9da22531aef1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:29.094997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce2d9a0-d751-4cc2-8ec1-9da22531aef1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:29.095711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce2d9a0-d751-4cc2-8ec1-9da22531aef1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:29.096165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce2d9a0-d751-4cc2-8ec1-9da22531aef1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:29.096585 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bce2d9a0-d751-4cc2-8ec1-9da22531aef1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:29.231926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bce2d9a0-d751-4cc2-8ec1-9da22531aef1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:29.239843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bce2d9a0-d751-4cc2-8ec1-9da22531aef1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.157752 Aug 31 01:02:29.240577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1638/3220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:29 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:30.261462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-179c67f1-ae6f-4b89-96ea-1e54e6f43ed7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:30.261995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-179c67f1-ae6f-4b89-96ea-1e54e6f43ed7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:30.269009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-179c67f1-ae6f-4b89-96ea-1e54e6f43ed7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:30.269486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-179c67f1-ae6f-4b89-96ea-1e54e6f43ed7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:30.269918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-179c67f1-ae6f-4b89-96ea-1e54e6f43ed7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:30.270603 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-179c67f1-ae6f-4b89-96ea-1e54e6f43ed7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:30.271052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-179c67f1-ae6f-4b89-96ea-1e54e6f43ed7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:30.271492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-179c67f1-ae6f-4b89-96ea-1e54e6f43ed7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:30.405900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-179c67f1-ae6f-4b89-96ea-1e54e6f43ed7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:30.413524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-179c67f1-ae6f-4b89-96ea-1e54e6f43ed7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.156053 Aug 31 01:02:30.414078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1583/3221] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:30 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:31.435662 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f8907e67-739d-4afa-960c-3a3834874f83 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:31.436261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f8907e67-739d-4afa-960c-3a3834874f83 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:31.442649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8907e67-739d-4afa-960c-3a3834874f83 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:31.443167 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8907e67-739d-4afa-960c-3a3834874f83 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:31.443604 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8907e67-739d-4afa-960c-3a3834874f83 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:31.444299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8907e67-739d-4afa-960c-3a3834874f83 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:31.444729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8907e67-739d-4afa-960c-3a3834874f83 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:31.445148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f8907e67-739d-4afa-960c-3a3834874f83 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:31.578467 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f8907e67-739d-4afa-960c-3a3834874f83 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:31.586389 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f8907e67-739d-4afa-960c-3a3834874f83 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.155100 Aug 31 01:02:31.586952 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1639/3222] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:31 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:32.608638 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-667b6ca1-89e6-4d3d-a2f6-9c847af3b249 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:32.609262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-667b6ca1-89e6-4d3d-a2f6-9c847af3b249 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:32.616084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-667b6ca1-89e6-4d3d-a2f6-9c847af3b249 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:32.616513 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-667b6ca1-89e6-4d3d-a2f6-9c847af3b249 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:32.616951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-667b6ca1-89e6-4d3d-a2f6-9c847af3b249 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:32.617699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-667b6ca1-89e6-4d3d-a2f6-9c847af3b249 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:32.618129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-667b6ca1-89e6-4d3d-a2f6-9c847af3b249 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:32.618549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-667b6ca1-89e6-4d3d-a2f6-9c847af3b249 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:32.764401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-667b6ca1-89e6-4d3d-a2f6-9c847af3b249 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:32.772461 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-667b6ca1-89e6-4d3d-a2f6-9c847af3b249 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1509 microversion: 2.1 time: 0.168190 Aug 31 01:02:32.773031 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1584/3223] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:32 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:32.795257 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f87f65d6-ff0c-4370-9264-32349faa7fc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:02:32.795864 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f87f65d6-ff0c-4370-9264-32349faa7fc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:32.802261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87f65d6-ff0c-4370-9264-32349faa7fc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:32.802748 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87f65d6-ff0c-4370-9264-32349faa7fc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:32.803253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87f65d6-ff0c-4370-9264-32349faa7fc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:32.803948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87f65d6-ff0c-4370-9264-32349faa7fc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:32.804409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87f65d6-ff0c-4370-9264-32349faa7fc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:32.804831 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87f65d6-ff0c-4370-9264-32349faa7fc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:32.897538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f87f65d6-ff0c-4370-9264-32349faa7fc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126975) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 01:02:32.963565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f87f65d6-ff0c-4370-9264-32349faa7fc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "POST /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db/action" status: 202 len: 0 microversion: 2.1 time: 0.173040 Aug 31 01:02:32.964471 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1640/3224] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 01:02:32 2022] POST /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:02:32.972956 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-eeae8d46-f3e7-481b-a856-829909156dab tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:32.973860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eeae8d46-f3e7-481b-a856-829909156dab tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:32.980590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeae8d46-f3e7-481b-a856-829909156dab tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:32.981147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeae8d46-f3e7-481b-a856-829909156dab tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:32.981654 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeae8d46-f3e7-481b-a856-829909156dab tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:32.982462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeae8d46-f3e7-481b-a856-829909156dab tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:32.982943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeae8d46-f3e7-481b-a856-829909156dab tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:32.983401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eeae8d46-f3e7-481b-a856-829909156dab tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:33.164222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-eeae8d46-f3e7-481b-a856-829909156dab tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:33.172912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-eeae8d46-f3e7-481b-a856-829909156dab tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1517 microversion: 2.1 time: 0.204181 Aug 31 01:02:33.173486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1585/3225] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:32 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:02:33.575438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-848b785d-f791-47c4-a311-a4f79369182a req-fbed6b15-6763-487e-86cd-6d0a29341845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dd3781-9c72-4d8d-9cd8-114d0aead4db", "name": "network-vif-unplugged", "status": "completed", "tag": "28bd9e08-7e14-43fc-9b70-0737bc3a18e9"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:02:33.588575 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-848b785d-f791-47c4-a311-a4f79369182a req-fbed6b15-6763-487e-86cd-6d0a29341845 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:33.589564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-848b785d-f791-47c4-a311-a4f79369182a req-fbed6b15-6763-487e-86cd-6d0a29341845 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:33.590938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-848b785d-f791-47c4-a311-a4f79369182a req-fbed6b15-6763-487e-86cd-6d0a29341845 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:33.619456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.compute.server_external_events [req-848b785d-f791-47c4-a311-a4f79369182a req-fbed6b15-6763-487e-86cd-6d0a29341845 service nova] Unable to find a host for instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db. Dropping event network-vif-unplugged {{(pid=126975) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 01:02:33.620468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-848b785d-f791-47c4-a311-a4f79369182a req-fbed6b15-6763-487e-86cd-6d0a29341845 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049819 Aug 31 01:02:33.621073 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1641/3226] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 31 01:02:34.194376 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-51e782f4-f494-4eb7-b647-41b171f9ef15 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:34.194932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-51e782f4-f494-4eb7-b647-41b171f9ef15 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:34.201209 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51e782f4-f494-4eb7-b647-41b171f9ef15 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:34.201655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51e782f4-f494-4eb7-b647-41b171f9ef15 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:34.202082 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51e782f4-f494-4eb7-b647-41b171f9ef15 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:34.202750 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51e782f4-f494-4eb7-b647-41b171f9ef15 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:34.203223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51e782f4-f494-4eb7-b647-41b171f9ef15 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:34.203634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-51e782f4-f494-4eb7-b647-41b171f9ef15 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:34.337516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-51e782f4-f494-4eb7-b647-41b171f9ef15 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:34.345569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-51e782f4-f494-4eb7-b647-41b171f9ef15 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1519 microversion: 2.1 time: 0.155138 Aug 31 01:02:34.346138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1586/3227] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:34 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:35.370492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a08954a1-9d47-49fc-b0c2-51b05452370b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:35.373356 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a08954a1-9d47-49fc-b0c2-51b05452370b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:35.382839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a08954a1-9d47-49fc-b0c2-51b05452370b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:35.383667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a08954a1-9d47-49fc-b0c2-51b05452370b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:35.385321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a08954a1-9d47-49fc-b0c2-51b05452370b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:35.385321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a08954a1-9d47-49fc-b0c2-51b05452370b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:35.385511 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a08954a1-9d47-49fc-b0c2-51b05452370b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:35.385839 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a08954a1-9d47-49fc-b0c2-51b05452370b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:35.552510 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a08954a1-9d47-49fc-b0c2-51b05452370b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:35.561470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a08954a1-9d47-49fc-b0c2-51b05452370b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.197425 Aug 31 01:02:35.562051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1642/3228] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:35 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:36.588782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-39c01dce-4537-42d0-9338-07e0a76bd4d5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:36.589375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-39c01dce-4537-42d0-9338-07e0a76bd4d5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:36.596785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39c01dce-4537-42d0-9338-07e0a76bd4d5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:36.597305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39c01dce-4537-42d0-9338-07e0a76bd4d5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:36.597734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39c01dce-4537-42d0-9338-07e0a76bd4d5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:36.598410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39c01dce-4537-42d0-9338-07e0a76bd4d5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:36.598855 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39c01dce-4537-42d0-9338-07e0a76bd4d5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:36.599296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-39c01dce-4537-42d0-9338-07e0a76bd4d5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:36.735567 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-39c01dce-4537-42d0-9338-07e0a76bd4d5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:36.743508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-39c01dce-4537-42d0-9338-07e0a76bd4d5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.158576 Aug 31 01:02:36.744067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1587/3229] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:36 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:37.766212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6261d648-f19c-42c2-abc4-999c65612735 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:37.766799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6261d648-f19c-42c2-abc4-999c65612735 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:37.772940 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6261d648-f19c-42c2-abc4-999c65612735 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:37.773413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6261d648-f19c-42c2-abc4-999c65612735 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:37.773834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6261d648-f19c-42c2-abc4-999c65612735 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:37.774505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6261d648-f19c-42c2-abc4-999c65612735 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:37.774945 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6261d648-f19c-42c2-abc4-999c65612735 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:37.775384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6261d648-f19c-42c2-abc4-999c65612735 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:37.908909 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6261d648-f19c-42c2-abc4-999c65612735 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:37.916816 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6261d648-f19c-42c2-abc4-999c65612735 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.155079 Aug 31 01:02:37.917374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1643/3230] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:37 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:38.938946 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1906f2aa-4750-41e4-8c1d-90db7ccbbdde tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:38.939482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1906f2aa-4750-41e4-8c1d-90db7ccbbdde tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:38.945545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1906f2aa-4750-41e4-8c1d-90db7ccbbdde tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:38.946051 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1906f2aa-4750-41e4-8c1d-90db7ccbbdde tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:38.946455 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1906f2aa-4750-41e4-8c1d-90db7ccbbdde tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:38.947150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1906f2aa-4750-41e4-8c1d-90db7ccbbdde tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:38.947598 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1906f2aa-4750-41e4-8c1d-90db7ccbbdde tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:38.948014 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1906f2aa-4750-41e4-8c1d-90db7ccbbdde tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:39.088398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1906f2aa-4750-41e4-8c1d-90db7ccbbdde tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:39.096878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1906f2aa-4750-41e4-8c1d-90db7ccbbdde tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.162457 Aug 31 01:02:39.097440 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1588/3231] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:38 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:40.118413 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d8d4f974-74f6-4082-8009-b5caa6497d4c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:40.119015 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d8d4f974-74f6-4082-8009-b5caa6497d4c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:40.125654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d4f974-74f6-4082-8009-b5caa6497d4c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:40.126125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d4f974-74f6-4082-8009-b5caa6497d4c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:40.126550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d4f974-74f6-4082-8009-b5caa6497d4c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:40.127248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d4f974-74f6-4082-8009-b5caa6497d4c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:40.127690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d4f974-74f6-4082-8009-b5caa6497d4c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:40.128105 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8d4f974-74f6-4082-8009-b5caa6497d4c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:40.257353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d8d4f974-74f6-4082-8009-b5caa6497d4c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:40.265536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d8d4f974-74f6-4082-8009-b5caa6497d4c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.150425 Aug 31 01:02:40.267171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1644/3232] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:40 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:41.289198 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-622882a5-5210-4db5-ba62-3f72e768cb42 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:41.289828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-622882a5-5210-4db5-ba62-3f72e768cb42 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:41.296826 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622882a5-5210-4db5-ba62-3f72e768cb42 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:41.297304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622882a5-5210-4db5-ba62-3f72e768cb42 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:41.297725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622882a5-5210-4db5-ba62-3f72e768cb42 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:41.298404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622882a5-5210-4db5-ba62-3f72e768cb42 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:41.298848 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622882a5-5210-4db5-ba62-3f72e768cb42 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:41.299368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622882a5-5210-4db5-ba62-3f72e768cb42 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:41.435312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-622882a5-5210-4db5-ba62-3f72e768cb42 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:41.443739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-622882a5-5210-4db5-ba62-3f72e768cb42 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.160825 Aug 31 01:02:41.444307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1589/3233] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:41 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:42.463982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d39b4d79-e941-4f16-b1bc-b738ccd30c11 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:42.464580 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d39b4d79-e941-4f16-b1bc-b738ccd30c11 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:42.471299 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d39b4d79-e941-4f16-b1bc-b738ccd30c11 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:42.471773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d39b4d79-e941-4f16-b1bc-b738ccd30c11 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:42.472195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d39b4d79-e941-4f16-b1bc-b738ccd30c11 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:42.472869 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d39b4d79-e941-4f16-b1bc-b738ccd30c11 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:42.473314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d39b4d79-e941-4f16-b1bc-b738ccd30c11 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:42.473745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d39b4d79-e941-4f16-b1bc-b738ccd30c11 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:42.612664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d39b4d79-e941-4f16-b1bc-b738ccd30c11 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:42.622180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d39b4d79-e941-4f16-b1bc-b738ccd30c11 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.161438 Aug 31 01:02:42.622757 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1645/3234] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:42 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:43.642691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-05eb7812-c299-42d4-bc5b-9f1fa79a74c8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:43.644764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-05eb7812-c299-42d4-bc5b-9f1fa79a74c8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:43.654640 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05eb7812-c299-42d4-bc5b-9f1fa79a74c8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:43.655138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05eb7812-c299-42d4-bc5b-9f1fa79a74c8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:43.656089 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05eb7812-c299-42d4-bc5b-9f1fa79a74c8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:43.656776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05eb7812-c299-42d4-bc5b-9f1fa79a74c8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:43.657213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05eb7812-c299-42d4-bc5b-9f1fa79a74c8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:43.657704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05eb7812-c299-42d4-bc5b-9f1fa79a74c8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:43.787159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-05eb7812-c299-42d4-bc5b-9f1fa79a74c8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:43.794803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-05eb7812-c299-42d4-bc5b-9f1fa79a74c8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.156016 Aug 31 01:02:43.795398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1590/3235] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:43 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:44.402215 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1985579901", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:02:44.456367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] validate_networks() for None {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:02:44.726163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:02:44.726577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:02:44.727060 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:02:44.727466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:02:44.727870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:02:44.737143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:44.737605 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:44.738025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:44.738729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:44.739211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:44.739621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:44.756428 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Getting quotas for project 2a998579761145feaa91931ff92d16ef. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:02:44.760311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Getting quotas for user ae963a2068ac476393110be5f31ce4c4 and project 2a998579761145feaa91931ff92d16ef. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:02:44.770865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:02:44.773125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:02:44.817103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0918ce14-dfbe-437c-a908-b1dde7897e38 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:44.817712 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0918ce14-dfbe-437c-a908-b1dde7897e38 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:44.820946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b573902e-4611-40e2-931f-3a77dd17f3b9 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.422569 Aug 31 01:02:44.827308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1646/3236] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 01:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:02:44.827488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0918ce14-dfbe-437c-a908-b1dde7897e38 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:44.827488 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0918ce14-dfbe-437c-a908-b1dde7897e38 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:44.827683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0918ce14-dfbe-437c-a908-b1dde7897e38 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:44.828336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0918ce14-dfbe-437c-a908-b1dde7897e38 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:44.829223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0918ce14-dfbe-437c-a908-b1dde7897e38 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:44.829671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0918ce14-dfbe-437c-a908-b1dde7897e38 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:44.833116 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4b71c15-fab9-4390-ad9d-257c1b33b8dd tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:44.835236 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4b71c15-fab9-4390-ad9d-257c1b33b8dd tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:44.916190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f4b71c15-fab9-4390-ad9d-257c1b33b8dd tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:44.925341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4b71c15-fab9-4390-ad9d-257c1b33b8dd tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1215 microversion: 2.1 time: 0.096260 Aug 31 01:02:44.926188 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1647/3237] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:44 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:44.993671 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0918ce14-dfbe-437c-a908-b1dde7897e38 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:45.001875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0918ce14-dfbe-437c-a908-b1dde7897e38 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.189748 Aug 31 01:02:45.002446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1591/3238] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:44 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:02:45.946129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c073f345-4e8c-4748-b353-fa80c0f4a61e tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:45.946724 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c073f345-4e8c-4748-b353-fa80c0f4a61e tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:45.953961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c073f345-4e8c-4748-b353-fa80c0f4a61e tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:45.954451 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c073f345-4e8c-4748-b353-fa80c0f4a61e tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:45.954884 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c073f345-4e8c-4748-b353-fa80c0f4a61e tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:45.955610 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c073f345-4e8c-4748-b353-fa80c0f4a61e tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:45.956065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c073f345-4e8c-4748-b353-fa80c0f4a61e tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:45.956491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c073f345-4e8c-4748-b353-fa80c0f4a61e tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:46.027776 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-87c97c49-44c2-40be-980b-5a9767d3382b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:46.029418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-87c97c49-44c2-40be-980b-5a9767d3382b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:46.030793 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c073f345-4e8c-4748-b353-fa80c0f4a61e tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:46.038132 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:46.038346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87c97c49-44c2-40be-980b-5a9767d3382b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:46.038674 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87c97c49-44c2-40be-980b-5a9767d3382b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:46.039682 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87c97c49-44c2-40be-980b-5a9767d3382b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:46.040646 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87c97c49-44c2-40be-980b-5a9767d3382b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:46.041095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87c97c49-44c2-40be-980b-5a9767d3382b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:46.041574 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-87c97c49-44c2-40be-980b-5a9767d3382b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:46.042281 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c073f345-4e8c-4748-b353-fa80c0f4a61e tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1275 microversion: 2.1 time: 0.099655 Aug 31 01:02:46.042882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1648/3239] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:45 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1275 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:46.182142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-87c97c49-44c2-40be-980b-5a9767d3382b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:46.191403 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-87c97c49-44c2-40be-980b-5a9767d3382b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.169815 Aug 31 01:02:46.192535 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1592/3240] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:46 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:02:47.065868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e3fa3ebe-7927-4ba8-88c6-b9e8c9acc30c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:47.066462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e3fa3ebe-7927-4ba8-88c6-b9e8c9acc30c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:47.075762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3fa3ebe-7927-4ba8-88c6-b9e8c9acc30c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:47.076289 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3fa3ebe-7927-4ba8-88c6-b9e8c9acc30c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:47.076735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3fa3ebe-7927-4ba8-88c6-b9e8c9acc30c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:47.078129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3fa3ebe-7927-4ba8-88c6-b9e8c9acc30c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:47.078697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3fa3ebe-7927-4ba8-88c6-b9e8c9acc30c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:47.079131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e3fa3ebe-7927-4ba8-88c6-b9e8c9acc30c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:47.213792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-449d5bcc-9418-444b-a25b-b7dca7406f0a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:47.214628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-449d5bcc-9418-444b-a25b-b7dca7406f0a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:47.222394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449d5bcc-9418-444b-a25b-b7dca7406f0a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:47.222876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449d5bcc-9418-444b-a25b-b7dca7406f0a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:47.223185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e3fa3ebe-7927-4ba8-88c6-b9e8c9acc30c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:47.223680 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449d5bcc-9418-444b-a25b-b7dca7406f0a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:47.224371 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449d5bcc-9418-444b-a25b-b7dca7406f0a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:47.224984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449d5bcc-9418-444b-a25b-b7dca7406f0a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:47.225572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-449d5bcc-9418-444b-a25b-b7dca7406f0a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:47.234072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e3fa3ebe-7927-4ba8-88c6-b9e8c9acc30c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1315 microversion: 2.1 time: 0.172554 Aug 31 01:02:47.239121 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1649/3241] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:47 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:47.363329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-449d5bcc-9418-444b-a25b-b7dca7406f0a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:47.371138 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-449d5bcc-9418-444b-a25b-b7dca7406f0a tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.161244 Aug 31 01:02:47.371701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1593/3242] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:47 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:02:47.568207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-e3caef29-e4bb-4e3e-bdc7-66f08613d017 req-bd7461cf-6c4e-4231-97f6-523649dcc3be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57129b68-d758-4d7b-968e-998302887e17", "tag": "7f4d8a64-d1c7-49f7-bc34-adc732087d13"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:02:47.582557 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-e3caef29-e4bb-4e3e-bdc7-66f08613d017 req-bd7461cf-6c4e-4231-97f6-523649dcc3be service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:47.583059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-e3caef29-e4bb-4e3e-bdc7-66f08613d017 req-bd7461cf-6c4e-4231-97f6-523649dcc3be service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:47.583718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-e3caef29-e4bb-4e3e-bdc7-66f08613d017 req-bd7461cf-6c4e-4231-97f6-523649dcc3be service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:47.595741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-e3caef29-e4bb-4e3e-bdc7-66f08613d017 req-bd7461cf-6c4e-4231-97f6-523649dcc3be service nova] Creating event network-changed:7f4d8a64-d1c7-49f7-bc34-adc732087d13 for instance 57129b68-d758-4d7b-968e-998302887e17 on hv-cinder-85506 Aug 31 01:02:47.602288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-e3caef29-e4bb-4e3e-bdc7-66f08613d017 req-bd7461cf-6c4e-4231-97f6-523649dcc3be service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041727 Aug 31 01:02:47.603858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1650/3243] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:02:47.703613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-2a24b768-fdf0-4558-8eba-453e627944fc req-815253ce-cc52-459e-9779-2e853245dc1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dd3781-9c72-4d8d-9cd8-114d0aead4db", "name": "network-vif-plugged", "status": "completed", "tag": "28bd9e08-7e14-43fc-9b70-0737bc3a18e9"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:02:47.715734 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-2a24b768-fdf0-4558-8eba-453e627944fc req-815253ce-cc52-459e-9779-2e853245dc1a service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:47.716282 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-2a24b768-fdf0-4558-8eba-453e627944fc req-815253ce-cc52-459e-9779-2e853245dc1a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:47.716951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-2a24b768-fdf0-4558-8eba-453e627944fc req-815253ce-cc52-459e-9779-2e853245dc1a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:47.729069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-2a24b768-fdf0-4558-8eba-453e627944fc req-815253ce-cc52-459e-9779-2e853245dc1a service nova] Creating event network-vif-plugged:28bd9e08-7e14-43fc-9b70-0737bc3a18e9 for instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db on hv-cinder-85506 Aug 31 01:02:47.734814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-2a24b768-fdf0-4558-8eba-453e627944fc req-815253ce-cc52-459e-9779-2e853245dc1a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036103 Aug 31 01:02:47.735522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1594/3244] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:02:48.256211 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6ab4514d-57cd-449b-acc5-c6f4050bc7ed tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:48.256809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6ab4514d-57cd-449b-acc5-c6f4050bc7ed tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:48.259544 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:48.265586 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab4514d-57cd-449b-acc5-c6f4050bc7ed tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:48.266240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab4514d-57cd-449b-acc5-c6f4050bc7ed tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:48.266668 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab4514d-57cd-449b-acc5-c6f4050bc7ed tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:48.267376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab4514d-57cd-449b-acc5-c6f4050bc7ed tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:48.267822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab4514d-57cd-449b-acc5-c6f4050bc7ed tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:48.268237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab4514d-57cd-449b-acc5-c6f4050bc7ed tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:48.394380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f3f5c54f-c614-4d31-bba0-a62a81f98c1c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:48.395087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f3f5c54f-c614-4d31-bba0-a62a81f98c1c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:48.397055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=35 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:48.403485 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f5c54f-c614-4d31-bba0-a62a81f98c1c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:48.404215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f5c54f-c614-4d31-bba0-a62a81f98c1c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:48.404807 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f5c54f-c614-4d31-bba0-a62a81f98c1c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:48.405685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f5c54f-c614-4d31-bba0-a62a81f98c1c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:48.406252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f5c54f-c614-4d31-bba0-a62a81f98c1c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:48.406794 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3f5c54f-c614-4d31-bba0-a62a81f98c1c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:48.408520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6ab4514d-57cd-449b-acc5-c6f4050bc7ed tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:48.411853 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=99 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:48.416644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6ab4514d-57cd-449b-acc5-c6f4050bc7ed tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1315 microversion: 2.1 time: 0.164654 Aug 31 01:02:48.417217 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1651/3245] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:48 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:48.549647 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3f5c54f-c614-4d31-bba0-a62a81f98c1c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:48.557342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f3f5c54f-c614-4d31-bba0-a62a81f98c1c tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.168600 Aug 31 01:02:48.558126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1595/3246] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:48 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:02:49.437704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b1ba42be-2d00-45e6-ada6-daa19ad0e4a7 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:49.438417 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b1ba42be-2d00-45e6-ada6-daa19ad0e4a7 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:49.444894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b1ba42be-2d00-45e6-ada6-daa19ad0e4a7 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:49.445376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b1ba42be-2d00-45e6-ada6-daa19ad0e4a7 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:49.445807 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b1ba42be-2d00-45e6-ada6-daa19ad0e4a7 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:49.446491 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b1ba42be-2d00-45e6-ada6-daa19ad0e4a7 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:49.446943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b1ba42be-2d00-45e6-ada6-daa19ad0e4a7 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:49.447392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b1ba42be-2d00-45e6-ada6-daa19ad0e4a7 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:49.579872 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5ed05c15-28ac-491f-ba79-17014fb4edc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:49.580462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5ed05c15-28ac-491f-ba79-17014fb4edc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:49.581624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b1ba42be-2d00-45e6-ada6-daa19ad0e4a7 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:49.587105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ed05c15-28ac-491f-ba79-17014fb4edc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:49.587586 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ed05c15-28ac-491f-ba79-17014fb4edc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:49.588015 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ed05c15-28ac-491f-ba79-17014fb4edc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:49.588698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ed05c15-28ac-491f-ba79-17014fb4edc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:49.589143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ed05c15-28ac-491f-ba79-17014fb4edc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:49.589388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b1ba42be-2d00-45e6-ada6-daa19ad0e4a7 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1315 microversion: 2.1 time: 0.155987 Aug 31 01:02:49.589565 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ed05c15-28ac-491f-ba79-17014fb4edc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:49.590093 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1652/3247] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:49 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:49.720523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5ed05c15-28ac-491f-ba79-17014fb4edc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:49.728192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5ed05c15-28ac-491f-ba79-17014fb4edc5 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.152813 Aug 31 01:02:49.728745 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1596/3248] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:49 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:50.611187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-51f73a11-197f-4faf-8c25-b2413d71098d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:50.611789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-51f73a11-197f-4faf-8c25-b2413d71098d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:50.618514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f73a11-197f-4faf-8c25-b2413d71098d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:50.619086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f73a11-197f-4faf-8c25-b2413d71098d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:50.619514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f73a11-197f-4faf-8c25-b2413d71098d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:50.620305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f73a11-197f-4faf-8c25-b2413d71098d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:50.620709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f73a11-197f-4faf-8c25-b2413d71098d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:50.621126 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51f73a11-197f-4faf-8c25-b2413d71098d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:50.750180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7cefb093-db27-4a1a-92fe-c92d8b7da1ce tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:50.750786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7cefb093-db27-4a1a-92fe-c92d8b7da1ce tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:50.751243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-51f73a11-197f-4faf-8c25-b2413d71098d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:50.757248 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cefb093-db27-4a1a-92fe-c92d8b7da1ce tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:50.757723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cefb093-db27-4a1a-92fe-c92d8b7da1ce tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:50.758152 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cefb093-db27-4a1a-92fe-c92d8b7da1ce tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:50.758822 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-51f73a11-197f-4faf-8c25-b2413d71098d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1315 microversion: 2.1 time: 0.151665 Aug 31 01:02:50.758932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cefb093-db27-4a1a-92fe-c92d8b7da1ce tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:50.759304 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cefb093-db27-4a1a-92fe-c92d8b7da1ce tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:50.759414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1653/3249] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:50 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:50.759725 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7cefb093-db27-4a1a-92fe-c92d8b7da1ce tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:50.886710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7cefb093-db27-4a1a-92fe-c92d8b7da1ce tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:50.895126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7cefb093-db27-4a1a-92fe-c92d8b7da1ce tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.149399 Aug 31 01:02:50.895697 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1597/3250] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:50 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:02:51.780180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4fd7d788-0c4a-433c-8f78-a276baf5cca3 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:51.781506 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4fd7d788-0c4a-433c-8f78-a276baf5cca3 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:51.787944 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd7d788-0c4a-433c-8f78-a276baf5cca3 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:51.788419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd7d788-0c4a-433c-8f78-a276baf5cca3 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:51.788844 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd7d788-0c4a-433c-8f78-a276baf5cca3 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:51.789521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd7d788-0c4a-433c-8f78-a276baf5cca3 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:51.789961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd7d788-0c4a-433c-8f78-a276baf5cca3 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:51.790372 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fd7d788-0c4a-433c-8f78-a276baf5cca3 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:51.916251 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-32e71712-e2b6-491c-9433-e3c6eebc6ec7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:51.916860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-32e71712-e2b6-491c-9433-e3c6eebc6ec7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:51.919975 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4fd7d788-0c4a-433c-8f78-a276baf5cca3 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:51.923464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32e71712-e2b6-491c-9433-e3c6eebc6ec7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:51.923927 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32e71712-e2b6-491c-9433-e3c6eebc6ec7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:51.924352 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32e71712-e2b6-491c-9433-e3c6eebc6ec7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:51.925035 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32e71712-e2b6-491c-9433-e3c6eebc6ec7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:51.925473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32e71712-e2b6-491c-9433-e3c6eebc6ec7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:51.925885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32e71712-e2b6-491c-9433-e3c6eebc6ec7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:51.928134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4fd7d788-0c4a-433c-8f78-a276baf5cca3 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1315 microversion: 2.1 time: 0.151715 Aug 31 01:02:51.929069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1654/3251] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:51 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:52.074785 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-32e71712-e2b6-491c-9433-e3c6eebc6ec7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:52.083354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-32e71712-e2b6-491c-9433-e3c6eebc6ec7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1575 microversion: 2.1 time: 0.170988 Aug 31 01:02:52.083921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1598/3252] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:51 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:02:52.954390 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-963a2894-b2d6-4c83-8844-a0489d76147c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:52.954992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-963a2894-b2d6-4c83-8844-a0489d76147c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:52.961432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-963a2894-b2d6-4c83-8844-a0489d76147c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:52.961914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-963a2894-b2d6-4c83-8844-a0489d76147c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:52.962345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-963a2894-b2d6-4c83-8844-a0489d76147c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:52.963023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-963a2894-b2d6-4c83-8844-a0489d76147c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:52.963494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-963a2894-b2d6-4c83-8844-a0489d76147c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:52.963910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-963a2894-b2d6-4c83-8844-a0489d76147c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:53.093318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-963a2894-b2d6-4c83-8844-a0489d76147c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:53.101186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-963a2894-b2d6-4c83-8844-a0489d76147c tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1315 microversion: 2.1 time: 0.151302 Aug 31 01:02:53.101809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1655/3253] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:52 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:53.105339 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-14cdd2f0-4dab-45d3-9499-52ed31a94c4b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:53.105945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-14cdd2f0-4dab-45d3-9499-52ed31a94c4b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:53.112311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14cdd2f0-4dab-45d3-9499-52ed31a94c4b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:53.112784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14cdd2f0-4dab-45d3-9499-52ed31a94c4b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:53.113212 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14cdd2f0-4dab-45d3-9499-52ed31a94c4b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:53.113885 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14cdd2f0-4dab-45d3-9499-52ed31a94c4b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:53.114325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14cdd2f0-4dab-45d3-9499-52ed31a94c4b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:53.114736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14cdd2f0-4dab-45d3-9499-52ed31a94c4b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:53.247806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-14cdd2f0-4dab-45d3-9499-52ed31a94c4b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:53.256284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-14cdd2f0-4dab-45d3-9499-52ed31a94c4b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1562 microversion: 2.1 time: 0.154700 Aug 31 01:02:53.256843 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1599/3254] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:53 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:02:54.121726 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-42349180-9ee7-483f-b412-f559c06079a5 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:54.122335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-42349180-9ee7-483f-b412-f559c06079a5 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:54.128875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42349180-9ee7-483f-b412-f559c06079a5 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:54.129346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42349180-9ee7-483f-b412-f559c06079a5 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:54.129768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42349180-9ee7-483f-b412-f559c06079a5 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:54.130445 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42349180-9ee7-483f-b412-f559c06079a5 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:54.130889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42349180-9ee7-483f-b412-f559c06079a5 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:54.131330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-42349180-9ee7-483f-b412-f559c06079a5 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:54.261820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-42349180-9ee7-483f-b412-f559c06079a5 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:54.270074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-42349180-9ee7-483f-b412-f559c06079a5 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1315 microversion: 2.1 time: 0.152214 Aug 31 01:02:54.270631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1656/3255] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:54 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:55.291013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-967041db-1d24-488c-a765-c162e5fc1d33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:55.291636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-967041db-1d24-488c-a765-c162e5fc1d33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:55.298881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-967041db-1d24-488c-a765-c162e5fc1d33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:55.299383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-967041db-1d24-488c-a765-c162e5fc1d33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:55.299809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-967041db-1d24-488c-a765-c162e5fc1d33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:55.300481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-967041db-1d24-488c-a765-c162e5fc1d33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:55.300924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-967041db-1d24-488c-a765-c162e5fc1d33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:55.301336 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-967041db-1d24-488c-a765-c162e5fc1d33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:55.429955 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-967041db-1d24-488c-a765-c162e5fc1d33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:55.438006 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-967041db-1d24-488c-a765-c162e5fc1d33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1315 microversion: 2.1 time: 0.150864 Aug 31 01:02:55.438660 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1600/3256] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:55 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:55.787166 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-6ee99c3b-e7e5-4d6d-84c8-b77489f980d3 req-d51f6ec8-4e40-43d3-a75c-39a0244fa2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57129b68-d758-4d7b-968e-998302887e17", "name": "network-vif-plugged", "status": "completed", "tag": "7f4d8a64-d1c7-49f7-bc34-adc732087d13"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:02:55.791948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:55.792741 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=8 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:02:55.800047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-6ee99c3b-e7e5-4d6d-84c8-b77489f980d3 req-d51f6ec8-4e40-43d3-a75c-39a0244fa2dd service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:55.800528 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-6ee99c3b-e7e5-4d6d-84c8-b77489f980d3 req-d51f6ec8-4e40-43d3-a75c-39a0244fa2dd service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:55.800953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-6ee99c3b-e7e5-4d6d-84c8-b77489f980d3 req-d51f6ec8-4e40-43d3-a75c-39a0244fa2dd service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:55.813029 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-6ee99c3b-e7e5-4d6d-84c8-b77489f980d3 req-d51f6ec8-4e40-43d3-a75c-39a0244fa2dd service nova] Creating event network-vif-plugged:7f4d8a64-d1c7-49f7-bc34-adc732087d13 for instance 57129b68-d758-4d7b-968e-998302887e17 on hv-cinder-85506 Aug 31 01:02:55.818230 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-6ee99c3b-e7e5-4d6d-84c8-b77489f980d3 req-d51f6ec8-4e40-43d3-a75c-39a0244fa2dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034700 Aug 31 01:02:55.818847 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1657/3257] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:02:56.458930 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4fd2c229-0db2-4b3a-a150-f0a18b170d69 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:56.459536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4fd2c229-0db2-4b3a-a150-f0a18b170d69 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:56.465844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fd2c229-0db2-4b3a-a150-f0a18b170d69 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:56.466315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fd2c229-0db2-4b3a-a150-f0a18b170d69 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:56.466740 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fd2c229-0db2-4b3a-a150-f0a18b170d69 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:56.467444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fd2c229-0db2-4b3a-a150-f0a18b170d69 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:56.467894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fd2c229-0db2-4b3a-a150-f0a18b170d69 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:56.468305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4fd2c229-0db2-4b3a-a150-f0a18b170d69 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:56.599262 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4fd2c229-0db2-4b3a-a150-f0a18b170d69 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:56.606854 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4fd2c229-0db2-4b3a-a150-f0a18b170d69 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1315 microversion: 2.1 time: 0.151878 Aug 31 01:02:56.607418 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1601/3258] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:56 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:57.629961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2ad1244e-f23a-4712-9e2c-5b724b3cdd60 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:57.630649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2ad1244e-f23a-4712-9e2c-5b724b3cdd60 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:57.636873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ad1244e-f23a-4712-9e2c-5b724b3cdd60 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:57.637349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ad1244e-f23a-4712-9e2c-5b724b3cdd60 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:57.637774 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ad1244e-f23a-4712-9e2c-5b724b3cdd60 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:57.638444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ad1244e-f23a-4712-9e2c-5b724b3cdd60 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:57.638887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ad1244e-f23a-4712-9e2c-5b724b3cdd60 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:57.639326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ad1244e-f23a-4712-9e2c-5b724b3cdd60 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:57.767919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2ad1244e-f23a-4712-9e2c-5b724b3cdd60 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:57.775554 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2ad1244e-f23a-4712-9e2c-5b724b3cdd60 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1315 microversion: 2.1 time: 0.150446 Aug 31 01:02:57.776109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1658/3259] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:57 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:58.797784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-18d797d0-463f-4505-9591-bd98815796d4 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:58.798317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-18d797d0-463f-4505-9591-bd98815796d4 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:58.804714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18d797d0-463f-4505-9591-bd98815796d4 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:58.805184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18d797d0-463f-4505-9591-bd98815796d4 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:58.805615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18d797d0-463f-4505-9591-bd98815796d4 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:58.806284 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18d797d0-463f-4505-9591-bd98815796d4 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:58.806723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18d797d0-463f-4505-9591-bd98815796d4 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:58.807178 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18d797d0-463f-4505-9591-bd98815796d4 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:58.940355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18d797d0-463f-4505-9591-bd98815796d4 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:58.948021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-18d797d0-463f-4505-9591-bd98815796d4 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1465 microversion: 2.1 time: 0.155035 Aug 31 01:02:58.948584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1602/3260] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:58 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:02:58.993962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-05b9ea0f-83e0-4989-aa60-226b19073a33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:58.994461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-05b9ea0f-83e0-4989-aa60-226b19073a33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:59.005629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05b9ea0f-83e0-4989-aa60-226b19073a33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:59.006357 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05b9ea0f-83e0-4989-aa60-226b19073a33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:59.006823 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05b9ea0f-83e0-4989-aa60-226b19073a33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:59.007568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05b9ea0f-83e0-4989-aa60-226b19073a33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:59.008023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05b9ea0f-83e0-4989-aa60-226b19073a33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:59.008449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05b9ea0f-83e0-4989-aa60-226b19073a33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:59.035318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-05b9ea0f-83e0-4989-aa60-226b19073a33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:02:59.114136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-05b9ea0f-83e0-4989-aa60-226b19073a33 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "DELETE /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 204 len: 0 microversion: 2.1 time: 0.123572 Aug 31 01:02:59.115059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1659/3261] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:02:58 2022] DELETE /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:02:59.123084 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0e9ac59b-b5cd-4bab-b1d1-502d3c97cdbb tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:02:59.123686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0e9ac59b-b5cd-4bab-b1d1-502d3c97cdbb tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:02:59.129664 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e9ac59b-b5cd-4bab-b1d1-502d3c97cdbb tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:59.130134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e9ac59b-b5cd-4bab-b1d1-502d3c97cdbb tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:59.130556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e9ac59b-b5cd-4bab-b1d1-502d3c97cdbb tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:59.131279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e9ac59b-b5cd-4bab-b1d1-502d3c97cdbb tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:02:59.131730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e9ac59b-b5cd-4bab-b1d1-502d3c97cdbb tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:02:59.132141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e9ac59b-b5cd-4bab-b1d1-502d3c97cdbb tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:02:59.265105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0e9ac59b-b5cd-4bab-b1d1-502d3c97cdbb tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:02:59.272944 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0e9ac59b-b5cd-4bab-b1d1-502d3c97cdbb tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1471 microversion: 2.1 time: 0.153623 Aug 31 01:02:59.273505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1603/3262] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:02:59 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:00.294983 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8e78c35e-fb54-4c0c-a644-c611d75c9f20 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:00.295705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8e78c35e-fb54-4c0c-a644-c611d75c9f20 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:00.302592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e78c35e-fb54-4c0c-a644-c611d75c9f20 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:00.303095 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e78c35e-fb54-4c0c-a644-c611d75c9f20 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:00.303530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e78c35e-fb54-4c0c-a644-c611d75c9f20 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:00.304207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e78c35e-fb54-4c0c-a644-c611d75c9f20 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:00.304656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e78c35e-fb54-4c0c-a644-c611d75c9f20 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:00.305074 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e78c35e-fb54-4c0c-a644-c611d75c9f20 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:00.440645 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8e78c35e-fb54-4c0c-a644-c611d75c9f20 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:00.448520 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8e78c35e-fb54-4c0c-a644-c611d75c9f20 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1471 microversion: 2.1 time: 0.157842 Aug 31 01:03:00.449090 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1660/3263] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:00 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:01.473559 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0e813522-3fa0-4968-8123-3870ce48e424 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:01.474193 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0e813522-3fa0-4968-8123-3870ce48e424 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:01.481322 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e813522-3fa0-4968-8123-3870ce48e424 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:01.481811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e813522-3fa0-4968-8123-3870ce48e424 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:01.482741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e813522-3fa0-4968-8123-3870ce48e424 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:01.483020 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e813522-3fa0-4968-8123-3870ce48e424 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:01.484211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e813522-3fa0-4968-8123-3870ce48e424 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:01.484211 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e813522-3fa0-4968-8123-3870ce48e424 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:01.551025 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-6ec1a268-fda7-4bb2-a60d-64ae80246781 req-d4f6bb3c-3a2f-4b62-a633-58f967acf6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57129b68-d758-4d7b-968e-998302887e17", "name": "network-vif-deleted", "tag": "7f4d8a64-d1c7-49f7-bc34-adc732087d13"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:01.567481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-6ec1a268-fda7-4bb2-a60d-64ae80246781 req-d4f6bb3c-3a2f-4b62-a633-58f967acf6f7 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:01.567953 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-6ec1a268-fda7-4bb2-a60d-64ae80246781 req-d4f6bb3c-3a2f-4b62-a633-58f967acf6f7 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:01.568388 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-6ec1a268-fda7-4bb2-a60d-64ae80246781 req-d4f6bb3c-3a2f-4b62-a633-58f967acf6f7 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:01.575643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0e813522-3fa0-4968-8123-3870ce48e424 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae963a2068ac476393110be5f31ce4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a998579761145feaa91931ff92d16ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:01.586997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-6ec1a268-fda7-4bb2-a60d-64ae80246781 req-d4f6bb3c-3a2f-4b62-a633-58f967acf6f7 service nova] Creating event network-vif-deleted:7f4d8a64-d1c7-49f7-bc34-adc732087d13 for instance 57129b68-d758-4d7b-968e-998302887e17 on hv-cinder-85506 Aug 31 01:03:01.589254 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0e813522-3fa0-4968-8123-3870ce48e424 tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 200 len: 1429 microversion: 2.1 time: 0.119489 Aug 31 01:03:01.591531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1604/3264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:01 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 1429 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:01.592179 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-6ec1a268-fda7-4bb2-a60d-64ae80246781 req-d4f6bb3c-3a2f-4b62-a633-58f967acf6f7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044703 Aug 31 01:03:01.592933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1661/3265] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:02.150423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d8e85767-4625-4888-a6a5-859098e021d8 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:02.150942 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d8e85767-4625-4888-a6a5-859098e021d8 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:02.158484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8e85767-4625-4888-a6a5-859098e021d8 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:02.158963 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8e85767-4625-4888-a6a5-859098e021d8 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:02.159419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8e85767-4625-4888-a6a5-859098e021d8 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:02.160099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8e85767-4625-4888-a6a5-859098e021d8 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:02.160543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8e85767-4625-4888-a6a5-859098e021d8 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:02.160958 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8e85767-4625-4888-a6a5-859098e021d8 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:02.191743 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d8e85767-4625-4888-a6a5-859098e021d8 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c/ips" status: 200 len: 149 microversion: 2.1 time: 0.045008 Aug 31 01:03:02.192450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1605/3266] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 31 01:03:02 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:02.204962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85c33bb8-727f-41d9-954c-dc72746a5083"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:02.207436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:02.214397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:02.214882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:02.215347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:02.216039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:02.216486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:02.216905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:02.301149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Invalid volume: volume 85c33bb8-727f-41d9-954c-dc72746a5083 is already attached to instances: b121863b-98ef-451b-be2a-2f3f615e4456 Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: POST /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c/os-volume_attachments HTTP/1.1 Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 74 Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:03:02.302999 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {"volumeAttachment": {"volumeId": "85c33bb8-727f-41d9-954c-dc72746a5083"}} Aug 31 01:03:02.304456 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Invalid volume: volume 85c33bb8-727f-41d9-954c-dc72746a5083 is already attached to instances: b121863b-98ef-451b-be2a-2f3f615e4456 Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'server_id': '12b2858e-c473-44bb-a7f4-5e520c11b66c', 'body': {'volumeAttachment': {'volumeId': '85c33bb8-727f-41d9-954c-dc72746a5083'}}} Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 85c33bb8-727f-41d9-954c-dc72746a5083 is already attached to instances: b121863b-98ef-451b-be2a-2f3f615e4456 Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:03:02.305279 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 85c33bb8-727f-41d9-954c-dc72746a5083 is already attached to instances: b121863b-98ef-451b-be2a-2f3f615e4456 Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:02.306583 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:03:02.307892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:03:02.307892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:03:02.307892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:03:02.307892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 85c33bb8-727f-41d9-954c-dc72746a5083 is already attached to instances: b121863b-98ef-451b-be2a-2f3f615e4456 Aug 31 01:03:02.307892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:03:02.307892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 400 to user: Invalid volume: volume 85c33bb8-727f-41d9-954c-dc72746a5083 is already attached to instances: b121863b-98ef-451b-be2a-2f3f615e4456 {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:03:02.307892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fdaf5c3b-6b1e-4eb8-ac5a-7418a126b255 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105495 Aug 31 01:03:02.307892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1662/3267] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 01:03:02 2022] POST /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:03:02.316866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-85a3dcae-023c-46b2-9116-6164b1a56523 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:02.317370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-85a3dcae-023c-46b2-9116-6164b1a56523 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:02.323522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85a3dcae-023c-46b2-9116-6164b1a56523 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:02.324005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85a3dcae-023c-46b2-9116-6164b1a56523 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:02.324441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85a3dcae-023c-46b2-9116-6164b1a56523 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:02.325119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85a3dcae-023c-46b2-9116-6164b1a56523 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:02.325739 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85a3dcae-023c-46b2-9116-6164b1a56523 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:02.326163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85a3dcae-023c-46b2-9116-6164b1a56523 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:02.356691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-85a3dcae-023c-46b2-9116-6164b1a56523 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:03:02.434968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-85a3dcae-023c-46b2-9116-6164b1a56523 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 204 len: 0 microversion: 2.1 time: 0.122592 Aug 31 01:03:02.436026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1606/3268] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:03:02 2022] DELETE /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:03:02.444530 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7e98985f-f009-435b-8391-2c9834a0f08a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:02.445353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7e98985f-f009-435b-8391-2c9834a0f08a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:02.451376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e98985f-f009-435b-8391-2c9834a0f08a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:02.451853 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e98985f-f009-435b-8391-2c9834a0f08a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:02.452300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e98985f-f009-435b-8391-2c9834a0f08a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:02.452982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e98985f-f009-435b-8391-2c9834a0f08a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:02.453424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e98985f-f009-435b-8391-2c9834a0f08a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:02.453841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e98985f-f009-435b-8391-2c9834a0f08a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:02.584832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7e98985f-f009-435b-8391-2c9834a0f08a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:02.593072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7e98985f-f009-435b-8391-2c9834a0f08a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1680 microversion: 2.1 time: 0.151954 Aug 31 01:03:02.593635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1663/3269] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:02 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:02.612677 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:02.613368 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] [instance: 57129b68-d758-4d7b-968e-998302887e17] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:02.620171 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:02.620644 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:02.621077 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:02.621881 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:02.622416 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:02.622926 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:02.636475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] HTTP exception thrown: Instance 57129b68-d758-4d7b-968e-998302887e17 could not be found. Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Request method failure captured: Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 HTTP/1.1 Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrMy-04pco8czL-ir6HNtKMqPpc0UToxp7OXK0mWjRLZmJBI_c46NrQArV35RY8xEamTVeiu3MRLDollNp6cdAdXXB3eDp1qrOAVPRbgTflZU8df4_pSibT-jiChqTKmPvoWOLuqtqP6Z-zmuO85szfLLHk9WtNnjPoiZzf7Djkl3XE Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 2a998579761145feaa91931ff92d16ef Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesNegativeTest-802792344 Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:03:02.638090 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2a998579761145feaa91931ff92d16ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2a998579761145feaa91931ff92d16ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2a998579761145feaa91931ff92d16ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2a998579761145feaa91931ff92d16ef", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesNegativeTest-802792344 Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 2a998579761145feaa91931ff92d16ef Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesNegativeTest-802792344 Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesNegativeTest-802792344-project Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: ae963a2068ac476393110be5f31ce4c4 Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesNegativeTest-802792344-project Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance 57129b68-d758-4d7b-968e-998302887e17 could not be found. Aug 31 01:03:02.639596 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '57129b68-d758-4d7b-968e-998302887e17'} Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57129b68-d758-4d7b-968e-998302887e17 could not be found. Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:03:02.640498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57129b68-d758-4d7b-968e-998302887e17 could not be found. Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57129b68-d758-4d7b-968e-998302887e17 could not be found. Aug 31 01:03:02.641895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:03:02.643011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] Returning 404 to user: Instance 57129b68-d758-4d7b-968e-998302887e17 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:03:02.643011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d5093817-82bd-44e3-9a94-425fd93b8e4d tempest-VolumesNegativeTest-802792344 tempest-VolumesNegativeTest-802792344-project] 10.222.0.67 "GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17" status: 404 len: 111 microversion: 2.1 time: 0.031517 Aug 31 01:03:02.643011 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1607/3270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:02 2022] GET /compute/v2.1/servers/57129b68-d758-4d7b-968e-998302887e17 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:03:03.616314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0de4fd6c-03e7-450b-bce6-2d019b28955f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:03.616916 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0de4fd6c-03e7-450b-bce6-2d019b28955f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:03.625391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0de4fd6c-03e7-450b-bce6-2d019b28955f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:03.625875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0de4fd6c-03e7-450b-bce6-2d019b28955f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:03.626305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0de4fd6c-03e7-450b-bce6-2d019b28955f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:03.626985 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0de4fd6c-03e7-450b-bce6-2d019b28955f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:03.627462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0de4fd6c-03e7-450b-bce6-2d019b28955f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:03.627879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0de4fd6c-03e7-450b-bce6-2d019b28955f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:03.769970 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0de4fd6c-03e7-450b-bce6-2d019b28955f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:03.777747 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0de4fd6c-03e7-450b-bce6-2d019b28955f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1680 microversion: 2.1 time: 0.166151 Aug 31 01:03:03.778564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1664/3271] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:03 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:04.801372 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b74ee715-2309-4d50-b26c-11d4a3b9839b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:04.802547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b74ee715-2309-4d50-b26c-11d4a3b9839b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:04.808912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b74ee715-2309-4d50-b26c-11d4a3b9839b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:04.809388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b74ee715-2309-4d50-b26c-11d4a3b9839b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:04.809816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b74ee715-2309-4d50-b26c-11d4a3b9839b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:04.810497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b74ee715-2309-4d50-b26c-11d4a3b9839b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:04.810947 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b74ee715-2309-4d50-b26c-11d4a3b9839b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:04.811451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b74ee715-2309-4d50-b26c-11d4a3b9839b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:04.952782 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b74ee715-2309-4d50-b26c-11d4a3b9839b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:04.961579 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b74ee715-2309-4d50-b26c-11d4a3b9839b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1680 microversion: 2.1 time: 0.163980 Aug 31 01:03:04.962150 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1608/3272] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:04 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:05.485524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-f88a2870-1614-4a0b-9991-2e62598454c5 req-fb4e300d-4264-4765-8311-422e24e96f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b2858e-c473-44bb-a7f4-5e520c11b66c", "name": "network-vif-deleted", "tag": "6ed00551-04dd-4a7c-b069-b1c9e654fbf2"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:05.495879 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f88a2870-1614-4a0b-9991-2e62598454c5 req-fb4e300d-4264-4765-8311-422e24e96f6a service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:05.496362 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f88a2870-1614-4a0b-9991-2e62598454c5 req-fb4e300d-4264-4765-8311-422e24e96f6a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:05.496789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f88a2870-1614-4a0b-9991-2e62598454c5 req-fb4e300d-4264-4765-8311-422e24e96f6a service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:05.508818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-f88a2870-1614-4a0b-9991-2e62598454c5 req-fb4e300d-4264-4765-8311-422e24e96f6a service nova] Creating event network-vif-deleted:6ed00551-04dd-4a7c-b069-b1c9e654fbf2 for instance 12b2858e-c473-44bb-a7f4-5e520c11b66c on hv-cinder-85506 Aug 31 01:03:05.514064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-f88a2870-1614-4a0b-9991-2e62598454c5 req-fb4e300d-4264-4765-8311-422e24e96f6a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032319 Aug 31 01:03:05.515182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1665/3273] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:03:05.985007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:05.985648 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:05.992228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:05.992715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:05.993142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:05.994052 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:05.994492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:05.994916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:06.027438 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:06.027976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:06.028503 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:06.029044 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lazy-loading 'fault' on Instance uuid 12b2858e-c473-44bb-a7f4-5e520c11b66c {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:03:06.071831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:06.082183 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-466f91a9-9b94-434a-b479-0efec2e774fc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 200 len: 1330 microversion: 2.1 time: 0.101489 Aug 31 01:03:06.082829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1609/3274] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:05 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:07.106579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:07.107422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:07.113968 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:07.114444 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:07.114866 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:07.115573 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:07.116059 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:07.116424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:07.134309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c HTTP/1.1 Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:03:07.135981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:03:07.137204 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': '12b2858e-c473-44bb-a7f4-5e520c11b66c'} Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:03:07.137868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:03:07.139023 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:03:07.140350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:03:07.140350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-04b5285a-1146-4a9d-bd07-32aa75275cac tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 404 len: 111 microversion: 2.1 time: 0.035499 Aug 31 01:03:07.140350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1666/3275] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:07 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:03:07.149195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-99a6f155-4cb2-4a68-956d-bb8d03ed27ea tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '.version_select at 0x7fa7f74ad5e0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:07.170470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-99a6f155-4cb2-4a68-956d-bb8d03ed27ea tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-368643855" status: 202 len: 0 microversion: 2.1 time: 0.025427 Aug 31 01:03:07.172234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1610/3276] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 31 01:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-368643855 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:03:08.133692 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-73263a54-2cee-455e-90ed-34b40cbaad91 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:08.134209 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-73263a54-2cee-455e-90ed-34b40cbaad91 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:08.141164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73263a54-2cee-455e-90ed-34b40cbaad91 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:08.141591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73263a54-2cee-455e-90ed-34b40cbaad91 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:08.142102 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73263a54-2cee-455e-90ed-34b40cbaad91 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:08.143458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73263a54-2cee-455e-90ed-34b40cbaad91 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:08.143458 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73263a54-2cee-455e-90ed-34b40cbaad91 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:08.143967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-73263a54-2cee-455e-90ed-34b40cbaad91 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:08.159518 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:08.251762 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-73263a54-2cee-455e-90ed-34b40cbaad91 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lazy-loading 'services' on Instance uuid b121863b-98ef-451b-be2a-2f3f615e4456 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:03:08.328918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-73263a54-2cee-455e-90ed-34b40cbaad91 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/os-volume_attachments/85c33bb8-727f-41d9-954c-dc72746a5083" status: 202 len: 0 microversion: 2.1 time: 0.198893 Aug 31 01:03:08.329630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1667/3277] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 01:03:08 2022] DELETE /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/os-volume_attachments/85c33bb8-727f-41d9-954c-dc72746a5083 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:03:08.339214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-278011ca-7fed-4a21-a06f-cd74c5ae1cfc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:08.341338 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-278011ca-7fed-4a21-a06f-cd74c5ae1cfc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:08.349473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-278011ca-7fed-4a21-a06f-cd74c5ae1cfc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:08.350206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-278011ca-7fed-4a21-a06f-cd74c5ae1cfc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:08.350790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-278011ca-7fed-4a21-a06f-cd74c5ae1cfc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:08.351665 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-278011ca-7fed-4a21-a06f-cd74c5ae1cfc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:08.352358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-278011ca-7fed-4a21-a06f-cd74c5ae1cfc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:08.352971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-278011ca-7fed-4a21-a06f-cd74c5ae1cfc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:08.381570 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:08.389056 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-278011ca-7fed-4a21-a06f-cd74c5ae1cfc tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054682 Aug 31 01:03:08.390466 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1611/3278] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 01:03:08 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:09.404728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a48a7282-dbac-401f-893a-e276c1643d92 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:09.407785 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a48a7282-dbac-401f-893a-e276c1643d92 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:09.414053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a48a7282-dbac-401f-893a-e276c1643d92 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:09.414532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a48a7282-dbac-401f-893a-e276c1643d92 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:09.414961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a48a7282-dbac-401f-893a-e276c1643d92 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:09.415680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a48a7282-dbac-401f-893a-e276c1643d92 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:09.416131 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a48a7282-dbac-401f-893a-e276c1643d92 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:09.416550 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a48a7282-dbac-401f-893a-e276c1643d92 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:09.448081 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a48a7282-dbac-401f-893a-e276c1643d92 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048227 Aug 31 01:03:09.455133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1668/3279] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 01:03:09 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:03:09.515824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-eac8dbd3-8fba-4af9-9263-3e5ecdcc8e9c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:09.516317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eac8dbd3-8fba-4af9-9263-3e5ecdcc8e9c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:09.523428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eac8dbd3-8fba-4af9-9263-3e5ecdcc8e9c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:09.523914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eac8dbd3-8fba-4af9-9263-3e5ecdcc8e9c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:09.524342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eac8dbd3-8fba-4af9-9263-3e5ecdcc8e9c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:09.525061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eac8dbd3-8fba-4af9-9263-3e5ecdcc8e9c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:09.525478 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eac8dbd3-8fba-4af9-9263-3e5ecdcc8e9c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:09.525896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eac8dbd3-8fba-4af9-9263-3e5ecdcc8e9c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:09.550996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eac8dbd3-8fba-4af9-9263-3e5ecdcc8e9c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:03:09.631731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-eac8dbd3-8fba-4af9-9263-3e5ecdcc8e9c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 204 len: 0 microversion: 2.1 time: 0.120295 Aug 31 01:03:09.632593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1612/3280] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:03:09 2022] DELETE /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:03:09.642327 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-df767864-b2b8-4d2e-8b6f-64998cccf8c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:09.642535 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-df767864-b2b8-4d2e-8b6f-64998cccf8c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:09.649295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df767864-b2b8-4d2e-8b6f-64998cccf8c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:09.649834 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df767864-b2b8-4d2e-8b6f-64998cccf8c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:09.650275 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df767864-b2b8-4d2e-8b6f-64998cccf8c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:09.650948 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df767864-b2b8-4d2e-8b6f-64998cccf8c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:09.651903 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df767864-b2b8-4d2e-8b6f-64998cccf8c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:09.652619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df767864-b2b8-4d2e-8b6f-64998cccf8c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:09.906729 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-df767864-b2b8-4d2e-8b6f-64998cccf8c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:09.917613 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-df767864-b2b8-4d2e-8b6f-64998cccf8c1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1680 microversion: 2.1 time: 0.280775 Aug 31 01:03:09.919091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1669/3281] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:09 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:03:10.941831 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ea3f9b68-bc08-4f59-96a6-bcd8f3554bf9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:10.942521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ea3f9b68-bc08-4f59-96a6-bcd8f3554bf9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:10.949167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea3f9b68-bc08-4f59-96a6-bcd8f3554bf9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:10.949657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea3f9b68-bc08-4f59-96a6-bcd8f3554bf9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:10.950087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea3f9b68-bc08-4f59-96a6-bcd8f3554bf9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:10.950788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea3f9b68-bc08-4f59-96a6-bcd8f3554bf9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:10.951250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea3f9b68-bc08-4f59-96a6-bcd8f3554bf9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:10.951673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea3f9b68-bc08-4f59-96a6-bcd8f3554bf9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:11.141113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ea3f9b68-bc08-4f59-96a6-bcd8f3554bf9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:11.149710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ea3f9b68-bc08-4f59-96a6-bcd8f3554bf9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1680 microversion: 2.1 time: 0.211971 Aug 31 01:03:11.150541 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1613/3282] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:10 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:12.174321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4fc18179-5618-4191-9e02-8a0c73731139 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:12.175772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4fc18179-5618-4191-9e02-8a0c73731139 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:12.185905 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fc18179-5618-4191-9e02-8a0c73731139 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:12.187784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fc18179-5618-4191-9e02-8a0c73731139 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:12.188462 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fc18179-5618-4191-9e02-8a0c73731139 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:12.189405 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fc18179-5618-4191-9e02-8a0c73731139 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:12.190545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fc18179-5618-4191-9e02-8a0c73731139 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:12.191723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4fc18179-5618-4191-9e02-8a0c73731139 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:12.364298 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4fc18179-5618-4191-9e02-8a0c73731139 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:12.378262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4fc18179-5618-4191-9e02-8a0c73731139 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1680 microversion: 2.1 time: 0.209361 Aug 31 01:03:12.381558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1670/3283] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:12 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:13.240007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-2c95d755-cf03-4eb6-86e5-19bc1de15bb3 req-d5a1df0d-ab42-4c68-82e1-779ecd042a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b121863b-98ef-451b-be2a-2f3f615e4456", "name": "network-vif-deleted", "tag": "fc9e7855-130f-49c9-944c-e779446adb05"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:13.252710 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-2c95d755-cf03-4eb6-86e5-19bc1de15bb3 req-d5a1df0d-ab42-4c68-82e1-779ecd042a97 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:13.253523 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-2c95d755-cf03-4eb6-86e5-19bc1de15bb3 req-d5a1df0d-ab42-4c68-82e1-779ecd042a97 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:13.254095 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-2c95d755-cf03-4eb6-86e5-19bc1de15bb3 req-d5a1df0d-ab42-4c68-82e1-779ecd042a97 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:13.267083 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-2c95d755-cf03-4eb6-86e5-19bc1de15bb3 req-d5a1df0d-ab42-4c68-82e1-779ecd042a97 service nova] Creating event network-vif-deleted:fc9e7855-130f-49c9-944c-e779446adb05 for instance b121863b-98ef-451b-be2a-2f3f615e4456 on hv-cinder-85506 Aug 31 01:03:13.272891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-2c95d755-cf03-4eb6-86e5-19bc1de15bb3 req-d5a1df0d-ab42-4c68-82e1-779ecd042a97 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.435057 Aug 31 01:03:13.273810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1614/3284] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:13.402169 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:13.404238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:13.414695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:13.415225 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:13.415942 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:13.416779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:13.417301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:13.417961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:13.486125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:13.486588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:13.487051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:13.487513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lazy-loading 'fault' on Instance uuid b121863b-98ef-451b-be2a-2f3f615e4456 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:03:13.562865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:13.584377 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c47757d5-339e-4dac-b65d-3cf96b61db1a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 200 len: 1331 microversion: 2.1 time: 0.185200 Aug 31 01:03:13.587690 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1671/3285] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:13 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 1331 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:14.610910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:14.611902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:14.625206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:14.626037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:14.626536 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:14.627533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:14.628129 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:14.628699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:14.645959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 HTTP/1.1 Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:03:14.647812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:03:14.649069 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'b121863b-98ef-451b-be2a-2f3f615e4456'} Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:03:14.649764 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:03:14.652145 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:03:14.653649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:03:14.653649 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-826e762f-e80b-42bc-a431-c0f433b3f6ae tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 404 len: 111 microversion: 2.1 time: 0.044145 Aug 31 01:03:14.654849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1615/3286] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:14 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:03:14.661144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f5c40fd6-5f03-4011-a845-55edb86c3806 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '.version_select at 0x7fa7f76ecf70>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:14.694722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f5c40fd6-5f03-4011-a845-55edb86c3806 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-516519146" status: 202 len: 0 microversion: 2.1 time: 0.038253 Aug 31 01:03:14.695721 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1672/3287] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 31 01:03:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-516519146 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:03:15.859306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cfd6d973-9a98-4541-9c6f-a603802098b7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: .version_select at 0x7fa7f75fcca0>, body: {"keypair": {"name": "tempest-keypair-146961060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/kySfwY7VXCRVpnZLv3eV9h1o5/YOWbfw6DtW5cBZh1lwdW14voFQPK/41UnxT7cu4b+Onzh+bNfJzdh6jY29Y/SvIJ+ygSsgKphdbyMVNUxMFoS2uNFwjJjir9gcSaQ=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:15.884022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-cfd6d973-9a98-4541-9c6f-a603802098b7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for project 6b67e536fd414591b859c1a89808e1a6. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:03:15.888558 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-cfd6d973-9a98-4541-9c6f-a603802098b7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for user 26826ddf92124c95835a5356e13040bf and project 6b67e536fd414591b859c1a89808e1a6. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:03:15.913127 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cfd6d973-9a98-4541-9c6f-a603802098b7 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060127 Aug 31 01:03:15.914429 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1616/3288] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 31 01:03:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:17.860032 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-866552528", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84755e79-134e-460d-be79-1943a8a099f4"}], "security_groups": [{"name": "tempest-securitygroup--423214461"}], "key_name": "tempest-keypair-146961060", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:18.055421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] validate_networks() for [('84755e79-134e-460d-be79-1943a8a099f4', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:03:18.508423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:03:18.514969 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:03:18.516087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:03:18.516558 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:03:18.519259 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:03:18.521450 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:18.535108 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:18.535393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:18.536012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:18.536725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:18.537175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:18.537592 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:18.555514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for project 6b67e536fd414591b859c1a89808e1a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:03:18.560649 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for user 26826ddf92124c95835a5356e13040bf and project 6b67e536fd414591b859c1a89808e1a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:03:18.572794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:03:18.575112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:03:18.644165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-902c15ce-2539-47f8-8b52-3297d50ceb39 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.797272 Aug 31 01:03:18.645152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1673/3289] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 01:03:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:03:18.656661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fef37461-43bb-4101-8b7b-09dc94e5913a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:18.663685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fef37461-43bb-4101-8b7b-09dc94e5913a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:18.676258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:18.755802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fef37461-43bb-4101-8b7b-09dc94e5913a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:18.762901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fef37461-43bb-4101-8b7b-09dc94e5913a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1240 microversion: 2.1 time: 0.110647 Aug 31 01:03:18.764933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1617/3290] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:18 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1240 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:19.789796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-17227178-ab1f-4166-a9f3-6a00fd1d9440 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:19.790429 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-17227178-ab1f-4166-a9f3-6a00fd1d9440 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:19.801068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17227178-ab1f-4166-a9f3-6a00fd1d9440 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:19.801819 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17227178-ab1f-4166-a9f3-6a00fd1d9440 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:19.803012 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17227178-ab1f-4166-a9f3-6a00fd1d9440 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:19.803949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17227178-ab1f-4166-a9f3-6a00fd1d9440 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:19.806568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17227178-ab1f-4166-a9f3-6a00fd1d9440 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:19.807195 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17227178-ab1f-4166-a9f3-6a00fd1d9440 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:19.929525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-17227178-ab1f-4166-a9f3-6a00fd1d9440 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:19.938313 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-17227178-ab1f-4166-a9f3-6a00fd1d9440 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1292 microversion: 2.1 time: 0.153288 Aug 31 01:03:19.944139 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1674/3291] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:19 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1292 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:20.967615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-13a3d64f-497c-4835-a5da-712db7c6b783 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:20.969155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-13a3d64f-497c-4835-a5da-712db7c6b783 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:20.982005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13a3d64f-497c-4835-a5da-712db7c6b783 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:20.984166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13a3d64f-497c-4835-a5da-712db7c6b783 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:20.984934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13a3d64f-497c-4835-a5da-712db7c6b783 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:20.987858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13a3d64f-497c-4835-a5da-712db7c6b783 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:20.990346 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13a3d64f-497c-4835-a5da-712db7c6b783 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:20.990923 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-13a3d64f-497c-4835-a5da-712db7c6b783 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:21.097249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-13a3d64f-497c-4835-a5da-712db7c6b783 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:21.108055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-13a3d64f-497c-4835-a5da-712db7c6b783 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1298 microversion: 2.1 time: 0.145941 Aug 31 01:03:21.112506 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1618/3292] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:20 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:22.136934 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f07aac13-1f65-4c67-aeeb-9a520ca35581 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:22.137559 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f07aac13-1f65-4c67-aeeb-9a520ca35581 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:22.153119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f07aac13-1f65-4c67-aeeb-9a520ca35581 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:22.153720 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f07aac13-1f65-4c67-aeeb-9a520ca35581 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:22.154348 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f07aac13-1f65-4c67-aeeb-9a520ca35581 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:22.155737 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f07aac13-1f65-4c67-aeeb-9a520ca35581 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:22.156562 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f07aac13-1f65-4c67-aeeb-9a520ca35581 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:22.156936 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f07aac13-1f65-4c67-aeeb-9a520ca35581 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:22.187117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-d14bbe4e-740d-4cb7-a804-33581874e911 req-33f4bf35-6da8-479d-b47a-ad7dbe1a5839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefe8ad6-db69-4013-99c8-0a6427495baf", "tag": "c567e761-92a1-43c8-b110-3d4a58c53908"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:22.204938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d14bbe4e-740d-4cb7-a804-33581874e911 req-33f4bf35-6da8-479d-b47a-ad7dbe1a5839 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:22.205452 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d14bbe4e-740d-4cb7-a804-33581874e911 req-33f4bf35-6da8-479d-b47a-ad7dbe1a5839 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:22.205852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d14bbe4e-740d-4cb7-a804-33581874e911 req-33f4bf35-6da8-479d-b47a-ad7dbe1a5839 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:22.230142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-d14bbe4e-740d-4cb7-a804-33581874e911 req-33f4bf35-6da8-479d-b47a-ad7dbe1a5839 service nova] Creating event network-changed:c567e761-92a1-43c8-b110-3d4a58c53908 for instance fefe8ad6-db69-4013-99c8-0a6427495baf on hv-cinder-85506 Aug 31 01:03:22.244796 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-d14bbe4e-740d-4cb7-a804-33581874e911 req-33f4bf35-6da8-479d-b47a-ad7dbe1a5839 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061896 Aug 31 01:03:22.246356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1619/3293] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:22.341578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f07aac13-1f65-4c67-aeeb-9a520ca35581 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:22.351177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f07aac13-1f65-4c67-aeeb-9a520ca35581 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.218113 Aug 31 01:03:22.365092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1675/3294] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:22 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:23.378961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-725d5202-f28b-477d-b8ef-7eea36f0f564 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:23.380396 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-725d5202-f28b-477d-b8ef-7eea36f0f564 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:23.387301 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d5202-f28b-477d-b8ef-7eea36f0f564 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:23.393863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d5202-f28b-477d-b8ef-7eea36f0f564 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:23.394751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d5202-f28b-477d-b8ef-7eea36f0f564 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:23.395738 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d5202-f28b-477d-b8ef-7eea36f0f564 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:23.396405 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d5202-f28b-477d-b8ef-7eea36f0f564 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:23.397008 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-725d5202-f28b-477d-b8ef-7eea36f0f564 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:23.577328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-725d5202-f28b-477d-b8ef-7eea36f0f564 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:23.586064 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-725d5202-f28b-477d-b8ef-7eea36f0f564 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.214757 Aug 31 01:03:23.589625 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1620/3295] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:23 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:24.613177 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-756d9b69-bf9a-443d-8bfd-3c5819a13388 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:24.614316 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-756d9b69-bf9a-443d-8bfd-3c5819a13388 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:24.621178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-756d9b69-bf9a-443d-8bfd-3c5819a13388 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:24.621885 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-756d9b69-bf9a-443d-8bfd-3c5819a13388 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:24.622666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-756d9b69-bf9a-443d-8bfd-3c5819a13388 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:24.624262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-756d9b69-bf9a-443d-8bfd-3c5819a13388 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:24.625241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-756d9b69-bf9a-443d-8bfd-3c5819a13388 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:24.625841 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-756d9b69-bf9a-443d-8bfd-3c5819a13388 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:24.816894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-756d9b69-bf9a-443d-8bfd-3c5819a13388 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:24.825564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-756d9b69-bf9a-443d-8bfd-3c5819a13388 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.219609 Aug 31 01:03:24.826160 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1676/3296] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:24 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:25.849508 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1612c4ca-cea0-4bce-9b20-6066fb6a0dc5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:25.850741 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1612c4ca-cea0-4bce-9b20-6066fb6a0dc5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:25.857966 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1612c4ca-cea0-4bce-9b20-6066fb6a0dc5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:25.859469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1612c4ca-cea0-4bce-9b20-6066fb6a0dc5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:25.860066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1612c4ca-cea0-4bce-9b20-6066fb6a0dc5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:25.860907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1612c4ca-cea0-4bce-9b20-6066fb6a0dc5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:25.861505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1612c4ca-cea0-4bce-9b20-6066fb6a0dc5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:25.862065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1612c4ca-cea0-4bce-9b20-6066fb6a0dc5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:26.054483 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1612c4ca-cea0-4bce-9b20-6066fb6a0dc5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:26.064373 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1612c4ca-cea0-4bce-9b20-6066fb6a0dc5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.222380 Aug 31 01:03:26.064957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1621/3297] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:25 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:27.086256 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ca3e5b0a-7093-4b4d-a9b2-a9f8df72864e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:27.087563 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ca3e5b0a-7093-4b4d-a9b2-a9f8df72864e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:27.095255 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3e5b0a-7093-4b4d-a9b2-a9f8df72864e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:27.095837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3e5b0a-7093-4b4d-a9b2-a9f8df72864e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:27.096347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3e5b0a-7093-4b4d-a9b2-a9f8df72864e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:27.097396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3e5b0a-7093-4b4d-a9b2-a9f8df72864e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:27.097949 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3e5b0a-7093-4b4d-a9b2-a9f8df72864e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:27.098809 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3e5b0a-7093-4b4d-a9b2-a9f8df72864e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:27.541989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ca3e5b0a-7093-4b4d-a9b2-a9f8df72864e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:27.551175 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ca3e5b0a-7093-4b4d-a9b2-a9f8df72864e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.468715 Aug 31 01:03:27.551870 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1677/3298] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:27 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:28.346101 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-587592c1-5093-4530-a740-77ac1f9d536d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Action: 'create', calling method: .version_select at 0x7fa7ef9c3e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1709539258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYY9Rs7YyU8NLlJrnJCmZHcdMsfujyqiizIAewfVbE8nF3aNEpIv7w7sHaU+xn+iWubXsdTznEHe++5i/b4t60LKl1nFs6ULnbnKNVmlzo3pGtiW3B4Vs818seFALbnyQ=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:28.361752 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-587592c1-5093-4530-a740-77ac1f9d536d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Getting quotas for project 7f85c7d484fa4aebafc3c0a12c9569c2. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:03:28.365475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-587592c1-5093-4530-a740-77ac1f9d536d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Getting quotas for user 74ec301c62e541e0851f7570bcf07e4f and project 7f85c7d484fa4aebafc3c0a12c9569c2. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:03:28.386632 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-587592c1-5093-4530-a740-77ac1f9d536d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045279 Aug 31 01:03:28.387247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1622/3299] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 31 01:03:28 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:03:28.440784 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1917340546", "imageRef": "dbf2ed8c-8d37-469c-97f8-5bcbb12d996e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1709539258", "networks": [{"uuid": "113440fe-4e49-4c39-8e9b-29315f750eef"}]}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:28.492568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] validate_networks() for [('113440fe-4e49-4c39-8e9b-29315f750eef', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:03:28.545670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:28.568946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=6 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:28.573763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-576ed2b6-22f4-486c-b5dd-2cafb923487a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:28.574377 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-576ed2b6-22f4-486c-b5dd-2cafb923487a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:28.582002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-576ed2b6-22f4-486c-b5dd-2cafb923487a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:28.582834 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-576ed2b6-22f4-486c-b5dd-2cafb923487a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:28.583700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-576ed2b6-22f4-486c-b5dd-2cafb923487a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:28.584879 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-576ed2b6-22f4-486c-b5dd-2cafb923487a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:28.585486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-576ed2b6-22f4-486c-b5dd-2cafb923487a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:28.586092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-576ed2b6-22f4-486c-b5dd-2cafb923487a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:28.806547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-576ed2b6-22f4-486c-b5dd-2cafb923487a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:28.816263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-576ed2b6-22f4-486c-b5dd-2cafb923487a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.246871 Aug 31 01:03:28.816841 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1623/3300] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:28 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:03:28.934180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:03:28.934602 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:03:28.935106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:03:28.935513 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:03:28.936039 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:03:28.945435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:28.945915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:28.946345 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:28.947086 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:28.947537 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:28.947956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:28.964182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Getting quotas for project 7f85c7d484fa4aebafc3c0a12c9569c2. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:03:28.968061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Getting quotas for user 74ec301c62e541e0851f7570bcf07e4f and project 7f85c7d484fa4aebafc3c0a12c9569c2. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:03:28.979360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:03:28.981434 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dbf2ed8c-8d37-469c-97f8-5bcbb12d996e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:03:29.027765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7e4f41e0-d81a-4747-93dc-b9bc2ce0402a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591028 Aug 31 01:03:29.028412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1678/3301] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 01:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:03:29.039616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-21f9135e-195e-4f6b-8cea-1a49eb654376 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:29.040223 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-21f9135e-195e-4f6b-8cea-1a49eb654376 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:29.100943 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-21f9135e-195e-4f6b-8cea-1a49eb654376 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:29.109112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-21f9135e-195e-4f6b-8cea-1a49eb654376 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1259 microversion: 2.1 time: 0.073668 Aug 31 01:03:29.109789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1624/3302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:29 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:29.839654 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d6c1559-7eb1-45ec-8f1b-d272d64edbbe tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:29.840300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d6c1559-7eb1-45ec-8f1b-d272d64edbbe tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:29.848614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d6c1559-7eb1-45ec-8f1b-d272d64edbbe tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:29.849107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d6c1559-7eb1-45ec-8f1b-d272d64edbbe tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:29.849545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d6c1559-7eb1-45ec-8f1b-d272d64edbbe tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:29.850244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d6c1559-7eb1-45ec-8f1b-d272d64edbbe tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:29.850723 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d6c1559-7eb1-45ec-8f1b-d272d64edbbe tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:29.851319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d6c1559-7eb1-45ec-8f1b-d272d64edbbe tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:29.941901 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-91ed268f-e95a-4937-ab33-738cd38f04c8 req-309489b4-85c6-417e-b4c9-1065581247a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefe8ad6-db69-4013-99c8-0a6427495baf", "name": "network-vif-plugged", "status": "completed", "tag": "c567e761-92a1-43c8-b110-3d4a58c53908"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:29.954175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-91ed268f-e95a-4937-ab33-738cd38f04c8 req-309489b4-85c6-417e-b4c9-1065581247a9 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:29.954655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-91ed268f-e95a-4937-ab33-738cd38f04c8 req-309489b4-85c6-417e-b4c9-1065581247a9 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:29.955320 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-91ed268f-e95a-4937-ab33-738cd38f04c8 req-309489b4-85c6-417e-b4c9-1065581247a9 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:29.966529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-91ed268f-e95a-4937-ab33-738cd38f04c8 req-309489b4-85c6-417e-b4c9-1065581247a9 service nova] Creating event network-vif-plugged:c567e761-92a1-43c8-b110-3d4a58c53908 for instance fefe8ad6-db69-4013-99c8-0a6427495baf on hv-cinder-85506 Aug 31 01:03:29.973714 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-91ed268f-e95a-4937-ab33-738cd38f04c8 req-309489b4-85c6-417e-b4c9-1065581247a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035828 Aug 31 01:03:29.974325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1625/3303] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:03:29.999781 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8d6c1559-7eb1-45ec-8f1b-d272d64edbbe tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:30.007685 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d6c1559-7eb1-45ec-8f1b-d272d64edbbe tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.172568 Aug 31 01:03:30.008262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1679/3304] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:29 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:30.131050 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-719a0689-dba1-4c80-8d17-ce2af2d7dba5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:30.131868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-719a0689-dba1-4c80-8d17-ce2af2d7dba5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:30.138004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-719a0689-dba1-4c80-8d17-ce2af2d7dba5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:30.138484 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-719a0689-dba1-4c80-8d17-ce2af2d7dba5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:30.138920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-719a0689-dba1-4c80-8d17-ce2af2d7dba5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:30.141149 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-719a0689-dba1-4c80-8d17-ce2af2d7dba5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:30.141706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-719a0689-dba1-4c80-8d17-ce2af2d7dba5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:30.145295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-719a0689-dba1-4c80-8d17-ce2af2d7dba5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:30.221208 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-719a0689-dba1-4c80-8d17-ce2af2d7dba5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:30.229049 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-719a0689-dba1-4c80-8d17-ce2af2d7dba5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1311 microversion: 2.1 time: 0.102206 Aug 31 01:03:30.229622 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1626/3305] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:30 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:31.030402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e5d61d3c-b3b9-4571-bb78-67c516a4e1a3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:31.031342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e5d61d3c-b3b9-4571-bb78-67c516a4e1a3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:31.039082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5d61d3c-b3b9-4571-bb78-67c516a4e1a3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:31.039755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5d61d3c-b3b9-4571-bb78-67c516a4e1a3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:31.040322 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5d61d3c-b3b9-4571-bb78-67c516a4e1a3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:31.041157 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5d61d3c-b3b9-4571-bb78-67c516a4e1a3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:31.042277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5d61d3c-b3b9-4571-bb78-67c516a4e1a3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:31.042277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5d61d3c-b3b9-4571-bb78-67c516a4e1a3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:31.220461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e5d61d3c-b3b9-4571-bb78-67c516a4e1a3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:31.233066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e5d61d3c-b3b9-4571-bb78-67c516a4e1a3 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.206492 Aug 31 01:03:31.234306 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1680/3306] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:31 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:31.251228 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-37f1c302-0241-4eb8-a35c-588405fd0157 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:31.251931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-37f1c302-0241-4eb8-a35c-588405fd0157 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:31.260450 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f1c302-0241-4eb8-a35c-588405fd0157 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:31.260934 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f1c302-0241-4eb8-a35c-588405fd0157 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:31.261364 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f1c302-0241-4eb8-a35c-588405fd0157 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:31.262229 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f1c302-0241-4eb8-a35c-588405fd0157 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:31.262683 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f1c302-0241-4eb8-a35c-588405fd0157 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:31.263124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-37f1c302-0241-4eb8-a35c-588405fd0157 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:31.421124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-37f1c302-0241-4eb8-a35c-588405fd0157 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:31.429164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-37f1c302-0241-4eb8-a35c-588405fd0157 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.182837 Aug 31 01:03:31.429784 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1627/3307] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:31 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:32.254051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eedc6b0c-9240-4ec4-85c7-9c7d830bfe41 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:32.254567 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eedc6b0c-9240-4ec4-85c7-9c7d830bfe41 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:32.261239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedc6b0c-9240-4ec4-85c7-9c7d830bfe41 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:32.261732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedc6b0c-9240-4ec4-85c7-9c7d830bfe41 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:32.262171 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedc6b0c-9240-4ec4-85c7-9c7d830bfe41 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:32.262874 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedc6b0c-9240-4ec4-85c7-9c7d830bfe41 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:32.263365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedc6b0c-9240-4ec4-85c7-9c7d830bfe41 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:32.263789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eedc6b0c-9240-4ec4-85c7-9c7d830bfe41 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:32.413778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eedc6b0c-9240-4ec4-85c7-9c7d830bfe41 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:32.422288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eedc6b0c-9240-4ec4-85c7-9c7d830bfe41 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.172229 Aug 31 01:03:32.423186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1681/3308] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:32 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:32.454111 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a7a92aad-1125-4d91-93ca-9a1df7979427 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:32.454643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a7a92aad-1125-4d91-93ca-9a1df7979427 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:32.460716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7a92aad-1125-4d91-93ca-9a1df7979427 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:32.461291 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7a92aad-1125-4d91-93ca-9a1df7979427 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:32.461800 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7a92aad-1125-4d91-93ca-9a1df7979427 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:32.462556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7a92aad-1125-4d91-93ca-9a1df7979427 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:32.463096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7a92aad-1125-4d91-93ca-9a1df7979427 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:32.463585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7a92aad-1125-4d91-93ca-9a1df7979427 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:32.602530 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a7a92aad-1125-4d91-93ca-9a1df7979427 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:32.611391 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a7a92aad-1125-4d91-93ca-9a1df7979427 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.164064 Aug 31 01:03:32.611973 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1628/3309] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:32 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:33.444402 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ac1fd7a7-c32b-4cb6-ba2f-ed065d745f45 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:33.445623 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ac1fd7a7-c32b-4cb6-ba2f-ed065d745f45 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:33.453333 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7a7-c32b-4cb6-ba2f-ed065d745f45 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:33.453900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7a7-c32b-4cb6-ba2f-ed065d745f45 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:33.454343 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7a7-c32b-4cb6-ba2f-ed065d745f45 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:33.455072 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7a7-c32b-4cb6-ba2f-ed065d745f45 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:33.455782 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7a7-c32b-4cb6-ba2f-ed065d745f45 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:33.456277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7a7-c32b-4cb6-ba2f-ed065d745f45 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:33.603929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ac1fd7a7-c32b-4cb6-ba2f-ed065d745f45 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:33.613241 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ac1fd7a7-c32b-4cb6-ba2f-ed065d745f45 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.172615 Aug 31 01:03:33.613824 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1682/3310] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:33 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:33.632850 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6836773c-a1de-4dd9-b1e8-b96f06e854d7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:33.635407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6836773c-a1de-4dd9-b1e8-b96f06e854d7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:33.641094 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6836773c-a1de-4dd9-b1e8-b96f06e854d7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:33.641568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6836773c-a1de-4dd9-b1e8-b96f06e854d7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:33.641996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6836773c-a1de-4dd9-b1e8-b96f06e854d7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:33.642678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6836773c-a1de-4dd9-b1e8-b96f06e854d7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:33.643175 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6836773c-a1de-4dd9-b1e8-b96f06e854d7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:33.643595 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6836773c-a1de-4dd9-b1e8-b96f06e854d7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:33.776847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6836773c-a1de-4dd9-b1e8-b96f06e854d7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:33.785258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6836773c-a1de-4dd9-b1e8-b96f06e854d7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.156227 Aug 31 01:03:33.785835 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1629/3311] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:33 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:34.634976 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-040f5567-e3df-43d4-830f-f806f9ff5a97 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:34.635618 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-040f5567-e3df-43d4-830f-f806f9ff5a97 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:34.646283 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-040f5567-e3df-43d4-830f-f806f9ff5a97 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:34.646806 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-040f5567-e3df-43d4-830f-f806f9ff5a97 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:34.647250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-040f5567-e3df-43d4-830f-f806f9ff5a97 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:34.647982 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-040f5567-e3df-43d4-830f-f806f9ff5a97 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:34.648403 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-040f5567-e3df-43d4-830f-f806f9ff5a97 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:34.649076 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-040f5567-e3df-43d4-830f-f806f9ff5a97 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:34.786546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-040f5567-e3df-43d4-830f-f806f9ff5a97 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:34.794659 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-040f5567-e3df-43d4-830f-f806f9ff5a97 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.163419 Aug 31 01:03:34.795566 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1683/3312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:34 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:34.813518 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a4031641-4d56-469f-8b41-e8b50953f910 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:34.814113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a4031641-4d56-469f-8b41-e8b50953f910 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:34.820802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4031641-4d56-469f-8b41-e8b50953f910 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:34.821436 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4031641-4d56-469f-8b41-e8b50953f910 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:34.821892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4031641-4d56-469f-8b41-e8b50953f910 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:34.822792 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4031641-4d56-469f-8b41-e8b50953f910 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:34.823524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4031641-4d56-469f-8b41-e8b50953f910 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:34.824097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a4031641-4d56-469f-8b41-e8b50953f910 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:34.965017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a4031641-4d56-469f-8b41-e8b50953f910 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:34.975951 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a4031641-4d56-469f-8b41-e8b50953f910 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.174073 Aug 31 01:03:34.976534 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1630/3313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:34 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:35.820887 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8b2bffbe-4d74-45ad-97a2-0db85b7aca8f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:35.821504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8b2bffbe-4d74-45ad-97a2-0db85b7aca8f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:35.830047 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b2bffbe-4d74-45ad-97a2-0db85b7aca8f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:35.830900 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b2bffbe-4d74-45ad-97a2-0db85b7aca8f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:35.831674 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b2bffbe-4d74-45ad-97a2-0db85b7aca8f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:35.832686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b2bffbe-4d74-45ad-97a2-0db85b7aca8f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:35.833234 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b2bffbe-4d74-45ad-97a2-0db85b7aca8f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:35.833703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b2bffbe-4d74-45ad-97a2-0db85b7aca8f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:35.997767 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-09d29ded-974c-4171-ad42-a0dc9090cdf8 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:35.998435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-09d29ded-974c-4171-ad42-a0dc9090cdf8 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:36.005791 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09d29ded-974c-4171-ad42-a0dc9090cdf8 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:36.006287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09d29ded-974c-4171-ad42-a0dc9090cdf8 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:36.006910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09d29ded-974c-4171-ad42-a0dc9090cdf8 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:36.007803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09d29ded-974c-4171-ad42-a0dc9090cdf8 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:36.008426 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09d29ded-974c-4171-ad42-a0dc9090cdf8 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:36.008847 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09d29ded-974c-4171-ad42-a0dc9090cdf8 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:36.017514 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b2bffbe-4d74-45ad-97a2-0db85b7aca8f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:36.027932 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8b2bffbe-4d74-45ad-97a2-0db85b7aca8f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.214477 Aug 31 01:03:36.040499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1684/3314] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:35 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:36.178880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-09d29ded-974c-4171-ad42-a0dc9090cdf8 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:36.187779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-09d29ded-974c-4171-ad42-a0dc9090cdf8 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.194238 Aug 31 01:03:36.188620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1631/3315] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:35 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:37.050512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f18038b3-bcc1-4fd4-a79f-e712fc2d0daf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:37.051180 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f18038b3-bcc1-4fd4-a79f-e712fc2d0daf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:37.057789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f18038b3-bcc1-4fd4-a79f-e712fc2d0daf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:37.058277 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f18038b3-bcc1-4fd4-a79f-e712fc2d0daf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:37.058710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f18038b3-bcc1-4fd4-a79f-e712fc2d0daf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:37.059441 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f18038b3-bcc1-4fd4-a79f-e712fc2d0daf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:37.059899 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f18038b3-bcc1-4fd4-a79f-e712fc2d0daf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:37.060321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f18038b3-bcc1-4fd4-a79f-e712fc2d0daf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:37.065461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:37.202616 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f18038b3-bcc1-4fd4-a79f-e712fc2d0daf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:37.208329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-22aa05ba-fa60-4fac-8281-59289c7428ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:37.209041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-22aa05ba-fa60-4fac-8281-59289c7428ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:37.210523 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f18038b3-bcc1-4fd4-a79f-e712fc2d0daf tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.164370 Aug 31 01:03:37.211103 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1685/3316] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:37 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:37.218205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22aa05ba-fa60-4fac-8281-59289c7428ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:37.218883 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22aa05ba-fa60-4fac-8281-59289c7428ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:37.219770 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22aa05ba-fa60-4fac-8281-59289c7428ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:37.220639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22aa05ba-fa60-4fac-8281-59289c7428ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:37.221100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22aa05ba-fa60-4fac-8281-59289c7428ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:37.221526 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22aa05ba-fa60-4fac-8281-59289c7428ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:37.367724 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-22aa05ba-fa60-4fac-8281-59289c7428ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:37.376891 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-22aa05ba-fa60-4fac-8281-59289c7428ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.172246 Aug 31 01:03:37.377481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1632/3317] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:37 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:03:38.232006 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4b80e05b-ec4b-40cc-b2e7-e4b5507d24e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:38.232597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4b80e05b-ec4b-40cc-b2e7-e4b5507d24e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:38.239715 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b80e05b-ec4b-40cc-b2e7-e4b5507d24e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:38.240197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b80e05b-ec4b-40cc-b2e7-e4b5507d24e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:38.240625 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b80e05b-ec4b-40cc-b2e7-e4b5507d24e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:38.241309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b80e05b-ec4b-40cc-b2e7-e4b5507d24e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:38.241755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b80e05b-ec4b-40cc-b2e7-e4b5507d24e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:38.242170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b80e05b-ec4b-40cc-b2e7-e4b5507d24e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:38.381117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4b80e05b-ec4b-40cc-b2e7-e4b5507d24e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:38.392552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4b80e05b-ec4b-40cc-b2e7-e4b5507d24e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.164243 Aug 31 01:03:38.399140 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1686/3318] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:38 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:38.405497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a1e8d446-1d69-41bc-83f1-550927b4fdaa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:38.406755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a1e8d446-1d69-41bc-83f1-550927b4fdaa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:38.414307 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1e8d446-1d69-41bc-83f1-550927b4fdaa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:38.415404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1e8d446-1d69-41bc-83f1-550927b4fdaa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:38.415404 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1e8d446-1d69-41bc-83f1-550927b4fdaa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:38.416167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1e8d446-1d69-41bc-83f1-550927b4fdaa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:38.416593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1e8d446-1d69-41bc-83f1-550927b4fdaa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:38.417192 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a1e8d446-1d69-41bc-83f1-550927b4fdaa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:38.437213 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:38.556437 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a1e8d446-1d69-41bc-83f1-550927b4fdaa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:38.565597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a1e8d446-1d69-41bc-83f1-550927b4fdaa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.171287 Aug 31 01:03:38.566424 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1633/3319] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:38 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:03:39.419144 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0100cf6d-3f09-41e9-b3cf-ed5232d739ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:39.419894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0100cf6d-3f09-41e9-b3cf-ed5232d739ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:39.422208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:39.423128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=6 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:39.431414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0100cf6d-3f09-41e9-b3cf-ed5232d739ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:39.431964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0100cf6d-3f09-41e9-b3cf-ed5232d739ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:39.432398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0100cf6d-3f09-41e9-b3cf-ed5232d739ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:39.433125 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0100cf6d-3f09-41e9-b3cf-ed5232d739ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:39.433651 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0100cf6d-3f09-41e9-b3cf-ed5232d739ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:39.434134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0100cf6d-3f09-41e9-b3cf-ed5232d739ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:39.571113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0100cf6d-3f09-41e9-b3cf-ed5232d739ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:39.578714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0100cf6d-3f09-41e9-b3cf-ed5232d739ca tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.163616 Aug 31 01:03:39.579301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1687/3320] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:39 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:39.585929 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d8b6faf1-711e-4748-9749-71d4167cf7db tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:39.586636 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d8b6faf1-711e-4748-9749-71d4167cf7db tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:39.588967 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=12 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:39.595317 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8b6faf1-711e-4748-9749-71d4167cf7db tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:39.595809 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8b6faf1-711e-4748-9749-71d4167cf7db tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:39.596249 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8b6faf1-711e-4748-9749-71d4167cf7db tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:39.597117 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8b6faf1-711e-4748-9749-71d4167cf7db tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:39.597580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8b6faf1-711e-4748-9749-71d4167cf7db tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:39.598005 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d8b6faf1-711e-4748-9749-71d4167cf7db tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:39.732584 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d8b6faf1-711e-4748-9749-71d4167cf7db tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:39.740576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d8b6faf1-711e-4748-9749-71d4167cf7db tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.158376 Aug 31 01:03:39.741141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1634/3321] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:39 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:40.601301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-66d563a5-fdcc-497f-9b88-78f637d3d0db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:40.602019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-66d563a5-fdcc-497f-9b88-78f637d3d0db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:40.608378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66d563a5-fdcc-497f-9b88-78f637d3d0db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:40.608911 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66d563a5-fdcc-497f-9b88-78f637d3d0db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:40.609342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66d563a5-fdcc-497f-9b88-78f637d3d0db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:40.610028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66d563a5-fdcc-497f-9b88-78f637d3d0db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:40.610477 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66d563a5-fdcc-497f-9b88-78f637d3d0db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:40.610894 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66d563a5-fdcc-497f-9b88-78f637d3d0db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:40.748676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-66d563a5-fdcc-497f-9b88-78f637d3d0db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:40.757517 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-66d563a5-fdcc-497f-9b88-78f637d3d0db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.159974 Aug 31 01:03:40.758440 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1688/3322] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:40 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:40.768849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-24be3837-ee17-4561-bc8c-a826c367eae7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:40.769884 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-24be3837-ee17-4561-bc8c-a826c367eae7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:40.780188 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24be3837-ee17-4561-bc8c-a826c367eae7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:40.780937 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24be3837-ee17-4561-bc8c-a826c367eae7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:40.781549 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24be3837-ee17-4561-bc8c-a826c367eae7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:40.782464 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24be3837-ee17-4561-bc8c-a826c367eae7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:40.783109 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24be3837-ee17-4561-bc8c-a826c367eae7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:40.783691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24be3837-ee17-4561-bc8c-a826c367eae7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:40.926777 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-24be3837-ee17-4561-bc8c-a826c367eae7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:40.935180 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-24be3837-ee17-4561-bc8c-a826c367eae7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.173590 Aug 31 01:03:40.935759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1635/3323] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:40 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:41.780326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a2cee06c-f12f-40ba-9a86-d580cb1aa845 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:41.781632 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a2cee06c-f12f-40ba-9a86-d580cb1aa845 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:41.788014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2cee06c-f12f-40ba-9a86-d580cb1aa845 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:41.788499 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2cee06c-f12f-40ba-9a86-d580cb1aa845 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:41.788931 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2cee06c-f12f-40ba-9a86-d580cb1aa845 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:41.789619 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2cee06c-f12f-40ba-9a86-d580cb1aa845 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:41.790068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2cee06c-f12f-40ba-9a86-d580cb1aa845 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:41.790489 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a2cee06c-f12f-40ba-9a86-d580cb1aa845 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:41.926158 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a2cee06c-f12f-40ba-9a86-d580cb1aa845 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:41.934037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a2cee06c-f12f-40ba-9a86-d580cb1aa845 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.157621 Aug 31 01:03:41.934606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1689/3324] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:41 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:41.956423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6b1a9d13-ec81-4ea0-ab1d-fd47cb90d734 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:41.957025 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6b1a9d13-ec81-4ea0-ab1d-fd47cb90d734 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:41.963589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a9d13-ec81-4ea0-ab1d-fd47cb90d734 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:41.963998 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a9d13-ec81-4ea0-ab1d-fd47cb90d734 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:41.964428 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a9d13-ec81-4ea0-ab1d-fd47cb90d734 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:41.965105 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a9d13-ec81-4ea0-ab1d-fd47cb90d734 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:41.965551 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a9d13-ec81-4ea0-ab1d-fd47cb90d734 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:41.965976 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b1a9d13-ec81-4ea0-ab1d-fd47cb90d734 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:42.098185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6b1a9d13-ec81-4ea0-ab1d-fd47cb90d734 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:42.105902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6b1a9d13-ec81-4ea0-ab1d-fd47cb90d734 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.153992 Aug 31 01:03:42.106462 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1636/3325] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:41 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:42.955449 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d5721b72-41c7-48d1-842c-c418731056f6 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:42.956704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d5721b72-41c7-48d1-842c-c418731056f6 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:42.962615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5721b72-41c7-48d1-842c-c418731056f6 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:42.963122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5721b72-41c7-48d1-842c-c418731056f6 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:42.963560 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5721b72-41c7-48d1-842c-c418731056f6 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:42.964249 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5721b72-41c7-48d1-842c-c418731056f6 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:42.964698 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5721b72-41c7-48d1-842c-c418731056f6 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:42.965115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5721b72-41c7-48d1-842c-c418731056f6 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:43.098697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d5721b72-41c7-48d1-842c-c418731056f6 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:43.106422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d5721b72-41c7-48d1-842c-c418731056f6 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.155146 Aug 31 01:03:43.106978 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1690/3326] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:42 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:43.127021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d57f43c8-aeff-448d-b531-785e3b75f0eb tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:43.127653 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d57f43c8-aeff-448d-b531-785e3b75f0eb tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:43.134007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d57f43c8-aeff-448d-b531-785e3b75f0eb tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:43.134474 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d57f43c8-aeff-448d-b531-785e3b75f0eb tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:43.134898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d57f43c8-aeff-448d-b531-785e3b75f0eb tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:43.135593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d57f43c8-aeff-448d-b531-785e3b75f0eb tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:43.136034 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d57f43c8-aeff-448d-b531-785e3b75f0eb tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:43.136447 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d57f43c8-aeff-448d-b531-785e3b75f0eb tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:43.268457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d57f43c8-aeff-448d-b531-785e3b75f0eb tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:43.276063 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d57f43c8-aeff-448d-b531-785e3b75f0eb tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.153023 Aug 31 01:03:43.276620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1637/3327] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:43 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:44.128688 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5a50ed59-6552-4dd5-bf26-9b716bee200b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:44.129295 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5a50ed59-6552-4dd5-bf26-9b716bee200b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:44.135755 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a50ed59-6552-4dd5-bf26-9b716bee200b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:44.136237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a50ed59-6552-4dd5-bf26-9b716bee200b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:44.136670 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a50ed59-6552-4dd5-bf26-9b716bee200b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:44.137353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a50ed59-6552-4dd5-bf26-9b716bee200b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:44.137804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a50ed59-6552-4dd5-bf26-9b716bee200b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:44.138219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a50ed59-6552-4dd5-bf26-9b716bee200b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:44.268540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a50ed59-6552-4dd5-bf26-9b716bee200b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:44.276163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5a50ed59-6552-4dd5-bf26-9b716bee200b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.152227 Aug 31 01:03:44.276727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1691/3328] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:44 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:44.297733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c374320-dffb-4ee0-a7a4-304637b810ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:44.298335 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c374320-dffb-4ee0-a7a4-304637b810ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:44.304766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c374320-dffb-4ee0-a7a4-304637b810ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:44.305243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c374320-dffb-4ee0-a7a4-304637b810ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:44.305705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c374320-dffb-4ee0-a7a4-304637b810ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:44.306383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c374320-dffb-4ee0-a7a4-304637b810ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:44.306828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c374320-dffb-4ee0-a7a4-304637b810ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:44.307305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c374320-dffb-4ee0-a7a4-304637b810ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:44.439604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0c374320-dffb-4ee0-a7a4-304637b810ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:44.447162 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c374320-dffb-4ee0-a7a4-304637b810ee tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.153870 Aug 31 01:03:44.447720 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1638/3329] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:44 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:45.297832 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9c53d828-d77b-4ac7-9168-387b31e1e741 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:45.298363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9c53d828-d77b-4ac7-9168-387b31e1e741 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:45.305576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c53d828-d77b-4ac7-9168-387b31e1e741 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:45.306053 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c53d828-d77b-4ac7-9168-387b31e1e741 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:45.306481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c53d828-d77b-4ac7-9168-387b31e1e741 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:45.307189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c53d828-d77b-4ac7-9168-387b31e1e741 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:45.307633 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c53d828-d77b-4ac7-9168-387b31e1e741 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:45.308051 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c53d828-d77b-4ac7-9168-387b31e1e741 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:45.442779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9c53d828-d77b-4ac7-9168-387b31e1e741 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:45.450500 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9c53d828-d77b-4ac7-9168-387b31e1e741 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.156616 Aug 31 01:03:45.451085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1692/3330] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:45 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:45.468092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8afb76f7-28a6-444a-8c4f-7fbd0f0b32f7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:45.469131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8afb76f7-28a6-444a-8c4f-7fbd0f0b32f7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:45.476037 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8afb76f7-28a6-444a-8c4f-7fbd0f0b32f7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:45.476516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8afb76f7-28a6-444a-8c4f-7fbd0f0b32f7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:45.477001 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8afb76f7-28a6-444a-8c4f-7fbd0f0b32f7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:45.477691 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8afb76f7-28a6-444a-8c4f-7fbd0f0b32f7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:45.478143 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8afb76f7-28a6-444a-8c4f-7fbd0f0b32f7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:45.478561 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8afb76f7-28a6-444a-8c4f-7fbd0f0b32f7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:45.602953 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8afb76f7-28a6-444a-8c4f-7fbd0f0b32f7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:45.611219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8afb76f7-28a6-444a-8c4f-7fbd0f0b32f7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.146976 Aug 31 01:03:45.611786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1639/3331] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:45 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:46.472626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c8dd3e25-7444-40b7-9721-beeb610c8378 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:46.473226 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c8dd3e25-7444-40b7-9721-beeb610c8378 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:46.479664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8dd3e25-7444-40b7-9721-beeb610c8378 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:46.480149 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8dd3e25-7444-40b7-9721-beeb610c8378 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:46.480581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8dd3e25-7444-40b7-9721-beeb610c8378 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:46.481269 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8dd3e25-7444-40b7-9721-beeb610c8378 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:46.481722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8dd3e25-7444-40b7-9721-beeb610c8378 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:46.482146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8dd3e25-7444-40b7-9721-beeb610c8378 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:46.613330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c8dd3e25-7444-40b7-9721-beeb610c8378 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:46.620915 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c8dd3e25-7444-40b7-9721-beeb610c8378 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.153054 Aug 31 01:03:46.621472 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1693/3332] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:46 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:46.636593 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-49335a13-e929-4f7d-ab81-c5140347aa85 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:46.637200 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-49335a13-e929-4f7d-ab81-c5140347aa85 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:46.644383 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49335a13-e929-4f7d-ab81-c5140347aa85 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:46.644860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49335a13-e929-4f7d-ab81-c5140347aa85 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:46.645294 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49335a13-e929-4f7d-ab81-c5140347aa85 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:46.645982 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49335a13-e929-4f7d-ab81-c5140347aa85 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:46.646431 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49335a13-e929-4f7d-ab81-c5140347aa85 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:46.646851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-49335a13-e929-4f7d-ab81-c5140347aa85 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:46.770933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-49335a13-e929-4f7d-ab81-c5140347aa85 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:46.778575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-49335a13-e929-4f7d-ab81-c5140347aa85 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.145888 Aug 31 01:03:46.779154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1640/3333] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:46 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:47.642438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6b8d995f-5098-45c7-ad78-f01bba5b397d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:47.644240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6b8d995f-5098-45c7-ad78-f01bba5b397d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:47.649665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b8d995f-5098-45c7-ad78-f01bba5b397d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:47.650147 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b8d995f-5098-45c7-ad78-f01bba5b397d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:47.650582 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b8d995f-5098-45c7-ad78-f01bba5b397d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:47.651302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b8d995f-5098-45c7-ad78-f01bba5b397d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:47.651761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b8d995f-5098-45c7-ad78-f01bba5b397d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:47.652181 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b8d995f-5098-45c7-ad78-f01bba5b397d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:47.785302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6b8d995f-5098-45c7-ad78-f01bba5b397d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:47.793028 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6b8d995f-5098-45c7-ad78-f01bba5b397d tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1365 microversion: 2.1 time: 0.155118 Aug 31 01:03:47.793588 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1694/3334] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:47 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:03:47.799760 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6b812ba5-d170-48be-8cd1-7167446f20e4 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:47.800355 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6b812ba5-d170-48be-8cd1-7167446f20e4 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:47.806658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b812ba5-d170-48be-8cd1-7167446f20e4 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:47.807159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b812ba5-d170-48be-8cd1-7167446f20e4 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:47.807589 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b812ba5-d170-48be-8cd1-7167446f20e4 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:47.808258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b812ba5-d170-48be-8cd1-7167446f20e4 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:47.808700 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b812ba5-d170-48be-8cd1-7167446f20e4 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:47.809112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b812ba5-d170-48be-8cd1-7167446f20e4 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:47.933890 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6b812ba5-d170-48be-8cd1-7167446f20e4 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:47.942275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6b812ba5-d170-48be-8cd1-7167446f20e4 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.146868 Aug 31 01:03:47.942827 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1641/3335] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:47 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:48.815346 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d5c4d352-6749-45e5-9a56-ad83539685de tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:48.815974 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d5c4d352-6749-45e5-9a56-ad83539685de tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:48.819961 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:48.825063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c4d352-6749-45e5-9a56-ad83539685de tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:48.825603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c4d352-6749-45e5-9a56-ad83539685de tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:48.826119 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c4d352-6749-45e5-9a56-ad83539685de tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:48.827238 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c4d352-6749-45e5-9a56-ad83539685de tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:48.827820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c4d352-6749-45e5-9a56-ad83539685de tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:48.828302 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d5c4d352-6749-45e5-9a56-ad83539685de tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:48.964991 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d5c4d352-6749-45e5-9a56-ad83539685de tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:48.965611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-25a20765-4ad1-47d3-b546-6a6fe30bdb11 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:48.966756 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-25a20765-4ad1-47d3-b546-6a6fe30bdb11 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:48.974159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d5c4d352-6749-45e5-9a56-ad83539685de tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1554 microversion: 2.1 time: 0.162752 Aug 31 01:03:48.979916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:48.986701 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25a20765-4ad1-47d3-b546-6a6fe30bdb11 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:48.987386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25a20765-4ad1-47d3-b546-6a6fe30bdb11 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:48.987512 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1695/3336] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:48 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:48.988058 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25a20765-4ad1-47d3-b546-6a6fe30bdb11 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:48.988763 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25a20765-4ad1-47d3-b546-6a6fe30bdb11 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:48.994575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25a20765-4ad1-47d3-b546-6a6fe30bdb11 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:48.995155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25a20765-4ad1-47d3-b546-6a6fe30bdb11 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:48.997546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a6baf3af-1b11-4539-8fa0-f886c4b5b4f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:48.998046 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a6baf3af-1b11-4539-8fa0-f886c4b5b4f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:49.005433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6baf3af-1b11-4539-8fa0-f886c4b5b4f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:49.006297 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6baf3af-1b11-4539-8fa0-f886c4b5b4f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:49.006744 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6baf3af-1b11-4539-8fa0-f886c4b5b4f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:49.007533 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6baf3af-1b11-4539-8fa0-f886c4b5b4f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:49.007997 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6baf3af-1b11-4539-8fa0-f886c4b5b4f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:49.008424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6baf3af-1b11-4539-8fa0-f886c4b5b4f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:49.163439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-25a20765-4ad1-47d3-b546-6a6fe30bdb11 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:49.175085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-25a20765-4ad1-47d3-b546-6a6fe30bdb11 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.214428 Aug 31 01:03:49.176139 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1642/3337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:48 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:03:49.194527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-3d663e81-4cd3-4771-90c5-5658bab7d604 req-3543d66e-5416-4adf-a845-181c3e73afca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fe26d4-97c7-4a19-84d8-e043abbce608", "tag": "ee7cf7b9-05d2-4b75-84e8-032c61e63776"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:49.209860 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3d663e81-4cd3-4771-90c5-5658bab7d604 req-3543d66e-5416-4adf-a845-181c3e73afca service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:49.210588 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3d663e81-4cd3-4771-90c5-5658bab7d604 req-3543d66e-5416-4adf-a845-181c3e73afca service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:49.211240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-3d663e81-4cd3-4771-90c5-5658bab7d604 req-3543d66e-5416-4adf-a845-181c3e73afca service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:49.223808 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-3d663e81-4cd3-4771-90c5-5658bab7d604 req-3543d66e-5416-4adf-a845-181c3e73afca service nova] Creating event network-changed:ee7cf7b9-05d2-4b75-84e8-032c61e63776 for instance e3fe26d4-97c7-4a19-84d8-e043abbce608 on hv-cinder-85506 Aug 31 01:03:49.229026 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-3d663e81-4cd3-4771-90c5-5658bab7d604 req-3543d66e-5416-4adf-a845-181c3e73afca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038630 Aug 31 01:03:49.230374 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1643/3338] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:49.261532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a6baf3af-1b11-4539-8fa0-f886c4b5b4f1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.268902 Aug 31 01:03:49.262148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1696/3339] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 31 01:03:48 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-interface => generated 284 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:50.196802 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-263774a8-6248-4bf4-816e-d9c3de109ddc tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:50.197461 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-263774a8-6248-4bf4-816e-d9c3de109ddc tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:50.204240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263774a8-6248-4bf4-816e-d9c3de109ddc tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:50.204977 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263774a8-6248-4bf4-816e-d9c3de109ddc tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:50.205409 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263774a8-6248-4bf4-816e-d9c3de109ddc tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:50.206122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263774a8-6248-4bf4-816e-d9c3de109ddc tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:50.206796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263774a8-6248-4bf4-816e-d9c3de109ddc tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:50.207250 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-263774a8-6248-4bf4-816e-d9c3de109ddc tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:50.244605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-b5e6f58c-18bd-4a1f-b02c-8f75f9af9c3a req-fbea4471-92d4-40f3-89d5-e2797117bba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefe8ad6-db69-4013-99c8-0a6427495baf", "tag": "c567e761-92a1-43c8-b110-3d4a58c53908"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:50.256159 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b5e6f58c-18bd-4a1f-b02c-8f75f9af9c3a req-fbea4471-92d4-40f3-89d5-e2797117bba0 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:50.256902 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b5e6f58c-18bd-4a1f-b02c-8f75f9af9c3a req-fbea4471-92d4-40f3-89d5-e2797117bba0 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:50.257493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b5e6f58c-18bd-4a1f-b02c-8f75f9af9c3a req-fbea4471-92d4-40f3-89d5-e2797117bba0 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:50.268757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-b5e6f58c-18bd-4a1f-b02c-8f75f9af9c3a req-fbea4471-92d4-40f3-89d5-e2797117bba0 service nova] Creating event network-changed:c567e761-92a1-43c8-b110-3d4a58c53908 for instance fefe8ad6-db69-4013-99c8-0a6427495baf on hv-cinder-85506 Aug 31 01:03:50.274787 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-b5e6f58c-18bd-4a1f-b02c-8f75f9af9c3a req-fbea4471-92d4-40f3-89d5-e2797117bba0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093746 Aug 31 01:03:50.275419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1644/3340] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:50.345540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-263774a8-6248-4bf4-816e-d9c3de109ddc tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:50.353143 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-263774a8-6248-4bf4-816e-d9c3de109ddc tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.160838 Aug 31 01:03:50.353719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1697/3341] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:50 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:51.376399 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ddc0897e-316b-4391-b6f4-98f061489641 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:51.377087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ddc0897e-316b-4391-b6f4-98f061489641 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:51.383246 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddc0897e-316b-4391-b6f4-98f061489641 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:51.383709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddc0897e-316b-4391-b6f4-98f061489641 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:51.384135 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddc0897e-316b-4391-b6f4-98f061489641 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:51.384802 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddc0897e-316b-4391-b6f4-98f061489641 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:51.385275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddc0897e-316b-4391-b6f4-98f061489641 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:51.385685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddc0897e-316b-4391-b6f4-98f061489641 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:51.531730 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ddc0897e-316b-4391-b6f4-98f061489641 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:51.539264 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ddc0897e-316b-4391-b6f4-98f061489641 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.169074 Aug 31 01:03:51.539816 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1645/3342] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:51 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:52.560846 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9308edd4-2000-442a-afae-c3842b1abf5c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:52.561464 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9308edd4-2000-442a-afae-c3842b1abf5c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:52.568989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308edd4-2000-442a-afae-c3842b1abf5c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:52.569808 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308edd4-2000-442a-afae-c3842b1abf5c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:52.570486 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308edd4-2000-442a-afae-c3842b1abf5c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:52.571426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308edd4-2000-442a-afae-c3842b1abf5c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:52.572092 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308edd4-2000-442a-afae-c3842b1abf5c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:52.572742 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9308edd4-2000-442a-afae-c3842b1abf5c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:52.806122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9308edd4-2000-442a-afae-c3842b1abf5c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:52.814751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9308edd4-2000-442a-afae-c3842b1abf5c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.257668 Aug 31 01:03:52.815369 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1698/3343] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:52 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:53.836097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1058f8a7-d5f9-4ac3-ab4b-abd173bea92d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:53.838153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1058f8a7-d5f9-4ac3-ab4b-abd173bea92d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:53.846676 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1058f8a7-d5f9-4ac3-ab4b-abd173bea92d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:53.847210 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1058f8a7-d5f9-4ac3-ab4b-abd173bea92d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:53.847651 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1058f8a7-d5f9-4ac3-ab4b-abd173bea92d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:53.848981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1058f8a7-d5f9-4ac3-ab4b-abd173bea92d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:53.849510 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1058f8a7-d5f9-4ac3-ab4b-abd173bea92d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:53.849938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1058f8a7-d5f9-4ac3-ab4b-abd173bea92d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:53.989545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1058f8a7-d5f9-4ac3-ab4b-abd173bea92d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:53.998548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1058f8a7-d5f9-4ac3-ab4b-abd173bea92d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.166221 Aug 31 01:03:53.999255 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1646/3344] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:53 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:03:55.019859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-52613a61-673d-42ca-bb6c-f0a3bdd1e26a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:55.020454 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-52613a61-673d-42ca-bb6c-f0a3bdd1e26a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:55.026817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52613a61-673d-42ca-bb6c-f0a3bdd1e26a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:55.027326 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52613a61-673d-42ca-bb6c-f0a3bdd1e26a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:55.027753 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52613a61-673d-42ca-bb6c-f0a3bdd1e26a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:55.028435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52613a61-673d-42ca-bb6c-f0a3bdd1e26a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:55.028873 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52613a61-673d-42ca-bb6c-f0a3bdd1e26a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:55.029288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-52613a61-673d-42ca-bb6c-f0a3bdd1e26a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:55.158374 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-52613a61-673d-42ca-bb6c-f0a3bdd1e26a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:55.166106 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-52613a61-673d-42ca-bb6c-f0a3bdd1e26a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.150045 Aug 31 01:03:55.166666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1699/3345] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:55 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:56.035390 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-032964a5-51ab-4f57-be32-7e439788bbaf req-891d9eb2-1338-44b6-ad3e-301a7713ff27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fe26d4-97c7-4a19-84d8-e043abbce608", "name": "network-vif-plugged", "status": "completed", "tag": "ee7cf7b9-05d2-4b75-84e8-032c61e63776"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:03:56.044886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-032964a5-51ab-4f57-be32-7e439788bbaf req-891d9eb2-1338-44b6-ad3e-301a7713ff27 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:56.045358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-032964a5-51ab-4f57-be32-7e439788bbaf req-891d9eb2-1338-44b6-ad3e-301a7713ff27 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:56.045780 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-032964a5-51ab-4f57-be32-7e439788bbaf req-891d9eb2-1338-44b6-ad3e-301a7713ff27 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:56.057486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-032964a5-51ab-4f57-be32-7e439788bbaf req-891d9eb2-1338-44b6-ad3e-301a7713ff27 service nova] Creating event network-vif-plugged:ee7cf7b9-05d2-4b75-84e8-032c61e63776 for instance e3fe26d4-97c7-4a19-84d8-e043abbce608 on hv-cinder-85506 Aug 31 01:03:56.062924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-032964a5-51ab-4f57-be32-7e439788bbaf req-891d9eb2-1338-44b6-ad3e-301a7713ff27 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089860 Aug 31 01:03:56.063576 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1647/3346] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:56.185892 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-88865509-0200-4d06-a0be-4e6776db4e87 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:56.186526 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-88865509-0200-4d06-a0be-4e6776db4e87 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:56.194030 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88865509-0200-4d06-a0be-4e6776db4e87 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:56.194432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88865509-0200-4d06-a0be-4e6776db4e87 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:56.194907 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88865509-0200-4d06-a0be-4e6776db4e87 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:56.195643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88865509-0200-4d06-a0be-4e6776db4e87 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:56.196133 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88865509-0200-4d06-a0be-4e6776db4e87 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:56.196591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88865509-0200-4d06-a0be-4e6776db4e87 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:56.642321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-88865509-0200-4d06-a0be-4e6776db4e87 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:56.649964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-88865509-0200-4d06-a0be-4e6776db4e87 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.467931 Aug 31 01:03:56.650529 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1700/3347] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:56 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:57.673205 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3aed5ea4-36dd-4cce-b601-ce0c7fdaaf3a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:57.673896 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3aed5ea4-36dd-4cce-b601-ce0c7fdaaf3a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:57.680261 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3aed5ea4-36dd-4cce-b601-ce0c7fdaaf3a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:57.680735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3aed5ea4-36dd-4cce-b601-ce0c7fdaaf3a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:57.681164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3aed5ea4-36dd-4cce-b601-ce0c7fdaaf3a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:57.681844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3aed5ea4-36dd-4cce-b601-ce0c7fdaaf3a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:57.682292 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3aed5ea4-36dd-4cce-b601-ce0c7fdaaf3a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:57.682711 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3aed5ea4-36dd-4cce-b601-ce0c7fdaaf3a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:57.813498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3aed5ea4-36dd-4cce-b601-ce0c7fdaaf3a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:57.821164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3aed5ea4-36dd-4cce-b601-ce0c7fdaaf3a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1359 microversion: 2.1 time: 0.153055 Aug 31 01:03:57.821721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1648/3348] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:57 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:03:58.841804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-53f29401-6d33-48d4-9aeb-3a3a3a45716b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:58.842408 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-53f29401-6d33-48d4-9aeb-3a3a3a45716b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:58.849656 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53f29401-6d33-48d4-9aeb-3a3a3a45716b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:58.850152 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53f29401-6d33-48d4-9aeb-3a3a3a45716b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:58.850564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53f29401-6d33-48d4-9aeb-3a3a3a45716b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:58.851272 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53f29401-6d33-48d4-9aeb-3a3a3a45716b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:58.851772 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53f29401-6d33-48d4-9aeb-3a3a3a45716b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:58.852142 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53f29401-6d33-48d4-9aeb-3a3a3a45716b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:58.980436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-53f29401-6d33-48d4-9aeb-3a3a3a45716b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:58.988189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-53f29401-6d33-48d4-9aeb-3a3a3a45716b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1549 microversion: 2.1 time: 0.150267 Aug 31 01:03:58.988758 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1701/3349] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:58 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:59.008768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bb666865-8613-49f0-a72e-caa0dbc257f3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:59.009829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bb666865-8613-49f0-a72e-caa0dbc257f3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:59.017634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb666865-8613-49f0-a72e-caa0dbc257f3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:59.018113 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb666865-8613-49f0-a72e-caa0dbc257f3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:59.018547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb666865-8613-49f0-a72e-caa0dbc257f3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:59.019273 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb666865-8613-49f0-a72e-caa0dbc257f3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:59.019726 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb666865-8613-49f0-a72e-caa0dbc257f3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:59.020148 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb666865-8613-49f0-a72e-caa0dbc257f3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:59.148795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bb666865-8613-49f0-a72e-caa0dbc257f3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:59.157305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bb666865-8613-49f0-a72e-caa0dbc257f3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1549 microversion: 2.1 time: 0.152411 Aug 31 01:03:59.157866 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1649/3350] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:59 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:03:59.177264 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:59.182117 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:59.182779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Searching by: {'deleted': False, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2'} {{(pid=126975) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 01:03:59.189987 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:59.190460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:59.190889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:59.191621 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:59.192067 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:59.192484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:59.261042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:03:59.281713 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.multi_cell_list [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126975) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 01:03:59.376068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7624c52a-1fd2-482b-ae58-49c4d117842b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202444 Aug 31 01:03:59.376695 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1702/3351] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 31 01:03:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:03:59.387821 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-176c32ee-8d77-40f4-b9db-023cd8155955 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:03:59.388423 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-176c32ee-8d77-40f4-b9db-023cd8155955 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:03:59.394533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-176c32ee-8d77-40f4-b9db-023cd8155955 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:59.395009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-176c32ee-8d77-40f4-b9db-023cd8155955 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:59.395480 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-176c32ee-8d77-40f4-b9db-023cd8155955 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:59.396153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-176c32ee-8d77-40f4-b9db-023cd8155955 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:03:59.396599 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-176c32ee-8d77-40f4-b9db-023cd8155955 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:03:59.397016 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-176c32ee-8d77-40f4-b9db-023cd8155955 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:03:59.527543 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-176c32ee-8d77-40f4-b9db-023cd8155955 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:03:59.535067 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-176c32ee-8d77-40f4-b9db-023cd8155955 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1549 microversion: 2.1 time: 0.150985 Aug 31 01:03:59.535631 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1650/3352] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:03:59 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:04:01.080421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d2aae3b3-46d5-499c-91cd-3cf8bba6084a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f372405e-ddf2-48d9-a28f-ab470ec2145d"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:04:01.082735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d2aae3b3-46d5-499c-91cd-3cf8bba6084a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:04:01.092593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2aae3b3-46d5-499c-91cd-3cf8bba6084a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:01.093630 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2aae3b3-46d5-499c-91cd-3cf8bba6084a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:01.094063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2aae3b3-46d5-499c-91cd-3cf8bba6084a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:01.095254 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2aae3b3-46d5-499c-91cd-3cf8bba6084a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:01.095718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2aae3b3-46d5-499c-91cd-3cf8bba6084a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:01.096118 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d2aae3b3-46d5-499c-91cd-3cf8bba6084a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:01.362648 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d2aae3b3-46d5-499c-91cd-3cf8bba6084a tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "POST /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286061 Aug 31 01:04:01.363341 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1703/3353] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 01:04:01 2022] POST /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:04:08.947568 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9d13fef0-bdfb-41a0-acc7-5a8350ad8c1f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:04:08.948225 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9d13fef0-bdfb-41a0-acc7-5a8350ad8c1f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:04:08.954952 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d13fef0-bdfb-41a0-acc7-5a8350ad8c1f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:08.955451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d13fef0-bdfb-41a0-acc7-5a8350ad8c1f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:08.955878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d13fef0-bdfb-41a0-acc7-5a8350ad8c1f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:08.956548 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d13fef0-bdfb-41a0-acc7-5a8350ad8c1f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:08.956989 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d13fef0-bdfb-41a0-acc7-5a8350ad8c1f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:08.957401 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d13fef0-bdfb-41a0-acc7-5a8350ad8c1f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:08.960078 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=94 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:09.135365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9d13fef0-bdfb-41a0-acc7-5a8350ad8c1f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:04:09.144274 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9d13fef0-bdfb-41a0-acc7-5a8350ad8c1f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1595 microversion: 2.1 time: 0.200437 Aug 31 01:04:09.144837 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1651/3354] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:04:08 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1595 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:04:10.796914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:10.801190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-ee031f9c-3c5d-4a70-b0d4-f625bda70f8a req-f1a8521f-ecdf-4943-93e5-87f2b45bc06e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fe26d4-97c7-4a19-84d8-e043abbce608", "tag": "ee7cf7b9-05d2-4b75-84e8-032c61e63776"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:04:10.811065 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-ee031f9c-3c5d-4a70-b0d4-f625bda70f8a req-f1a8521f-ecdf-4943-93e5-87f2b45bc06e service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:10.812136 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-ee031f9c-3c5d-4a70-b0d4-f625bda70f8a req-f1a8521f-ecdf-4943-93e5-87f2b45bc06e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:10.812993 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-ee031f9c-3c5d-4a70-b0d4-f625bda70f8a req-f1a8521f-ecdf-4943-93e5-87f2b45bc06e service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:10.824334 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-ee031f9c-3c5d-4a70-b0d4-f625bda70f8a req-f1a8521f-ecdf-4943-93e5-87f2b45bc06e service nova] Creating event network-changed:ee7cf7b9-05d2-4b75-84e8-032c61e63776 for instance e3fe26d4-97c7-4a19-84d8-e043abbce608 on hv-cinder-85506 Aug 31 01:04:10.830738 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-ee031f9c-3c5d-4a70-b0d4-f625bda70f8a req-f1a8521f-ecdf-4943-93e5-87f2b45bc06e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035181 Aug 31 01:04:10.831754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1704/3355] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:04:11.831358 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-63089bde-84a9-47c4-a77c-ed68ee6d11a2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1447797905"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:04:11.832073 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-63089bde-84a9-47c4-a77c-ed68ee6d11a2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:04:11.838446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63089bde-84a9-47c4-a77c-ed68ee6d11a2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:11.838931 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63089bde-84a9-47c4-a77c-ed68ee6d11a2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:11.839398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63089bde-84a9-47c4-a77c-ed68ee6d11a2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:11.840085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63089bde-84a9-47c4-a77c-ed68ee6d11a2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:11.840572 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63089bde-84a9-47c4-a77c-ed68ee6d11a2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:11.840995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63089bde-84a9-47c4-a77c-ed68ee6d11a2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:11.979912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.network.security_group_api [None req-63089bde-84a9-47c4-a77c-ed68ee6d11a2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Adding security group 3cba5d1c-e806-43a8-8e34-c10072610d5a to port ee7cf7b9-05d2-4b75-84e8-032c61e63776 Aug 31 01:04:12.311181 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-63089bde-84a9-47c4-a77c-ed68ee6d11a2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "POST /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/action" status: 202 len: 0 microversion: 2.1 time: 0.484378 Aug 31 01:04:12.312305 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1652/3356] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 01:04:11 2022] POST /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:04:12.321355 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-480c2a90-9f00-44e7-b7a8-ae3ba2e3340d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:04:12.322035 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-480c2a90-9f00-44e7-b7a8-ae3ba2e3340d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:04:12.328760 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480c2a90-9f00-44e7-b7a8-ae3ba2e3340d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:12.329239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480c2a90-9f00-44e7-b7a8-ae3ba2e3340d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:12.329665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480c2a90-9f00-44e7-b7a8-ae3ba2e3340d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:12.330349 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480c2a90-9f00-44e7-b7a8-ae3ba2e3340d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:12.330799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480c2a90-9f00-44e7-b7a8-ae3ba2e3340d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:12.331237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-480c2a90-9f00-44e7-b7a8-ae3ba2e3340d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:12.532080 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-480c2a90-9f00-44e7-b7a8-ae3ba2e3340d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:04:12.540411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-480c2a90-9f00-44e7-b7a8-ae3ba2e3340d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1761 microversion: 2.1 time: 0.223746 Aug 31 01:04:12.541301 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1705/3357] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:04:12 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1761 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:04:12.846713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-7a01c529-1732-40dd-b2a1-01941f264056 req-e55fd438-c603-4027-957c-0e4cad9868ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fe26d4-97c7-4a19-84d8-e043abbce608", "tag": "ee7cf7b9-05d2-4b75-84e8-032c61e63776"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:04:12.856195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7a01c529-1732-40dd-b2a1-01941f264056 req-e55fd438-c603-4027-957c-0e4cad9868ff service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:12.856673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7a01c529-1732-40dd-b2a1-01941f264056 req-e55fd438-c603-4027-957c-0e4cad9868ff service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:12.857098 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7a01c529-1732-40dd-b2a1-01941f264056 req-e55fd438-c603-4027-957c-0e4cad9868ff service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:12.869097 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-7a01c529-1732-40dd-b2a1-01941f264056 req-e55fd438-c603-4027-957c-0e4cad9868ff service nova] Creating event network-changed:ee7cf7b9-05d2-4b75-84e8-032c61e63776 for instance e3fe26d4-97c7-4a19-84d8-e043abbce608 on hv-cinder-85506 Aug 31 01:04:12.874454 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-7a01c529-1732-40dd-b2a1-01941f264056 req-e55fd438-c603-4027-957c-0e4cad9868ff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032660 Aug 31 01:04:12.875268 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1653/3358] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:04:39.646460 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-660c3583-eb10-4894-a34e-68c308dfbcd1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:04:39.647063 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-660c3583-eb10-4894-a34e-68c308dfbcd1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:04:39.649164 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-7e752f74-8ca8-4f61-9b4f-237ecddcfca2 req-e148f3c9-11ea-48f4-8182-0d876417bfa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4dd3781-9c72-4d8d-9cd8-114d0aead4db", "tag": "28bd9e08-7e14-43fc-9b70-0737bc3a18e9"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:04:39.649624 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=21 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:39.650641 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:39.658330 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-660c3583-eb10-4894-a34e-68c308dfbcd1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:39.659383 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-660c3583-eb10-4894-a34e-68c308dfbcd1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:39.659914 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-660c3583-eb10-4894-a34e-68c308dfbcd1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:39.660818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-660c3583-eb10-4894-a34e-68c308dfbcd1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:39.661037 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-660c3583-eb10-4894-a34e-68c308dfbcd1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:39.661465 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-660c3583-eb10-4894-a34e-68c308dfbcd1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:39.663104 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=23 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:39.663887 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=11 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:04:39.667531 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7e752f74-8ca8-4f61-9b4f-237ecddcfca2 req-e148f3c9-11ea-48f4-8182-0d876417bfa3 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:39.668055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7e752f74-8ca8-4f61-9b4f-237ecddcfca2 req-e148f3c9-11ea-48f4-8182-0d876417bfa3 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:39.668492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-7e752f74-8ca8-4f61-9b4f-237ecddcfca2 req-e148f3c9-11ea-48f4-8182-0d876417bfa3 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:39.683133 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-7e752f74-8ca8-4f61-9b4f-237ecddcfca2 req-e148f3c9-11ea-48f4-8182-0d876417bfa3 service nova] Creating event network-changed:28bd9e08-7e14-43fc-9b70-0737bc3a18e9 for instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db on hv-cinder-85506 Aug 31 01:04:39.688569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-7e752f74-8ca8-4f61-9b4f-237ecddcfca2 req-e148f3c9-11ea-48f4-8182-0d876417bfa3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043583 Aug 31 01:04:39.689434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1654/3359] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:04:39.689857 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-660c3583-eb10-4894-a34e-68c308dfbcd1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:04:39.783312 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-660c3583-eb10-4894-a34e-68c308dfbcd1 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 204 len: 0 microversion: 2.1 time: 0.140320 Aug 31 01:04:39.784135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1706/3360] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:04:39 2022] DELETE /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 01:04:39.792910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-12e589c5-9df8-4b89-8a57-caa6fd6f169e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:04:39.793635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-12e589c5-9df8-4b89-8a57-caa6fd6f169e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:04:39.800685 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12e589c5-9df8-4b89-8a57-caa6fd6f169e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:39.801167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12e589c5-9df8-4b89-8a57-caa6fd6f169e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:39.801605 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12e589c5-9df8-4b89-8a57-caa6fd6f169e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:39.802287 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12e589c5-9df8-4b89-8a57-caa6fd6f169e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:39.802731 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12e589c5-9df8-4b89-8a57-caa6fd6f169e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:39.803185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12e589c5-9df8-4b89-8a57-caa6fd6f169e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:40.194768 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-12e589c5-9df8-4b89-8a57-caa6fd6f169e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:04:40.202903 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-12e589c5-9df8-4b89-8a57-caa6fd6f169e tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.414377 Aug 31 01:04:40.203991 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1655/3361] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:04:39 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:04:41.224814 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c0cac139-8b35-461c-a6c1-f2c34d7f2ed8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:04:41.225498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c0cac139-8b35-461c-a6c1-f2c34d7f2ed8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:04:41.231714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0cac139-8b35-461c-a6c1-f2c34d7f2ed8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:41.232186 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0cac139-8b35-461c-a6c1-f2c34d7f2ed8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:41.232606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0cac139-8b35-461c-a6c1-f2c34d7f2ed8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:41.233270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0cac139-8b35-461c-a6c1-f2c34d7f2ed8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:41.233710 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0cac139-8b35-461c-a6c1-f2c34d7f2ed8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:41.234756 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0cac139-8b35-461c-a6c1-f2c34d7f2ed8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:41.369666 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c0cac139-8b35-461c-a6c1-f2c34d7f2ed8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:04:41.378038 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c0cac139-8b35-461c-a6c1-f2c34d7f2ed8 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1568 microversion: 2.1 time: 0.157452 Aug 31 01:04:41.378608 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1707/3362] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:04:41 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:04:42.161690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-a64242f0-95e8-4a43-816e-347d61bf0ca5 req-c77bae74-0bf7-4ebb-9c35-10e5b983d4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dd3781-9c72-4d8d-9cd8-114d0aead4db", "name": "network-vif-deleted", "tag": "28bd9e08-7e14-43fc-9b70-0737bc3a18e9"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:04:42.171968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-a64242f0-95e8-4a43-816e-347d61bf0ca5 req-c77bae74-0bf7-4ebb-9c35-10e5b983d4f3 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:42.172444 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-a64242f0-95e8-4a43-816e-347d61bf0ca5 req-c77bae74-0bf7-4ebb-9c35-10e5b983d4f3 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:42.172864 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-a64242f0-95e8-4a43-816e-347d61bf0ca5 req-c77bae74-0bf7-4ebb-9c35-10e5b983d4f3 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:42.184733 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-a64242f0-95e8-4a43-816e-347d61bf0ca5 req-c77bae74-0bf7-4ebb-9c35-10e5b983d4f3 service nova] Creating event network-vif-deleted:28bd9e08-7e14-43fc-9b70-0737bc3a18e9 for instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db on hv-cinder-85506 Aug 31 01:04:42.190639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-a64242f0-95e8-4a43-816e-347d61bf0ca5 req-c77bae74-0bf7-4ebb-9c35-10e5b983d4f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032602 Aug 31 01:04:42.191473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1656/3363] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:04:42.402287 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-94d4ddef-0a70-4405-b423-7954b17e2cfb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:04:42.402852 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-94d4ddef-0a70-4405-b423-7954b17e2cfb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:04:42.409590 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94d4ddef-0a70-4405-b423-7954b17e2cfb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:42.410064 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94d4ddef-0a70-4405-b423-7954b17e2cfb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:42.410490 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94d4ddef-0a70-4405-b423-7954b17e2cfb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:42.411201 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94d4ddef-0a70-4405-b423-7954b17e2cfb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:42.411650 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94d4ddef-0a70-4405-b423-7954b17e2cfb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:42.412068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-94d4ddef-0a70-4405-b423-7954b17e2cfb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:42.477551 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-94d4ddef-0a70-4405-b423-7954b17e2cfb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69d5ca56a8e43ca9d91920684f2dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fdc920045d4fabac1e51adb944ff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:04:42.486492 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-94d4ddef-0a70-4405-b423-7954b17e2cfb tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 200 len: 1219 microversion: 2.1 time: 0.088021 Aug 31 01:04:42.487091 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1708/3364] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:04:42 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:04:43.508417 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:04:43.509088 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] [instance: e4dd3781-9c72-4d8d-9cd8-114d0aead4db] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:04:43.515489 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:43.516009 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:43.516446 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:43.517131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:04:43.517585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:04:43.518013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:04:43.532482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] HTTP exception thrown: Instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db could not be found. Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Request method failure captured: Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db HTTP/1.1 Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrItfWeacws2uI9FJjonHVE5ETv9aEDd2E8XomxMzMzxSl7r-hH1hVd9tHbaNluecDXLvsyD31VSvplh2EOpIA0Ql5QVYaU_ra2kkgg4xLwZOWXIp77lbACEE1o0Q-BEGIJOSe4M7CiLWxNHXULYnZ5aLqeryQanaNo_-AULYwdGQac Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: e5fdc920045d4fabac1e51adb944ff3f Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-TestShelveInstance-372888086 Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:04:43.533486 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e5fdc920045d4fabac1e51adb944ff3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e5fdc920045d4fabac1e51adb944ff3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e5fdc920045d4fabac1e51adb944ff3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e5fdc920045d4fabac1e51adb944ff3f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-TestShelveInstance-372888086 Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: e5fdc920045d4fabac1e51adb944ff3f Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-TestShelveInstance-372888086 Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-TestShelveInstance-372888086-project Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: d69d5ca56a8e43ca9d91920684f2dac8 Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-TestShelveInstance-372888086-project Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db could not be found. Aug 31 01:04:43.534971 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'e4dd3781-9c72-4d8d-9cd8-114d0aead4db'} Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db could not be found. Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:04:43.535939 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db could not be found. Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db could not be found. Aug 31 01:04:43.537375 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:04:43.538772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Returning 404 to user: Instance e4dd3781-9c72-4d8d-9cd8-114d0aead4db could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:04:43.538772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3efe016a-e5d4-4ffe-a5f0-72437c6767d7 tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db" status: 404 len: 111 microversion: 2.1 time: 0.031151 Aug 31 01:04:43.538772 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1657/3365] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:04:43 2022] GET /compute/v2.1/servers/e4dd3781-9c72-4d8d-9cd8-114d0aead4db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:04:43.696187 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ebdefc03-47bc-4e2d-9b17-27af5c00a03b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] Calling method '.version_select at 0x7fa7f7711b80>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:04:43.722568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ebdefc03-47bc-4e2d-9b17-27af5c00a03b tempest-TestShelveInstance-372888086 tempest-TestShelveInstance-372888086-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1983975222" status: 202 len: 0 microversion: 2.1 time: 0.030312 Aug 31 01:04:43.723426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1709/3366] 10.222.0.67 () {58 vars in 1254 bytes} [Wed Aug 31 01:04:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1983975222 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:05:02.063661 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bc4ec3f7-13f8-4e8c-9b8b-149851f23748 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:02.064315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bc4ec3f7-13f8-4e8c-9b8b-149851f23748 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:02.066810 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=8 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:02.067460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=12 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:02.072894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc4ec3f7-13f8-4e8c-9b8b-149851f23748 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:02.073365 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc4ec3f7-13f8-4e8c-9b8b-149851f23748 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:02.073788 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc4ec3f7-13f8-4e8c-9b8b-149851f23748 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:02.074460 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc4ec3f7-13f8-4e8c-9b8b-149851f23748 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:02.074905 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc4ec3f7-13f8-4e8c-9b8b-149851f23748 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:02.075341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc4ec3f7-13f8-4e8c-9b8b-149851f23748 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:02.100154 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bc4ec3f7-13f8-4e8c-9b8b-149851f23748 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/ips" status: 200 len: 148 microversion: 2.1 time: 0.040903 Aug 31 01:05:02.100716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1658/3367] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 31 01:05:02 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:05:03.420565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:03.421300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:03.426170 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ca3182ce-ae61-452a-ab4e-79ef88946fbd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a14d177-e89f-4ea6-96b8-86598f44afd8"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:05:03.428435 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ca3182ce-ae61-452a-ab4e-79ef88946fbd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:03.436933 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3182ce-ae61-452a-ab4e-79ef88946fbd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:03.437410 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3182ce-ae61-452a-ab4e-79ef88946fbd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:03.438420 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3182ce-ae61-452a-ab4e-79ef88946fbd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:03.439260 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3182ce-ae61-452a-ab4e-79ef88946fbd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:03.439705 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3182ce-ae61-452a-ab4e-79ef88946fbd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:03.440122 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca3182ce-ae61-452a-ab4e-79ef88946fbd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:03.708655 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ca3182ce-ae61-452a-ab4e-79ef88946fbd tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289321 Aug 31 01:05:03.709365 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1710/3368] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 01:05:03 2022] POST /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:05:11.245036 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a14d177-e89f-4ea6-96b8-86598f44afd8"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:05:11.247306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:11.253838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:11.254318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:11.254749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:11.255458 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:11.255907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:11.256327 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:11.338984 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Invalid volume: volume 0a14d177-e89f-4ea6-96b8-86598f44afd8 is already attached to instances: fefe8ad6-db69-4013-99c8-0a6427495baf Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: POST /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments HTTP/1.1 Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 74 Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:05:11.340616 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {"volumeAttachment": {"volumeId": "0a14d177-e89f-4ea6-96b8-86598f44afd8"}} Aug 31 01:05:11.342074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Invalid volume: volume 0a14d177-e89f-4ea6-96b8-86598f44afd8 is already attached to instances: fefe8ad6-db69-4013-99c8-0a6427495baf Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': 'fefe8ad6-db69-4013-99c8-0a6427495baf', 'body': {'volumeAttachment': {'volumeId': '0a14d177-e89f-4ea6-96b8-86598f44afd8'}}} Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0a14d177-e89f-4ea6-96b8-86598f44afd8 is already attached to instances: fefe8ad6-db69-4013-99c8-0a6427495baf Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:05:11.342898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0a14d177-e89f-4ea6-96b8-86598f44afd8 is already attached to instances: fefe8ad6-db69-4013-99c8-0a6427495baf Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:05:11.345048 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:05:11.346590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:05:11.346590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:05:11.346590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:05:11.346590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0a14d177-e89f-4ea6-96b8-86598f44afd8 is already attached to instances: fefe8ad6-db69-4013-99c8-0a6427495baf Aug 31 01:05:11.346590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:05:11.346590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 400 to user: Invalid volume: volume 0a14d177-e89f-4ea6-96b8-86598f44afd8 is already attached to instances: fefe8ad6-db69-4013-99c8-0a6427495baf {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:05:11.346590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-88fbd452-504a-420f-beec-3269a7204436 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101081 Aug 31 01:05:11.346590 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1659/3369] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 01:05:11 2022] POST /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 01:05:11.408964 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0fb9730c-f852-4681-bcc5-ef0450a204db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:11.409539 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0fb9730c-f852-4681-bcc5-ef0450a204db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:11.415686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb9730c-f852-4681-bcc5-ef0450a204db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:11.416161 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb9730c-f852-4681-bcc5-ef0450a204db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:11.416591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb9730c-f852-4681-bcc5-ef0450a204db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:11.417261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb9730c-f852-4681-bcc5-ef0450a204db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:11.417706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb9730c-f852-4681-bcc5-ef0450a204db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:11.418120 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0fb9730c-f852-4681-bcc5-ef0450a204db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:11.497923 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-0fb9730c-f852-4681-bcc5-ef0450a204db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lazy-loading 'services' on Instance uuid fefe8ad6-db69-4013-99c8-0a6427495baf {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:05:11.568693 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0fb9730c-f852-4681-bcc5-ef0450a204db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments/0a14d177-e89f-4ea6-96b8-86598f44afd8" status: 202 len: 0 microversion: 2.1 time: 0.164806 Aug 31 01:05:11.569361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1711/3370] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 01:05:11 2022] DELETE /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments/0a14d177-e89f-4ea6-96b8-86598f44afd8 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:05:11.579959 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-265589c1-26c6-45bc-b348-dcae65cf3e35 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:11.582168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-265589c1-26c6-45bc-b348-dcae65cf3e35 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:11.588329 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-265589c1-26c6-45bc-b348-dcae65cf3e35 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:11.588783 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-265589c1-26c6-45bc-b348-dcae65cf3e35 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:11.589206 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-265589c1-26c6-45bc-b348-dcae65cf3e35 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:11.589895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-265589c1-26c6-45bc-b348-dcae65cf3e35 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:11.590330 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-265589c1-26c6-45bc-b348-dcae65cf3e35 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:11.590742 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-265589c1-26c6-45bc-b348-dcae65cf3e35 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:11.622147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-265589c1-26c6-45bc-b348-dcae65cf3e35 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Aug 31 01:05:11.622696 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1660/3371] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 01:05:11 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:05:12.636360 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3b81d7a6-e990-4063-8c16-cd6b9eccb682 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:12.638564 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3b81d7a6-e990-4063-8c16-cd6b9eccb682 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:12.645305 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b81d7a6-e990-4063-8c16-cd6b9eccb682 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:12.645778 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b81d7a6-e990-4063-8c16-cd6b9eccb682 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:12.646205 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b81d7a6-e990-4063-8c16-cd6b9eccb682 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:12.646875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b81d7a6-e990-4063-8c16-cd6b9eccb682 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:12.647336 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b81d7a6-e990-4063-8c16-cd6b9eccb682 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:12.647749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b81d7a6-e990-4063-8c16-cd6b9eccb682 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:12.676436 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3b81d7a6-e990-4063-8c16-cd6b9eccb682 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044971 Aug 31 01:05:12.676967 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1712/3372] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 01:05:12 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:05:12.738419 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e28d0566-a7fd-4c9b-85ec-21dde9731587 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:12.738940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e28d0566-a7fd-4c9b-85ec-21dde9731587 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:12.746981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e28d0566-a7fd-4c9b-85ec-21dde9731587 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:12.747497 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e28d0566-a7fd-4c9b-85ec-21dde9731587 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:12.747921 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e28d0566-a7fd-4c9b-85ec-21dde9731587 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:12.748607 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e28d0566-a7fd-4c9b-85ec-21dde9731587 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:12.749055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e28d0566-a7fd-4c9b-85ec-21dde9731587 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:12.749473 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e28d0566-a7fd-4c9b-85ec-21dde9731587 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:12.775545 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e28d0566-a7fd-4c9b-85ec-21dde9731587 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:05:12.850119 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e28d0566-a7fd-4c9b-85ec-21dde9731587 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 204 len: 0 microversion: 2.1 time: 0.115453 Aug 31 01:05:12.850842 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1661/3373] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:05:12 2022] DELETE /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:05:12.859111 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-93d59f44-83cc-4939-9a91-63b462bdf9bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:12.859716 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-93d59f44-83cc-4939-9a91-63b462bdf9bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:12.866115 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93d59f44-83cc-4939-9a91-63b462bdf9bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:12.866965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93d59f44-83cc-4939-9a91-63b462bdf9bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:12.867746 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93d59f44-83cc-4939-9a91-63b462bdf9bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:12.868727 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93d59f44-83cc-4939-9a91-63b462bdf9bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:12.869294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93d59f44-83cc-4939-9a91-63b462bdf9bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:12.869714 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-93d59f44-83cc-4939-9a91-63b462bdf9bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:13.006735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-93d59f44-83cc-4939-9a91-63b462bdf9bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:13.014393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-93d59f44-83cc-4939-9a91-63b462bdf9bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1678 microversion: 2.1 time: 0.159261 Aug 31 01:05:13.014946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1713/3374] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:12 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:14.038472 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-85f1f0d2-39b8-4bf8-a098-f05186c65a5b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:14.039218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-85f1f0d2-39b8-4bf8-a098-f05186c65a5b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:14.045581 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85f1f0d2-39b8-4bf8-a098-f05186c65a5b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:14.046065 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85f1f0d2-39b8-4bf8-a098-f05186c65a5b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:14.046499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85f1f0d2-39b8-4bf8-a098-f05186c65a5b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:14.047217 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85f1f0d2-39b8-4bf8-a098-f05186c65a5b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:14.047673 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85f1f0d2-39b8-4bf8-a098-f05186c65a5b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:14.048107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-85f1f0d2-39b8-4bf8-a098-f05186c65a5b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:14.181988 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-85f1f0d2-39b8-4bf8-a098-f05186c65a5b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:14.189759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-85f1f0d2-39b8-4bf8-a098-f05186c65a5b tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1678 microversion: 2.1 time: 0.156147 Aug 31 01:05:14.191017 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1662/3375] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:14 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:15.212865 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3b79517d-3369-4592-9544-d81616085a42 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:15.213400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3b79517d-3369-4592-9544-d81616085a42 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:15.220165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b79517d-3369-4592-9544-d81616085a42 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:15.220640 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b79517d-3369-4592-9544-d81616085a42 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:15.221075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b79517d-3369-4592-9544-d81616085a42 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:15.221813 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b79517d-3369-4592-9544-d81616085a42 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:15.222261 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b79517d-3369-4592-9544-d81616085a42 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:15.222675 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b79517d-3369-4592-9544-d81616085a42 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:15.363056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3b79517d-3369-4592-9544-d81616085a42 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:15.372038 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3b79517d-3369-4592-9544-d81616085a42 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1678 microversion: 2.1 time: 0.162864 Aug 31 01:05:15.372363 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1714/3376] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:15 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:15.736522 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-b6204e3c-eb8d-448e-a9e9-160357ce4255 req-ac1a15ea-2804-4bff-9362-44f37d7f6a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefe8ad6-db69-4013-99c8-0a6427495baf", "name": "network-vif-deleted", "tag": "c567e761-92a1-43c8-b110-3d4a58c53908"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:05:15.747528 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b6204e3c-eb8d-448e-a9e9-160357ce4255 req-ac1a15ea-2804-4bff-9362-44f37d7f6a01 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:15.747999 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b6204e3c-eb8d-448e-a9e9-160357ce4255 req-ac1a15ea-2804-4bff-9362-44f37d7f6a01 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:15.748441 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b6204e3c-eb8d-448e-a9e9-160357ce4255 req-ac1a15ea-2804-4bff-9362-44f37d7f6a01 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:15.760799 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-b6204e3c-eb8d-448e-a9e9-160357ce4255 req-ac1a15ea-2804-4bff-9362-44f37d7f6a01 service nova] Creating event network-vif-deleted:c567e761-92a1-43c8-b110-3d4a58c53908 for instance fefe8ad6-db69-4013-99c8-0a6427495baf on hv-cinder-85506 Aug 31 01:05:15.766366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-b6204e3c-eb8d-448e-a9e9-160357ce4255 req-ac1a15ea-2804-4bff-9362-44f37d7f6a01 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Aug 31 01:05:15.766974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1663/3377] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:05:16.394391 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:16.395237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:16.401578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:16.402056 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:16.402487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:16.403219 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:16.403669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:16.404087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:16.435498 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:16.435972 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:16.436432 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:16.436871 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lazy-loading 'fault' on Instance uuid fefe8ad6-db69-4013-99c8-0a6427495baf {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:05:16.478342 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:16.486041 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cfd02cbb-2a85-4da9-a4c0-13ab244646a5 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 200 len: 1330 microversion: 2.1 time: 0.096152 Aug 31 01:05:16.486609 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1715/3378] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:16 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:17.509085 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:17.509803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:17.516244 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:17.516716 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:17.517142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:17.517814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:17.518315 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:17.518949 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:17.532267 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf HTTP/1.1 Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:05:17.534585 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:05:17.536039 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'fefe8ad6-db69-4013-99c8-0a6427495baf'} Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:05:17.536911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:05:17.538366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:05:17.539681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:05:17.539681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a96fd150-d39d-4b21-bf32-a7389d45170e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 404 len: 111 microversion: 2.1 time: 0.031846 Aug 31 01:05:17.539681 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1664/3379] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:17 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:05:17.545021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-57d69457-82ec-4e85-a892-e57ebf4fe98c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '.version_select at 0x7fa7efd6fca0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:17.564284 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-57d69457-82ec-4e85-a892-e57ebf4fe98c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-146961060" status: 202 len: 0 microversion: 2.1 time: 0.022922 Aug 31 01:05:17.564858 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1716/3380] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 31 01:05:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-146961060 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:05:18.446553 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8e00e270-f828-4674-b0ba-f0e358164a7f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: .version_select at 0x7fa7f7623dc0>, body: {"keypair": {"name": "tempest-keypair-1712188729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPv7LkJKg7nLvoPvP65ky2DS44lsKw9f8coxBbfeBCI5F3Hi/zTdxC6wrcG6SOrrDub4EIWMU2Lv4M+siN3/RMtH/aYaijHGJK0x8lZz4lbOZoa1K3X4XVi6M8dlqh6Lw=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:05:18.462219 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-8e00e270-f828-4674-b0ba-f0e358164a7f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for project 6b67e536fd414591b859c1a89808e1a6. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:05:18.466021 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-8e00e270-f828-4674-b0ba-f0e358164a7f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for user 26826ddf92124c95835a5356e13040bf and project 6b67e536fd414591b859c1a89808e1a6. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:05:18.488611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8e00e270-f828-4674-b0ba-f0e358164a7f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045773 Aug 31 01:05:18.489220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1665/3381] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 31 01:05:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:05:19.750366 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1302464808", "imageRef": "985e2a3c-9046-4355-855b-915e35ad77f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84755e79-134e-460d-be79-1943a8a099f4"}], "security_groups": [{"name": "tempest-securitygroup--452723625"}], "key_name": "tempest-keypair-1712188729", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:05:19.857159 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] validate_networks() for [('84755e79-134e-460d-be79-1943a8a099f4', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 01:05:20.233700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 01:05:20.234113 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 01:05:20.234574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 01:05:20.235019 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 01:05:20.235447 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 01:05:20.244597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:20.245066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:20.245487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:20.246190 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:20.246631 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:20.247068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:20.263665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for project 6b67e536fd414591b859c1a89808e1a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 01:05:20.267574 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Getting quotas for user 26826ddf92124c95835a5356e13040bf and project 6b67e536fd414591b859c1a89808e1a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 01:05:20.279069 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 01:05:20.281419 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='985e2a3c-9046-4355-855b-915e35ad77f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 01:05:20.329134 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-912b3293-3ca6-4efd-ab0c-707c719b02b4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.583518 Aug 31 01:05:20.329773 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1717/3382] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 31 01:05:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 01:05:20.341723 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-085b6019-0812-4faa-a9b5-d6b4a65e0620 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:20.342337 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-085b6019-0812-4faa-a9b5-d6b4a65e0620 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:20.398811 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-085b6019-0812-4faa-a9b5-d6b4a65e0620 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:20.405615 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-085b6019-0812-4faa-a9b5-d6b4a65e0620 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1242 microversion: 2.1 time: 0.068317 Aug 31 01:05:20.406167 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1666/3383] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:20 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:21.427703 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8687aa80-ec7d-4349-805a-8f05dae626f9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:21.429005 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8687aa80-ec7d-4349-805a-8f05dae626f9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:21.436412 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8687aa80-ec7d-4349-805a-8f05dae626f9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:21.436889 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8687aa80-ec7d-4349-805a-8f05dae626f9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:21.437320 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8687aa80-ec7d-4349-805a-8f05dae626f9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:21.437996 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8687aa80-ec7d-4349-805a-8f05dae626f9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:21.438442 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8687aa80-ec7d-4349-805a-8f05dae626f9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:21.438861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8687aa80-ec7d-4349-805a-8f05dae626f9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:21.508689 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8687aa80-ec7d-4349-805a-8f05dae626f9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:21.517804 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8687aa80-ec7d-4349-805a-8f05dae626f9 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1302 microversion: 2.1 time: 0.095495 Aug 31 01:05:21.525508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1718/3384] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:21 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:22.539698 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b49832d0-8886-463e-ada9-dce94456aba2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:22.540275 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b49832d0-8886-463e-ada9-dce94456aba2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:22.546533 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b49832d0-8886-463e-ada9-dce94456aba2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:22.547007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b49832d0-8886-463e-ada9-dce94456aba2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:22.547547 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b49832d0-8886-463e-ada9-dce94456aba2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:22.548235 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b49832d0-8886-463e-ada9-dce94456aba2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:22.548679 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b49832d0-8886-463e-ada9-dce94456aba2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:22.549099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b49832d0-8886-463e-ada9-dce94456aba2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:22.686013 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b49832d0-8886-463e-ada9-dce94456aba2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:22.694323 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b49832d0-8886-463e-ada9-dce94456aba2 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1367 microversion: 2.1 time: 0.158501 Aug 31 01:05:22.694925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1667/3385] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:22 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:23.171722 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-9d7ccccb-aa49-4fcb-ba08-d92ba11e560f req-25a2cc22-e8b0-4673-acc0-846205e7da04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a16cb4-fdbd-4287-a812-82504cc530c7", "tag": "eb4c5553-59c8-4e53-8f58-aa596211d976"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:05:23.182876 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-9d7ccccb-aa49-4fcb-ba08-d92ba11e560f req-25a2cc22-e8b0-4673-acc0-846205e7da04 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:23.183536 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-9d7ccccb-aa49-4fcb-ba08-d92ba11e560f req-25a2cc22-e8b0-4673-acc0-846205e7da04 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:23.184597 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-9d7ccccb-aa49-4fcb-ba08-d92ba11e560f req-25a2cc22-e8b0-4673-acc0-846205e7da04 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:23.195745 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-9d7ccccb-aa49-4fcb-ba08-d92ba11e560f req-25a2cc22-e8b0-4673-acc0-846205e7da04 service nova] Creating event network-changed:eb4c5553-59c8-4e53-8f58-aa596211d976 for instance 01a16cb4-fdbd-4287-a812-82504cc530c7 on hv-cinder-85506 Aug 31 01:05:23.200854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-9d7ccccb-aa49-4fcb-ba08-d92ba11e560f req-25a2cc22-e8b0-4673-acc0-846205e7da04 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032700 Aug 31 01:05:23.201508 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1719/3386] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:05:23.606220 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9a24521b-1a60-4734-8e1a-1d7e634cd65d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:05:23.608465 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9a24521b-1a60-4734-8e1a-1d7e634cd65d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:23.615639 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a24521b-1a60-4734-8e1a-1d7e634cd65d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:23.616400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a24521b-1a60-4734-8e1a-1d7e634cd65d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:23.616844 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a24521b-1a60-4734-8e1a-1d7e634cd65d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:23.617537 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a24521b-1a60-4734-8e1a-1d7e634cd65d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:23.618155 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a24521b-1a60-4734-8e1a-1d7e634cd65d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:23.618577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a24521b-1a60-4734-8e1a-1d7e634cd65d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:23.697147 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9a24521b-1a60-4734-8e1a-1d7e634cd65d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "POST /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/action" status: 202 len: 0 microversion: 2.1 time: 0.094625 Aug 31 01:05:23.697789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1668/3387] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 01:05:23 2022] POST /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:05:23.707282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-62e27e45-ffb7-4bac-981a-b6c6256da47e tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:23.708052 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-62e27e45-ffb7-4bac-981a-b6c6256da47e tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:23.714646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62e27e45-ffb7-4bac-981a-b6c6256da47e tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:23.715469 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62e27e45-ffb7-4bac-981a-b6c6256da47e tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:23.716361 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62e27e45-ffb7-4bac-981a-b6c6256da47e tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:23.717789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62e27e45-ffb7-4bac-981a-b6c6256da47e tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:23.718849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62e27e45-ffb7-4bac-981a-b6c6256da47e tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:23.719413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-68c86a23-3e42-4482-b07d-33815aa8d1bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:23.719644 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62e27e45-ffb7-4bac-981a-b6c6256da47e tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:23.720613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-68c86a23-3e42-4482-b07d-33815aa8d1bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:23.729386 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68c86a23-3e42-4482-b07d-33815aa8d1bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:23.730055 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68c86a23-3e42-4482-b07d-33815aa8d1bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:23.730566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68c86a23-3e42-4482-b07d-33815aa8d1bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:23.731295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68c86a23-3e42-4482-b07d-33815aa8d1bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:23.731747 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68c86a23-3e42-4482-b07d-33815aa8d1bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:23.732168 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68c86a23-3e42-4482-b07d-33815aa8d1bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:23.921998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-62e27e45-ffb7-4bac-981a-b6c6256da47e tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:23.930308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-62e27e45-ffb7-4bac-981a-b6c6256da47e tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1753 microversion: 2.1 time: 0.228030 Aug 31 01:05:23.930956 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1720/3388] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:23 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1753 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:23.946326 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-68c86a23-3e42-4482-b07d-33815aa8d1bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:23.954066 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-68c86a23-3e42-4482-b07d-33815aa8d1bb tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1367 microversion: 2.1 time: 0.240016 Aug 31 01:05:23.954612 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1669/3389] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:23 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:05:24.952338 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-91ab3153-d1f5-4ccd-9fea-f74afd79b39d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:24.953009 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-91ab3153-d1f5-4ccd-9fea-f74afd79b39d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:24.959468 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ab3153-d1f5-4ccd-9fea-f74afd79b39d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:24.959938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ab3153-d1f5-4ccd-9fea-f74afd79b39d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:24.960364 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ab3153-d1f5-4ccd-9fea-f74afd79b39d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:24.961045 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ab3153-d1f5-4ccd-9fea-f74afd79b39d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:24.961484 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ab3153-d1f5-4ccd-9fea-f74afd79b39d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:24.961895 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-91ab3153-d1f5-4ccd-9fea-f74afd79b39d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:24.976504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ba562f24-99c5-415e-a9c7-a0572a13d89f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:24.977920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ba562f24-99c5-415e-a9c7-a0572a13d89f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:24.984126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba562f24-99c5-415e-a9c7-a0572a13d89f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:24.984610 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba562f24-99c5-415e-a9c7-a0572a13d89f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:24.985103 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba562f24-99c5-415e-a9c7-a0572a13d89f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:24.985795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba562f24-99c5-415e-a9c7-a0572a13d89f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:24.986247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba562f24-99c5-415e-a9c7-a0572a13d89f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:24.986669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba562f24-99c5-415e-a9c7-a0572a13d89f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:25.174092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ba562f24-99c5-415e-a9c7-a0572a13d89f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:25.181185 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-91ab3153-d1f5-4ccd-9fea-f74afd79b39d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:25.181981 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ba562f24-99c5-415e-a9c7-a0572a13d89f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1367 microversion: 2.1 time: 0.209666 Aug 31 01:05:25.182563 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1670/3390] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:24 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:05:25.189398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-91ab3153-d1f5-4ccd-9fea-f74afd79b39d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1753 microversion: 2.1 time: 0.240941 Aug 31 01:05:25.189946 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1721/3391] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:24 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1753 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:26.203604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be7629b4-5658-4300-ad08-ec93a9b8b793 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:26.204271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-be7629b4-5658-4300-ad08-ec93a9b8b793 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:26.210109 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7342480f-ae1c-4fc5-934d-92454d7b17cf tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:26.210708 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7342480f-ae1c-4fc5-934d-92454d7b17cf tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:26.222373 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342480f-ae1c-4fc5-934d-92454d7b17cf tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:26.222611 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7629b4-5658-4300-ad08-ec93a9b8b793 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:26.222906 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342480f-ae1c-4fc5-934d-92454d7b17cf tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:26.223057 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7629b4-5658-4300-ad08-ec93a9b8b793 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:26.223397 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342480f-ae1c-4fc5-934d-92454d7b17cf tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:26.223516 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7629b4-5658-4300-ad08-ec93a9b8b793 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:26.224107 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342480f-ae1c-4fc5-934d-92454d7b17cf tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:26.224215 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7629b4-5658-4300-ad08-ec93a9b8b793 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:26.224565 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342480f-ae1c-4fc5-934d-92454d7b17cf tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:26.224675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7629b4-5658-4300-ad08-ec93a9b8b793 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:26.224989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7342480f-ae1c-4fc5-934d-92454d7b17cf tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:26.225093 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be7629b4-5658-4300-ad08-ec93a9b8b793 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:26.550803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be7629b4-5658-4300-ad08-ec93a9b8b793 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:26.558713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-be7629b4-5658-4300-ad08-ec93a9b8b793 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1367 microversion: 2.1 time: 0.359577 Aug 31 01:05:26.559411 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1671/3392] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:26 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:26.566207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7342480f-ae1c-4fc5-934d-92454d7b17cf tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:26.575463 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7342480f-ae1c-4fc5-934d-92454d7b17cf tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1753 microversion: 2.1 time: 0.369666 Aug 31 01:05:26.576042 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1722/3393] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:26 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1753 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:27.581121 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0f15b288-1d2b-48fe-a18c-0dd751d0f710 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:27.581751 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0f15b288-1d2b-48fe-a18c-0dd751d0f710 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:27.588222 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f15b288-1d2b-48fe-a18c-0dd751d0f710 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:27.588706 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f15b288-1d2b-48fe-a18c-0dd751d0f710 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:27.589142 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f15b288-1d2b-48fe-a18c-0dd751d0f710 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:27.589852 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f15b288-1d2b-48fe-a18c-0dd751d0f710 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:27.590297 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f15b288-1d2b-48fe-a18c-0dd751d0f710 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:27.590715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f15b288-1d2b-48fe-a18c-0dd751d0f710 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:27.597155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2699a26a-6752-4ba4-9bca-582317ceabd2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:27.598087 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2699a26a-6752-4ba4-9bca-582317ceabd2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:27.604504 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2699a26a-6752-4ba4-9bca-582317ceabd2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:27.604992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2699a26a-6752-4ba4-9bca-582317ceabd2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:27.605423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2699a26a-6752-4ba4-9bca-582317ceabd2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:27.606112 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2699a26a-6752-4ba4-9bca-582317ceabd2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:27.606561 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2699a26a-6752-4ba4-9bca-582317ceabd2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:27.606981 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2699a26a-6752-4ba4-9bca-582317ceabd2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:27.785033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0f15b288-1d2b-48fe-a18c-0dd751d0f710 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:27.792690 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0f15b288-1d2b-48fe-a18c-0dd751d0f710 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1367 microversion: 2.1 time: 0.215878 Aug 31 01:05:27.793250 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1672/3394] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:27 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:27.812718 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2699a26a-6752-4ba4-9bca-582317ceabd2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:27.821652 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2699a26a-6752-4ba4-9bca-582317ceabd2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1758 microversion: 2.1 time: 0.229302 Aug 31 01:05:27.822208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1723/3395] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:27 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1758 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:05:28.813737 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2b0dfa19-6c4e-4e70-8b44-21a0692ae822 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:28.814421 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2b0dfa19-6c4e-4e70-8b44-21a0692ae822 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:28.820774 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b0dfa19-6c4e-4e70-8b44-21a0692ae822 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:28.821252 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b0dfa19-6c4e-4e70-8b44-21a0692ae822 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:28.821678 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b0dfa19-6c4e-4e70-8b44-21a0692ae822 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:28.822354 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b0dfa19-6c4e-4e70-8b44-21a0692ae822 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:28.822795 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b0dfa19-6c4e-4e70-8b44-21a0692ae822 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:28.823243 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b0dfa19-6c4e-4e70-8b44-21a0692ae822 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:28.843676 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7157dee9-6e8e-48c5-b04e-3dd47ad5304b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:28.845164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7157dee9-6e8e-48c5-b04e-3dd47ad5304b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:28.852859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7157dee9-6e8e-48c5-b04e-3dd47ad5304b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:28.853353 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7157dee9-6e8e-48c5-b04e-3dd47ad5304b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:28.853787 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7157dee9-6e8e-48c5-b04e-3dd47ad5304b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:28.854481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7157dee9-6e8e-48c5-b04e-3dd47ad5304b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:28.854929 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7157dee9-6e8e-48c5-b04e-3dd47ad5304b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:28.855375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7157dee9-6e8e-48c5-b04e-3dd47ad5304b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:29.022457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2b0dfa19-6c4e-4e70-8b44-21a0692ae822 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:29.030099 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2b0dfa19-6c4e-4e70-8b44-21a0692ae822 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1367 microversion: 2.1 time: 0.220309 Aug 31 01:05:29.030779 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1673/3396] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:28 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:29.047677 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7157dee9-6e8e-48c5-b04e-3dd47ad5304b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:29.056232 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7157dee9-6e8e-48c5-b04e-3dd47ad5304b tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1758 microversion: 2.1 time: 0.216437 Aug 31 01:05:29.056801 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1724/3397] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:28 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1758 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:30.052453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d77a9f3e-c5ee-4668-9b2b-c1399a41b696 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:30.053100 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d77a9f3e-c5ee-4668-9b2b-c1399a41b696 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:30.060938 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d77a9f3e-c5ee-4668-9b2b-c1399a41b696 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:30.061412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d77a9f3e-c5ee-4668-9b2b-c1399a41b696 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:30.061840 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d77a9f3e-c5ee-4668-9b2b-c1399a41b696 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:30.062519 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d77a9f3e-c5ee-4668-9b2b-c1399a41b696 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:30.062957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d77a9f3e-c5ee-4668-9b2b-c1399a41b696 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:30.063400 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d77a9f3e-c5ee-4668-9b2b-c1399a41b696 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:30.077538 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-66297d44-0c4b-4899-8f23-d26eacecacf2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:30.078135 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-66297d44-0c4b-4899-8f23-d26eacecacf2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:30.085334 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66297d44-0c4b-4899-8f23-d26eacecacf2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:30.085812 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66297d44-0c4b-4899-8f23-d26eacecacf2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:30.086239 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66297d44-0c4b-4899-8f23-d26eacecacf2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:30.086918 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66297d44-0c4b-4899-8f23-d26eacecacf2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:30.087398 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66297d44-0c4b-4899-8f23-d26eacecacf2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:30.087818 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66297d44-0c4b-4899-8f23-d26eacecacf2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:30.244990 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d77a9f3e-c5ee-4668-9b2b-c1399a41b696 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:30.253806 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d77a9f3e-c5ee-4668-9b2b-c1399a41b696 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1367 microversion: 2.1 time: 0.205161 Aug 31 01:05:30.256540 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:30.269342 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1674/3398] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:30 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:30.274671 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=6 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:30.287433 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-66297d44-0c4b-4899-8f23-d26eacecacf2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:30.296173 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-66297d44-0c4b-4899-8f23-d26eacecacf2 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1758 microversion: 2.1 time: 0.222456 Aug 31 01:05:30.296837 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1725/3399] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:30 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1758 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:30.345509 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-83429254-02a1-4bba-a6e5-8199a926dd1b req-7f8adff7-6ea5-4422-8ed7-9ad8441493a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a16cb4-fdbd-4287-a812-82504cc530c7", "name": "network-vif-plugged", "status": "completed", "tag": "eb4c5553-59c8-4e53-8f58-aa596211d976"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:05:30.355761 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-83429254-02a1-4bba-a6e5-8199a926dd1b req-7f8adff7-6ea5-4422-8ed7-9ad8441493a9 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:30.356476 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-83429254-02a1-4bba-a6e5-8199a926dd1b req-7f8adff7-6ea5-4422-8ed7-9ad8441493a9 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:30.357892 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-83429254-02a1-4bba-a6e5-8199a926dd1b req-7f8adff7-6ea5-4422-8ed7-9ad8441493a9 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:30.370511 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-83429254-02a1-4bba-a6e5-8199a926dd1b req-7f8adff7-6ea5-4422-8ed7-9ad8441493a9 service nova] Creating event network-vif-plugged:eb4c5553-59c8-4e53-8f58-aa596211d976 for instance 01a16cb4-fdbd-4287-a812-82504cc530c7 on hv-cinder-85506 Aug 31 01:05:30.375520 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-83429254-02a1-4bba-a6e5-8199a926dd1b req-7f8adff7-6ea5-4422-8ed7-9ad8441493a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033936 Aug 31 01:05:30.376092 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1675/3400] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:05:31.276910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bb47c7e2-2c95-415c-91e8-1d333eefd4a4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:31.277424 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bb47c7e2-2c95-415c-91e8-1d333eefd4a4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:31.283921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb47c7e2-2c95-415c-91e8-1d333eefd4a4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:31.284396 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb47c7e2-2c95-415c-91e8-1d333eefd4a4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:31.284820 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb47c7e2-2c95-415c-91e8-1d333eefd4a4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:31.285495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb47c7e2-2c95-415c-91e8-1d333eefd4a4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:31.285939 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb47c7e2-2c95-415c-91e8-1d333eefd4a4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:31.286352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bb47c7e2-2c95-415c-91e8-1d333eefd4a4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:31.305021 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:31.315721 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:31.320707 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b528d707-6225-4520-a278-bab6821831d0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:31.321388 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b528d707-6225-4520-a278-bab6821831d0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:31.328218 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b528d707-6225-4520-a278-bab6821831d0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:31.328686 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b528d707-6225-4520-a278-bab6821831d0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:31.329110 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b528d707-6225-4520-a278-bab6821831d0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:31.329790 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b528d707-6225-4520-a278-bab6821831d0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:31.330257 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b528d707-6225-4520-a278-bab6821831d0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:31.330669 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b528d707-6225-4520-a278-bab6821831d0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:31.334932 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:31.477603 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bb47c7e2-2c95-415c-91e8-1d333eefd4a4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:31.485212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bb47c7e2-2c95-415c-91e8-1d333eefd4a4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1367 microversion: 2.1 time: 0.212486 Aug 31 01:05:31.485788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1726/3401] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:31 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:31.518303 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b528d707-6225-4520-a278-bab6821831d0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:31.527141 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b528d707-6225-4520-a278-bab6821831d0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1758 microversion: 2.1 time: 0.213042 Aug 31 01:05:31.527643 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1676/3402] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:31 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1758 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:05:32.506481 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d53834e-0fac-4c0a-9d5f-b568f0c6ae07 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:32.507104 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d53834e-0fac-4c0a-9d5f-b568f0c6ae07 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:32.513680 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d53834e-0fac-4c0a-9d5f-b568f0c6ae07 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:32.514163 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d53834e-0fac-4c0a-9d5f-b568f0c6ae07 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:32.514598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d53834e-0fac-4c0a-9d5f-b568f0c6ae07 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:32.515311 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d53834e-0fac-4c0a-9d5f-b568f0c6ae07 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:32.515868 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d53834e-0fac-4c0a-9d5f-b568f0c6ae07 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:32.516300 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d53834e-0fac-4c0a-9d5f-b568f0c6ae07 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:32.548914 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1b5575a4-b9b5-4fec-ace8-8c7a151c4c25 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:32.550617 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1b5575a4-b9b5-4fec-ace8-8c7a151c4c25 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:32.553043 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:32.558328 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b5575a4-b9b5-4fec-ace8-8c7a151c4c25 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:32.558803 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b5575a4-b9b5-4fec-ace8-8c7a151c4c25 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:32.559272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b5575a4-b9b5-4fec-ace8-8c7a151c4c25 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:32.559957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b5575a4-b9b5-4fec-ace8-8c7a151c4c25 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:32.560395 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b5575a4-b9b5-4fec-ace8-8c7a151c4c25 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:32.560812 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1b5575a4-b9b5-4fec-ace8-8c7a151c4c25 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:32.700262 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8d53834e-0fac-4c0a-9d5f-b568f0c6ae07 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:32.708288 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d53834e-0fac-4c0a-9d5f-b568f0c6ae07 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1556 microversion: 2.1 time: 0.206362 Aug 31 01:05:32.708856 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1727/3403] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:32 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1556 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:32.729033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c27c7095-6e1e-4a39-9277-276e9f9ceb09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:32.729626 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c27c7095-6e1e-4a39-9277-276e9f9ceb09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:32.735593 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c27c7095-6e1e-4a39-9277-276e9f9ceb09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:32.736212 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c27c7095-6e1e-4a39-9277-276e9f9ceb09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:32.737214 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c27c7095-6e1e-4a39-9277-276e9f9ceb09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:32.737902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c27c7095-6e1e-4a39-9277-276e9f9ceb09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:32.738337 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c27c7095-6e1e-4a39-9277-276e9f9ceb09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:32.738751 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c27c7095-6e1e-4a39-9277-276e9f9ceb09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:32.743746 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1b5575a4-b9b5-4fec-ace8-8c7a151c4c25 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:32.751900 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1b5575a4-b9b5-4fec-ace8-8c7a151c4c25 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1758 microversion: 2.1 time: 0.206657 Aug 31 01:05:32.753735 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1677/3404] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:32 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1758 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:05:32.822926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c27c7095-6e1e-4a39-9277-276e9f9ceb09 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097678 Aug 31 01:05:32.823568 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1728/3405] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 31 01:05:32 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:05:33.748427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-b81ae5a2-40f8-4337-adea-7c639c1fd844 req-c6503d7c-20af-4c46-a3c4-b36c2d7a2c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a16cb4-fdbd-4287-a812-82504cc530c7", "tag": "eb4c5553-59c8-4e53-8f58-aa596211d976"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:05:33.758498 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b81ae5a2-40f8-4337-adea-7c639c1fd844 req-c6503d7c-20af-4c46-a3c4-b36c2d7a2c67 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:33.758965 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b81ae5a2-40f8-4337-adea-7c639c1fd844 req-c6503d7c-20af-4c46-a3c4-b36c2d7a2c67 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:33.759412 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b81ae5a2-40f8-4337-adea-7c639c1fd844 req-c6503d7c-20af-4c46-a3c4-b36c2d7a2c67 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:33.770964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-b81ae5a2-40f8-4337-adea-7c639c1fd844 req-c6503d7c-20af-4c46-a3c4-b36c2d7a2c67 service nova] Creating event network-changed:eb4c5553-59c8-4e53-8f58-aa596211d976 for instance 01a16cb4-fdbd-4287-a812-82504cc530c7 on hv-cinder-85506 Aug 31 01:05:33.775168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-afdaa66f-bd7a-4a51-8dca-2a0898c00666 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:33.775795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-afdaa66f-bd7a-4a51-8dca-2a0898c00666 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:33.776240 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-b81ae5a2-40f8-4337-adea-7c639c1fd844 req-c6503d7c-20af-4c46-a3c4-b36c2d7a2c67 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031439 Aug 31 01:05:33.776786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1678/3406] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:05:33.777965 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:05:33.785319 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afdaa66f-bd7a-4a51-8dca-2a0898c00666 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:33.785811 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afdaa66f-bd7a-4a51-8dca-2a0898c00666 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:33.786240 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afdaa66f-bd7a-4a51-8dca-2a0898c00666 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:33.786928 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afdaa66f-bd7a-4a51-8dca-2a0898c00666 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:33.787400 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afdaa66f-bd7a-4a51-8dca-2a0898c00666 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:33.787817 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-afdaa66f-bd7a-4a51-8dca-2a0898c00666 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:34.040202 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-afdaa66f-bd7a-4a51-8dca-2a0898c00666 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:34.051646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-afdaa66f-bd7a-4a51-8dca-2a0898c00666 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1758 microversion: 2.1 time: 0.281251 Aug 31 01:05:34.054079 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1729/3407] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:33 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1758 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:05:35.073658 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-feebc936-7b47-4355-b03d-09e8fae30253 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:35.074357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-feebc936-7b47-4355-b03d-09e8fae30253 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:35.080494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-feebc936-7b47-4355-b03d-09e8fae30253 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:35.080974 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-feebc936-7b47-4355-b03d-09e8fae30253 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:35.081556 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-feebc936-7b47-4355-b03d-09e8fae30253 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:35.082283 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-feebc936-7b47-4355-b03d-09e8fae30253 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:35.082736 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-feebc936-7b47-4355-b03d-09e8fae30253 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:35.083191 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-feebc936-7b47-4355-b03d-09e8fae30253 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:35.237604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-feebc936-7b47-4355-b03d-09e8fae30253 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:35.245755 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-feebc936-7b47-4355-b03d-09e8fae30253 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1758 microversion: 2.1 time: 0.176739 Aug 31 01:05:35.246319 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1679/3408] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:35 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:36.266861 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1d3998b1-ea37-4521-ae20-251c128bb73d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:36.267487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1d3998b1-ea37-4521-ae20-251c128bb73d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:36.273992 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d3998b1-ea37-4521-ae20-251c128bb73d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:36.274470 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d3998b1-ea37-4521-ae20-251c128bb73d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:36.274901 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d3998b1-ea37-4521-ae20-251c128bb73d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:36.275614 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d3998b1-ea37-4521-ae20-251c128bb73d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:36.276066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d3998b1-ea37-4521-ae20-251c128bb73d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:36.276487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1d3998b1-ea37-4521-ae20-251c128bb73d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:36.677754 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1d3998b1-ea37-4521-ae20-251c128bb73d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:36.685986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1d3998b1-ea37-4521-ae20-251c128bb73d tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1758 microversion: 2.1 time: 0.422991 Aug 31 01:05:36.686639 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1730/3409] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:36 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1758 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:37.707801 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-934a2fd1-cbca-4792-a28a-a1bbfb29d6b0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:37.708410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-934a2fd1-cbca-4792-a28a-a1bbfb29d6b0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:37.714820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-934a2fd1-cbca-4792-a28a-a1bbfb29d6b0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:37.715333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-934a2fd1-cbca-4792-a28a-a1bbfb29d6b0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:37.715766 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-934a2fd1-cbca-4792-a28a-a1bbfb29d6b0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:37.716439 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-934a2fd1-cbca-4792-a28a-a1bbfb29d6b0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:37.716895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-934a2fd1-cbca-4792-a28a-a1bbfb29d6b0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:37.717312 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-934a2fd1-cbca-4792-a28a-a1bbfb29d6b0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:37.860620 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-934a2fd1-cbca-4792-a28a-a1bbfb29d6b0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:37.869186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-934a2fd1-cbca-4792-a28a-a1bbfb29d6b0 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1758 microversion: 2.1 time: 0.165448 Aug 31 01:05:37.869753 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1680/3410] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:37 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:05:38.889761 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0f5f830b-7616-4528-aa90-cfaa156adfd7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:05:38.890367 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0f5f830b-7616-4528-aa90-cfaa156adfd7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:05:38.897068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f5f830b-7616-4528-aa90-cfaa156adfd7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:38.897552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f5f830b-7616-4528-aa90-cfaa156adfd7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:38.897988 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f5f830b-7616-4528-aa90-cfaa156adfd7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:38.898672 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f5f830b-7616-4528-aa90-cfaa156adfd7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:05:38.899155 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f5f830b-7616-4528-aa90-cfaa156adfd7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:05:38.899579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0f5f830b-7616-4528-aa90-cfaa156adfd7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:05:39.050082 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0f5f830b-7616-4528-aa90-cfaa156adfd7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:05:39.058294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0f5f830b-7616-4528-aa90-cfaa156adfd7 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1761 microversion: 2.1 time: 0.172475 Aug 31 01:05:39.058859 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1731/3411] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:05:38 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1761 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:06:42.499487 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 01:06:42.500126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Wed Aug 31 01:06:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/action (ip 10.222.0.67) !!! Aug 31 01:06:42.500126 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=7 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:06:42.501635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=24 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:06:42.505830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-08929213-247b-4ee4-9653-c45eb00910d3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1447797905"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:06:42.506356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-08929213-247b-4ee4-9653-c45eb00910d3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:06:42.515366 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08929213-247b-4ee4-9653-c45eb00910d3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:42.515876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08929213-247b-4ee4-9653-c45eb00910d3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:42.516306 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08929213-247b-4ee4-9653-c45eb00910d3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:42.516996 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08929213-247b-4ee4-9653-c45eb00910d3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:42.517443 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08929213-247b-4ee4-9653-c45eb00910d3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:42.517858 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08929213-247b-4ee4-9653-c45eb00910d3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:42.646699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.network.security_group_api [None req-08929213-247b-4ee4-9653-c45eb00910d3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Removing security group 3cba5d1c-e806-43a8-8e34-c10072610d5a from port ee7cf7b9-05d2-4b75-84e8-032c61e63776 Aug 31 01:06:42.955757 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-08929213-247b-4ee4-9653-c45eb00910d3 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "POST /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/action" status: 202 len: 0 microversion: 2.1 time: 0.459407 Aug 31 01:06:42.956529 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1681/3412] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 31 01:06:42 2022] POST /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 01:06:42.962637 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=5 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:06:42.963799 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=30 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:06:42.974303 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-5a52ab52-f79a-4998-8ef4-99e4d61e4b8d req-456267b0-39f1-4bde-8b8f-ea7b9b86c016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fe26d4-97c7-4a19-84d8-e043abbce608", "tag": "ee7cf7b9-05d2-4b75-84e8-032c61e63776"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:06:42.985752 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5a52ab52-f79a-4998-8ef4-99e4d61e4b8d req-456267b0-39f1-4bde-8b8f-ea7b9b86c016 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:42.986237 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5a52ab52-f79a-4998-8ef4-99e4d61e4b8d req-456267b0-39f1-4bde-8b8f-ea7b9b86c016 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:42.986664 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5a52ab52-f79a-4998-8ef4-99e4d61e4b8d req-456267b0-39f1-4bde-8b8f-ea7b9b86c016 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:43.004075 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-5a52ab52-f79a-4998-8ef4-99e4d61e4b8d req-456267b0-39f1-4bde-8b8f-ea7b9b86c016 service nova] Creating event network-changed:ee7cf7b9-05d2-4b75-84e8-032c61e63776 for instance e3fe26d4-97c7-4a19-84d8-e043abbce608 on hv-cinder-85506 Aug 31 01:06:43.012207 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-5a52ab52-f79a-4998-8ef4-99e4d61e4b8d req-456267b0-39f1-4bde-8b8f-ea7b9b86c016 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049307 Aug 31 01:06:43.013128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1732/3413] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:06:44.335898 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cdb358c9-989d-486b-8b80-5e1b6879443c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:06:44.336385 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cdb358c9-989d-486b-8b80-5e1b6879443c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:06:44.342634 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb358c9-989d-486b-8b80-5e1b6879443c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:44.342839 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb358c9-989d-486b-8b80-5e1b6879443c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:44.343295 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb358c9-989d-486b-8b80-5e1b6879443c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:44.343970 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb358c9-989d-486b-8b80-5e1b6879443c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:44.344413 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb358c9-989d-486b-8b80-5e1b6879443c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:44.344828 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cdb358c9-989d-486b-8b80-5e1b6879443c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:44.426032 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-cdb358c9-989d-486b-8b80-5e1b6879443c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lazy-loading 'services' on Instance uuid e3fe26d4-97c7-4a19-84d8-e043abbce608 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:06:44.500566 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cdb358c9-989d-486b-8b80-5e1b6879443c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments/f372405e-ddf2-48d9-a28f-ab470ec2145d" status: 202 len: 0 microversion: 2.1 time: 0.168949 Aug 31 01:06:44.501247 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1682/3414] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 01:06:44 2022] DELETE /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments/f372405e-ddf2-48d9-a28f-ab470ec2145d => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:06:44.510455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-433f84f6-9eb2-47d6-bcac-220ca5d4b4d5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:06:44.513788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-433f84f6-9eb2-47d6-bcac-220ca5d4b4d5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:06:44.522224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f84f6-9eb2-47d6-bcac-220ca5d4b4d5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:44.522704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f84f6-9eb2-47d6-bcac-220ca5d4b4d5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:44.523165 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f84f6-9eb2-47d6-bcac-220ca5d4b4d5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:44.523849 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f84f6-9eb2-47d6-bcac-220ca5d4b4d5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:44.524292 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f84f6-9eb2-47d6-bcac-220ca5d4b4d5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:44.524706 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-433f84f6-9eb2-47d6-bcac-220ca5d4b4d5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:44.556548 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-433f84f6-9eb2-47d6-bcac-220ca5d4b4d5 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050549 Aug 31 01:06:44.557244 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1733/3415] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 01:06:44 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 01:06:45.029863 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-25b81cf2-61a0-4be7-ad61-e662030187a0 req-83a2181f-8de2-4a95-829c-97c97d0dd039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fe26d4-97c7-4a19-84d8-e043abbce608", "tag": "ee7cf7b9-05d2-4b75-84e8-032c61e63776"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:06:45.042715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-25b81cf2-61a0-4be7-ad61-e662030187a0 req-83a2181f-8de2-4a95-829c-97c97d0dd039 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:45.043263 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-25b81cf2-61a0-4be7-ad61-e662030187a0 req-83a2181f-8de2-4a95-829c-97c97d0dd039 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:45.044475 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-25b81cf2-61a0-4be7-ad61-e662030187a0 req-83a2181f-8de2-4a95-829c-97c97d0dd039 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:45.057924 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-25b81cf2-61a0-4be7-ad61-e662030187a0 req-83a2181f-8de2-4a95-829c-97c97d0dd039 service nova] Creating event network-changed:ee7cf7b9-05d2-4b75-84e8-032c61e63776 for instance e3fe26d4-97c7-4a19-84d8-e043abbce608 on hv-cinder-85506 Aug 31 01:06:45.063983 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-25b81cf2-61a0-4be7-ad61-e662030187a0 req-83a2181f-8de2-4a95-829c-97c97d0dd039 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038386 Aug 31 01:06:45.064362 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1683/3416] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:06:45.569443 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-080dcd70-d4e6-4678-9356-476e217eee3f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:06:45.571638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-080dcd70-d4e6-4678-9356-476e217eee3f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:06:45.578206 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-080dcd70-d4e6-4678-9356-476e217eee3f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:45.578696 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-080dcd70-d4e6-4678-9356-476e217eee3f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:45.579151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-080dcd70-d4e6-4678-9356-476e217eee3f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:45.579843 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-080dcd70-d4e6-4678-9356-476e217eee3f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:45.580294 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-080dcd70-d4e6-4678-9356-476e217eee3f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:45.580725 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-080dcd70-d4e6-4678-9356-476e217eee3f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:45.610882 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-080dcd70-d4e6-4678-9356-476e217eee3f tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045455 Aug 31 01:06:45.612317 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1734/3417] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 01:06:45 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:06:45.623894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:06:45.624477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:06:45.631245 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:45.631728 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:45.632163 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:45.632851 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:45.633299 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:45.633719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:45.709394 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] HTTP exception thrown: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 is not attached to volume f372405e-ddf2-48d9-a28f-ab470ec2145d Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Request method failure captured: Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments/f372405e-ddf2-48d9-a28f-ab470ec2145d HTTP/1.1 Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrNQMvONsJl2NtP34BE6Qwhrj7AHVZqgkTy3w6Z7xNHkk-w8w2fAhO2xUxYvcwz14cTpGq1iy7A-56AleY-_iyyKEXbIgGb4g4ePpF0sa-78RyNATCiEH2kFmpk9Pa9Z1AlDkF--FY3asslgk8soqUi5u-A8NRw9JZOxqeV2QcLsndE Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 7f85c7d484fa4aebafc3c0a12c9569c2 Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-TestMinimumBasicScenario-911643030 Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:06:45.711880 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f85c7d484fa4aebafc3c0a12c9569c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7f85c7d484fa4aebafc3c0a12c9569c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f85c7d484fa4aebafc3c0a12c9569c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7f85c7d484fa4aebafc3c0a12c9569c2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-TestMinimumBasicScenario-911643030 Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 7f85c7d484fa4aebafc3c0a12c9569c2 Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-TestMinimumBasicScenario-911643030 Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-TestMinimumBasicScenario-911643030-project Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 74ec301c62e541e0851f7570bcf07e4f Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-TestMinimumBasicScenario-911643030-project Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:06:45.713434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 is not attached to volume f372405e-ddf2-48d9-a28f-ab470ec2145d Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'server_id': 'e3fe26d4-97c7-4a19-84d8-e043abbce608', 'id': 'f372405e-ddf2-48d9-a28f-ab470ec2145d'} Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f372405e-ddf2-48d9-a28f-ab470ec2145d. Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:06:45.714195 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 is not attached to volume f372405e-ddf2-48d9-a28f-ab470ec2145d Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 is not attached to volume f372405e-ddf2-48d9-a28f-ab470ec2145d Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:06:45.715824 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Returning 404 to user: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 is not attached to volume f372405e-ddf2-48d9-a28f-ab470ec2145d {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:06:45.716907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2f25af3e-5ce1-4222-83ce-4a1e59fe4088 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments/f372405e-ddf2-48d9-a28f-ab470ec2145d" status: 404 len: 154 microversion: 2.1 time: 0.094557 Aug 31 01:06:45.716907 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1684/3418] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 01:06:45 2022] DELETE /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608/os-volume_attachments/f372405e-ddf2-48d9-a28f-ab470ec2145d => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:06:46.853840 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-65c75ab3-376e-4533-b7b3-b93fae8ce269 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:06:46.854335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-65c75ab3-376e-4533-b7b3-b93fae8ce269 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:06:46.861062 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c75ab3-376e-4533-b7b3-b93fae8ce269 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:46.861549 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c75ab3-376e-4533-b7b3-b93fae8ce269 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:46.861986 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c75ab3-376e-4533-b7b3-b93fae8ce269 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:46.862669 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c75ab3-376e-4533-b7b3-b93fae8ce269 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:46.863154 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c75ab3-376e-4533-b7b3-b93fae8ce269 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:46.863581 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65c75ab3-376e-4533-b7b3-b93fae8ce269 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:46.889197 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-65c75ab3-376e-4533-b7b3-b93fae8ce269 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:06:46.962453 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-65c75ab3-376e-4533-b7b3-b93fae8ce269 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 204 len: 0 microversion: 2.1 time: 0.112125 Aug 31 01:06:46.963145 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1735/3419] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:06:46 2022] DELETE /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 01:06:46.972481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-996c8f1c-e178-406b-bc48-8340355c5daa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:06:46.973227 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-996c8f1c-e178-406b-bc48-8340355c5daa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:06:46.979838 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-996c8f1c-e178-406b-bc48-8340355c5daa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:46.980316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-996c8f1c-e178-406b-bc48-8340355c5daa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:46.981325 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-996c8f1c-e178-406b-bc48-8340355c5daa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:46.982004 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-996c8f1c-e178-406b-bc48-8340355c5daa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:46.982451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-996c8f1c-e178-406b-bc48-8340355c5daa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:46.982868 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-996c8f1c-e178-406b-bc48-8340355c5daa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:47.114940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-996c8f1c-e178-406b-bc48-8340355c5daa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:06:47.123060 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-996c8f1c-e178-406b-bc48-8340355c5daa tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1555 microversion: 2.1 time: 0.155019 Aug 31 01:06:47.123635 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1685/3420] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:06:46 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:06:48.144657 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-68322cf4-f3e6-49eb-bc91-d7aaf711e765 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:06:48.145749 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-68322cf4-f3e6-49eb-bc91-d7aaf711e765 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:06:48.152422 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322cf4-f3e6-49eb-bc91-d7aaf711e765 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:48.152921 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322cf4-f3e6-49eb-bc91-d7aaf711e765 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:48.153421 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322cf4-f3e6-49eb-bc91-d7aaf711e765 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:48.154099 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322cf4-f3e6-49eb-bc91-d7aaf711e765 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:48.154545 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322cf4-f3e6-49eb-bc91-d7aaf711e765 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:48.154962 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322cf4-f3e6-49eb-bc91-d7aaf711e765 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:48.288335 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-68322cf4-f3e6-49eb-bc91-d7aaf711e765 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:06:48.296569 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-68322cf4-f3e6-49eb-bc91-d7aaf711e765 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1555 microversion: 2.1 time: 0.156121 Aug 31 01:06:48.297146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1736/3421] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:06:48 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 01:06:49.317732 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ce88f11e-9621-49bf-8e11-31757d44900c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:06:49.318333 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ce88f11e-9621-49bf-8e11-31757d44900c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:06:49.325453 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce88f11e-9621-49bf-8e11-31757d44900c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:49.325877 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce88f11e-9621-49bf-8e11-31757d44900c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:49.326309 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce88f11e-9621-49bf-8e11-31757d44900c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:49.326995 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce88f11e-9621-49bf-8e11-31757d44900c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:49.327470 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce88f11e-9621-49bf-8e11-31757d44900c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:49.327918 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ce88f11e-9621-49bf-8e11-31757d44900c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:49.515030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ce88f11e-9621-49bf-8e11-31757d44900c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ec301c62e541e0851f7570bcf07e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f85c7d484fa4aebafc3c0a12c9569c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:06:49.523432 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ce88f11e-9621-49bf-8e11-31757d44900c tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 200 len: 1555 microversion: 2.1 time: 0.209456 Aug 31 01:06:49.524471 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1686/3422] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:06:49 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:06:49.659702 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-4bdd0e09-8bf1-437e-bcb6-73a560994566 req-28a700fd-5e24-4a4c-adec-2dca147b02db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fe26d4-97c7-4a19-84d8-e043abbce608", "name": "network-vif-deleted", "tag": "ee7cf7b9-05d2-4b75-84e8-032c61e63776"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:06:49.669779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-4bdd0e09-8bf1-437e-bcb6-73a560994566 req-28a700fd-5e24-4a4c-adec-2dca147b02db service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:49.670253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-4bdd0e09-8bf1-437e-bcb6-73a560994566 req-28a700fd-5e24-4a4c-adec-2dca147b02db service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:49.670681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-4bdd0e09-8bf1-437e-bcb6-73a560994566 req-28a700fd-5e24-4a4c-adec-2dca147b02db service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:49.681791 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-4bdd0e09-8bf1-437e-bcb6-73a560994566 req-28a700fd-5e24-4a4c-adec-2dca147b02db service nova] Creating event network-vif-deleted:ee7cf7b9-05d2-4b75-84e8-032c61e63776 for instance e3fe26d4-97c7-4a19-84d8-e043abbce608 on hv-cinder-85506 Aug 31 01:06:49.687667 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-4bdd0e09-8bf1-437e-bcb6-73a560994566 req-28a700fd-5e24-4a4c-adec-2dca147b02db service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031733 Aug 31 01:06:49.688681 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1737/3423] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:06:50.544823 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:06:50.545434 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] [instance: e3fe26d4-97c7-4a19-84d8-e043abbce608] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:06:50.551867 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:50.552350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:50.552786 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:50.553469 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:06:50.553920 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:06:50.554341 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:06:50.568087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] HTTP exception thrown: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 could not be found. Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Request method failure captured: Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 HTTP/1.1 Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrNQMvONsJl2NtP34BE6Qwhrj7AHVZqgkTy3w6Z7xNHkk-w8w2fAhO2xUxYvcwz14cTpGq1iy7A-56AleY-_iyyKEXbIgGb4g4ePpF0sa-78RyNATCiEH2kFmpk9Pa9Z1AlDkF--FY3asslgk8soqUi5u-A8NRw9JZOxqeV2QcLsndE Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 7f85c7d484fa4aebafc3c0a12c9569c2 Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-TestMinimumBasicScenario-911643030 Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:06:50.569629 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f85c7d484fa4aebafc3c0a12c9569c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7f85c7d484fa4aebafc3c0a12c9569c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f85c7d484fa4aebafc3c0a12c9569c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7f85c7d484fa4aebafc3c0a12c9569c2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-TestMinimumBasicScenario-911643030 Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 7f85c7d484fa4aebafc3c0a12c9569c2 Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-TestMinimumBasicScenario-911643030 Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-TestMinimumBasicScenario-911643030-project Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 74ec301c62e541e0851f7570bcf07e4f Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-TestMinimumBasicScenario-911643030-project Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 could not be found. Aug 31 01:06:50.571086 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'e3fe26d4-97c7-4a19-84d8-e043abbce608'} Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 could not be found. Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:06:50.571910 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 could not be found. Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 could not be found. Aug 31 01:06:50.573131 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:06:50.575074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Returning 404 to user: Instance e3fe26d4-97c7-4a19-84d8-e043abbce608 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:06:50.575074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-031d5c8a-f6f6-4204-873f-962a55883f98 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608" status: 404 len: 111 microversion: 2.1 time: 0.030247 Aug 31 01:06:50.575074 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1687/3424] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:06:50 2022] GET /compute/v2.1/servers/e3fe26d4-97c7-4a19-84d8-e043abbce608 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:06:50.581033 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2fd64614-bba9-4480-a3ab-2d82001a6d84 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] Calling method '.version_select at 0x7fa7efd954c0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:06:50.599795 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2fd64614-bba9-4480-a3ab-2d82001a6d84 tempest-TestMinimumBasicScenario-911643030 tempest-TestMinimumBasicScenario-911643030-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1709539258" status: 202 len: 0 microversion: 2.1 time: 0.022838 Aug 31 01:06:50.600350 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1738/3425] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 31 01:06:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1709539258 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:07:03.427829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fb33b549-d523-4ff2-a539-9cd333b6dc4e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:03.428427 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fb33b549-d523-4ff2-a539-9cd333b6dc4e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:03.430945 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=14 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:07:03.432096 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:07:03.438030 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb33b549-d523-4ff2-a539-9cd333b6dc4e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:03.438524 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb33b549-d523-4ff2-a539-9cd333b6dc4e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:03.438992 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb33b549-d523-4ff2-a539-9cd333b6dc4e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:03.439705 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb33b549-d523-4ff2-a539-9cd333b6dc4e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:03.440161 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb33b549-d523-4ff2-a539-9cd333b6dc4e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:03.440575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb33b549-d523-4ff2-a539-9cd333b6dc4e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:03.465908 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fb33b549-d523-4ff2-a539-9cd333b6dc4e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/ips" status: 200 len: 149 microversion: 2.1 time: 0.041949 Aug 31 01:07:03.466482 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1688/3426] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 31 01:07:03 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:04.845525 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-609e43bb-8ca5-4ebd-a7dd-c065fcd18073 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69e3b385-9936-4c63-9383-b3f5d152eaf8"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:07:04.848223 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-609e43bb-8ca5-4ebd-a7dd-c065fcd18073 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:04.850347 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:07:04.850989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:07:04.858938 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-609e43bb-8ca5-4ebd-a7dd-c065fcd18073 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:04.859455 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-609e43bb-8ca5-4ebd-a7dd-c065fcd18073 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:04.860750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-609e43bb-8ca5-4ebd-a7dd-c065fcd18073 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:04.860750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-609e43bb-8ca5-4ebd-a7dd-c065fcd18073 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:04.861034 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-609e43bb-8ca5-4ebd-a7dd-c065fcd18073 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:04.861457 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-609e43bb-8ca5-4ebd-a7dd-c065fcd18073 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:05.151797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-609e43bb-8ca5-4ebd-a7dd-c065fcd18073 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "POST /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309938 Aug 31 01:07:05.152411 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1739/3427] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 31 01:07:04 2022] POST /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:12.789350 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1fe1e494-f9cc-4108-a1f8-106f2733942e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:12.789849 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1fe1e494-f9cc-4108-a1f8-106f2733942e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:12.796318 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fe1e494-f9cc-4108-a1f8-106f2733942e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:12.796797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fe1e494-f9cc-4108-a1f8-106f2733942e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:12.797271 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fe1e494-f9cc-4108-a1f8-106f2733942e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:12.797957 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fe1e494-f9cc-4108-a1f8-106f2733942e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:12.798407 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fe1e494-f9cc-4108-a1f8-106f2733942e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:12.798829 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1fe1e494-f9cc-4108-a1f8-106f2733942e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:12.880715 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-1fe1e494-f9cc-4108-a1f8-106f2733942e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lazy-loading 'services' on Instance uuid 01a16cb4-fdbd-4287-a812-82504cc530c7 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 01:07:12.966186 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1fe1e494-f9cc-4108-a1f8-106f2733942e tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/os-volume_attachments/69e3b385-9936-4c63-9383-b3f5d152eaf8" status: 202 len: 0 microversion: 2.1 time: 0.180605 Aug 31 01:07:12.972080 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1689/3428] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 31 01:07:12 2022] DELETE /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/os-volume_attachments/69e3b385-9936-4c63-9383-b3f5d152eaf8 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:07:12.983150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0d03a41-b953-45b7-818d-1467d3a23b04 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:12.985704 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0d03a41-b953-45b7-818d-1467d3a23b04 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:13.002786 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d03a41-b953-45b7-818d-1467d3a23b04 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:13.003309 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d03a41-b953-45b7-818d-1467d3a23b04 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:13.003735 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d03a41-b953-45b7-818d-1467d3a23b04 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:13.004423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d03a41-b953-45b7-818d-1467d3a23b04 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:13.004862 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d03a41-b953-45b7-818d-1467d3a23b04 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:13.005273 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0d03a41-b953-45b7-818d-1467d3a23b04 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:13.041591 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0d03a41-b953-45b7-818d-1467d3a23b04 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062895 Aug 31 01:07:13.042146 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1740/3429] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 01:07:12 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:14.055515 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f10072c9-dfdf-4125-8aba-b98e4f3d637a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:14.057876 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f10072c9-dfdf-4125-8aba-b98e4f3d637a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:14.064214 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f10072c9-dfdf-4125-8aba-b98e4f3d637a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:14.064695 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f10072c9-dfdf-4125-8aba-b98e4f3d637a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:14.065132 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f10072c9-dfdf-4125-8aba-b98e4f3d637a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:14.065814 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f10072c9-dfdf-4125-8aba-b98e4f3d637a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:14.066266 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f10072c9-dfdf-4125-8aba-b98e4f3d637a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:14.066693 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f10072c9-dfdf-4125-8aba-b98e4f3d637a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:14.096749 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f10072c9-dfdf-4125-8aba-b98e4f3d637a tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046103 Aug 31 01:07:14.097302 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1690/3430] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 31 01:07:14 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 01:07:14.159270 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d1b5d628-ebb3-41b9-a12b-44d508077654 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:14.159878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d1b5d628-ebb3-41b9-a12b-44d508077654 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:14.166235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1b5d628-ebb3-41b9-a12b-44d508077654 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:14.166711 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1b5d628-ebb3-41b9-a12b-44d508077654 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:14.167208 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1b5d628-ebb3-41b9-a12b-44d508077654 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:14.167926 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1b5d628-ebb3-41b9-a12b-44d508077654 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:14.168378 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1b5d628-ebb3-41b9-a12b-44d508077654 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:14.168797 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1b5d628-ebb3-41b9-a12b-44d508077654 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:14.193503 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d1b5d628-ebb3-41b9-a12b-44d508077654 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 01:07:14.271375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d1b5d628-ebb3-41b9-a12b-44d508077654 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 204 len: 0 microversion: 2.1 time: 0.115441 Aug 31 01:07:14.272224 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1741/3431] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:07:14 2022] DELETE /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 01:07:14.281221 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0a65b405-ff64-4d71-8caf-918e0d0e9c11 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:14.281941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0a65b405-ff64-4d71-8caf-918e0d0e9c11 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:14.287916 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a65b405-ff64-4d71-8caf-918e0d0e9c11 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:14.288410 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a65b405-ff64-4d71-8caf-918e0d0e9c11 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:14.288833 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a65b405-ff64-4d71-8caf-918e0d0e9c11 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:14.289512 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a65b405-ff64-4d71-8caf-918e0d0e9c11 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:14.289960 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a65b405-ff64-4d71-8caf-918e0d0e9c11 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:14.290380 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a65b405-ff64-4d71-8caf-918e0d0e9c11 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:14.424689 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0a65b405-ff64-4d71-8caf-918e0d0e9c11 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:07:14.432356 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0a65b405-ff64-4d71-8caf-918e0d0e9c11 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1681 microversion: 2.1 time: 0.155917 Aug 31 01:07:14.432906 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1691/3432] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:07:14 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:07:15.454989 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7033eced-6380-43ff-a311-e202a17b36db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:15.455719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7033eced-6380-43ff-a311-e202a17b36db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:15.462248 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7033eced-6380-43ff-a311-e202a17b36db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:15.462728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7033eced-6380-43ff-a311-e202a17b36db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:15.463189 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7033eced-6380-43ff-a311-e202a17b36db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:15.463875 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7033eced-6380-43ff-a311-e202a17b36db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:15.464352 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7033eced-6380-43ff-a311-e202a17b36db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:15.464779 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7033eced-6380-43ff-a311-e202a17b36db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:15.601384 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7033eced-6380-43ff-a311-e202a17b36db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:07:15.610066 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7033eced-6380-43ff-a311-e202a17b36db tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1681 microversion: 2.1 time: 0.160016 Aug 31 01:07:15.610629 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1742/3433] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:07:15 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:07:16.632490 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3fe5b42-401b-4de3-a760-265400ff8501 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:16.633007 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3fe5b42-401b-4de3-a760-265400ff8501 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:16.639600 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fe5b42-401b-4de3-a760-265400ff8501 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:16.640087 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fe5b42-401b-4de3-a760-265400ff8501 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:16.640521 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fe5b42-401b-4de3-a760-265400ff8501 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:16.641233 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fe5b42-401b-4de3-a760-265400ff8501 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:16.641663 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fe5b42-401b-4de3-a760-265400ff8501 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:16.642079 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fe5b42-401b-4de3-a760-265400ff8501 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:16.833002 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e3fe5b42-401b-4de3-a760-265400ff8501 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26826ddf92124c95835a5356e13040bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b67e536fd414591b859c1a89808e1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 01:07:16.840657 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3fe5b42-401b-4de3-a760-265400ff8501 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 200 len: 1681 microversion: 2.1 time: 0.212178 Aug 31 01:07:16.842387 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1692/3434] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:07:16 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 01:07:17.187011 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-bfae4b65-0b89-4c55-8ea3-3a89067b6d00 req-49d94763-1f04-4f81-aba6-fa926a2d4798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a16cb4-fdbd-4287-a812-82504cc530c7", "name": "network-vif-deleted", "tag": "eb4c5553-59c8-4e53-8f58-aa596211d976"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:07:17.197596 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-bfae4b65-0b89-4c55-8ea3-3a89067b6d00 req-49d94763-1f04-4f81-aba6-fa926a2d4798 service nova] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:17.198150 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-bfae4b65-0b89-4c55-8ea3-3a89067b6d00 req-49d94763-1f04-4f81-aba6-fa926a2d4798 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:17.198578 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-bfae4b65-0b89-4c55-8ea3-3a89067b6d00 req-49d94763-1f04-4f81-aba6-fa926a2d4798 service nova] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:17.212392 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-bfae4b65-0b89-4c55-8ea3-3a89067b6d00 req-49d94763-1f04-4f81-aba6-fa926a2d4798 service nova] Creating event network-vif-deleted:eb4c5553-59c8-4e53-8f58-aa596211d976 for instance 01a16cb4-fdbd-4287-a812-82504cc530c7 on hv-cinder-85506 Aug 31 01:07:17.218314 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-bfae4b65-0b89-4c55-8ea3-3a89067b6d00 req-49d94763-1f04-4f81-aba6-fa926a2d4798 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036125 Aug 31 01:07:17.219148 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1743/3435] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 31 01:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:17.864061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:17.864675 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:17.871370 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:17.871968 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:17.872597 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:17.873505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:17.873975 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:17.874449 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:17.889112 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 HTTP/1.1 Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:07:17.890771 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:17.892232 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '01a16cb4-fdbd-4287-a812-82504cc530c7'} Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:17.892950 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:17.895258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:17.897033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:17.897033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bc8b08c1-dd02-4da2-b6db-16a5bb7757ff tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 404 len: 111 microversion: 2.1 time: 0.032043 Aug 31 01:07:17.897033 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1693/3436] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:07:17 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:17.901598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2deced47-93cb-417f-a38d-7dd8047979da tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '.version_select at 0x7fa7f41c3790>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:17.922253 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2deced47-93cb-417f-a38d-7dd8047979da tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712188729" status: 202 len: 0 microversion: 2.1 time: 0.024751 Aug 31 01:07:17.922828 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1744/3437] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 31 01:07:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712188729 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 01:07:19.674061 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:19.674592 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:19.681408 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:19.681886 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:19.682311 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:19.682987 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:19.683459 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:19.683878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:19.697865 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 HTTP/1.1 Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:07:19.699492 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:19.701160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '01a16cb4-fdbd-4287-a812-82504cc530c7'} Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:19.701912 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:19.703256 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:19.704569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:19.704569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0859cef1-586c-4caa-aea6-50acb4e7545f tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 404 len: 111 microversion: 2.1 time: 0.031104 Aug 31 01:07:19.704569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1694/3438] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:07:19 2022] DELETE /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:19.709941 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:19.710665 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 01a16cb4-fdbd-4287-a812-82504cc530c7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:19.717673 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:19.718151 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:19.718579 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:19.719524 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:19.720061 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:19.720521 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:19.734686 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 HTTP/1.1 Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:07:19.736325 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:19.737700 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': '01a16cb4-fdbd-4287-a812-82504cc530c7'} Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:19.738495 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. Aug 31 01:07:19.739627 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:19.740584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance 01a16cb4-fdbd-4287-a812-82504cc530c7 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:19.740584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-910792bb-108e-4ad2-9eb0-e4cd54874a1c tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7" status: 404 len: 111 microversion: 2.1 time: 0.032062 Aug 31 01:07:19.740584 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1745/3439] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:07:19 2022] GET /compute/v2.1/servers/01a16cb4-fdbd-4287-a812-82504cc530c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:20.876830 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:20.877310 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:20.884070 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:20.884633 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:20.885187 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:20.885941 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:20.886398 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:20.886820 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:20.901493 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf HTTP/1.1 Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:07:20.903053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:07:20.904575 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'fefe8ad6-db69-4013-99c8-0a6427495baf'} Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:20.905670 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:07:20.907202 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.908504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:20.908504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-acfc2387-9ea1-4fd7-b862-c5ae36d4c963 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 404 len: 111 microversion: 2.1 time: 0.032068 Aug 31 01:07:20.908504 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1695/3440] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:07:20 2022] DELETE /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:20.913789 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:20.914394 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: fefe8ad6-db69-4013-99c8-0a6427495baf] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:20.921282 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:20.921750 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:20.922178 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:20.922854 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:20.923329 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:20.923743 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:20.937764 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf HTTP/1.1 Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:07:20.939308 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:07:20.940728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': 'fefe8ad6-db69-4013-99c8-0a6427495baf'} Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:20.941546 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. Aug 31 01:07:20.942902 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.944200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance fefe8ad6-db69-4013-99c8-0a6427495baf could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:20.944200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ec2f241d-2903-4854-a21c-de77413e25e4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf" status: 404 len: 111 microversion: 2.1 time: 0.030680 Aug 31 01:07:20.944200 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1746/3441] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:07:20 2022] GET /compute/v2.1/servers/fefe8ad6-db69-4013-99c8-0a6427495baf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:20.949003 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:20.949494 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:20.956124 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:20.956604 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:20.957029 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:20.957713 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:20.958160 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:20.958577 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:20.972619 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c HTTP/1.1 Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:07:20.974166 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:07:20.975527 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '12b2858e-c473-44bb-a7f4-5e520c11b66c'} Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:20.976185 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:07:20.977276 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:20.978435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:20.978435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1f90f9f1-bee2-40a4-96a5-77d5a8049def tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 404 len: 111 microversion: 2.1 time: 0.030408 Aug 31 01:07:20.978435 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1696/3442] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:07:20 2022] DELETE /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:20.985184 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:20.985788 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: 12b2858e-c473-44bb-a7f4-5e520c11b66c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:20.992606 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:20.993085 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:20.993577 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:20.994266 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:20.994881 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:20.995494 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:21.009768 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c HTTP/1.1 Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:07:21.011318 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:07:21.012838 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': '12b2858e-c473-44bb-a7f4-5e520c11b66c'} Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:21.013646 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. Aug 31 01:07:21.015709 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:21.016878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance 12b2858e-c473-44bb-a7f4-5e520c11b66c could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:21.016878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-56b4f9a3-5401-46f5-81ef-02a5dc1d2cd4 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c" status: 404 len: 111 microversion: 2.1 time: 0.031312 Aug 31 01:07:21.016878 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1747/3443] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:07:20 2022] GET /compute/v2.1/servers/12b2858e-c473-44bb-a7f4-5e520c11b66c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:22.151136 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:22.151655 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:22.158569 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:22.159053 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:22.159505 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:22.160184 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:22.160628 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:22.161041 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:22.174237 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 HTTP/1.1 Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:07:22.175789 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: > Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:07:22.177194 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'b121863b-98ef-451b-be2a-2f3f615e4456'} Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:22.178040 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:07:22.179258 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:22.180797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:22.180797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3fca1f8-3e49-49d6-8642-a9811271f154 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 404 len: 111 microversion: 2.1 time: 0.029893 Aug 31 01:07:22.180797 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1697/3444] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 31 01:07:22 2022] DELETE /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:22.185393 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:22.186697 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] [instance: b121863b-98ef-451b-be2a-2f3f615e4456] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 01:07:22.192966 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:22.193466 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:22.193888 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:22.194552 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Acquiring lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 01:07:22.194990 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 01:07:22.195430 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Lock "17a2f83e-804b-4b78-9634-80dd5da1cac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 01:07:22.209505 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] HTTP exception thrown: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Request method failure captured: Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 HTTP/1.1 Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDrJI1wjkHLqTMsySPVLa9M7PE0hHP1GMwVl8kkIhF2udBO7wJOqP-kAgEHbCFKFbXoM2d5PIDlKa2p6rEHcz7GtRVxgWu9t7iQLGTnuhs-PBZbXn1bSwddIx2S-pgAMxh9R68Y_2XCohi47crocVsDGIIIWLcBb1EoqdWJyZjrkAWPw Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:07:22.210998 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6b67e536fd414591b859c1a89808e1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6b67e536fd414591b859c1a89808e1a6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6b67e536fd414591b859c1a89808e1a6 Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737806414 Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 26826ddf92124c95835a5356e13040bf Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-737806414-project Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: > Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:07:22.212414 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': 'b121863b-98ef-451b-be2a-2f3f615e4456'} Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:22.213210 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. Aug 31 01:07:22.214474 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:22.215635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] Returning 404 to user: Instance b121863b-98ef-451b-be2a-2f3f615e4456 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:22.215635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ca414ade-8663-4f86-84d9-e01efaf2f1e1 tempest-AttachVolumeNegativeTest-737806414 tempest-AttachVolumeNegativeTest-737806414-project] 10.222.0.67 "GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456" status: 404 len: 111 microversion: 2.1 time: 0.030695 Aug 31 01:07:22.215635 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1748/3445] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 31 01:07:22 2022] GET /compute/v2.1/servers/b121863b-98ef-451b-be2a-2f3f615e4456 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:26.757719 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-94f95b6a-d892-4590-8066-f8477e054ae5 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Action: 'create', calling method: .version_select at 0x7fa7f7599430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1281154071"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:07:27.043279 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-94f95b6a-d892-4590-8066-f8477e054ae5 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.409116 Aug 31 01:07:27.043894 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1698/3446] 10.222.0.67 () {60 vars in 1155 bytes} [Wed Aug 31 01:07:26 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 410 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 01:07:27.057321 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-80bea6b2-a38c-4653-9593-3c5dd33d58c1 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7f7711670>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:27.109068 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-80bea6b2-a38c-4653-9593-3c5dd33d58c1 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30" status: 200 len: 345 microversion: 2.1 time: 0.055408 Aug 31 01:07:27.109643 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1749/3447] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 01:07:27 2022] GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:28.123621 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f5c9e7d6-73c6-46fb-a99e-354da0182bd7 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7ef9c4550>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:28.172153 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f5c9e7d6-73c6-46fb-a99e-354da0182bd7 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30" status: 200 len: 346 microversion: 2.1 time: 0.052848 Aug 31 01:07:28.172709 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1699/3448] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 01:07:28 2022] GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:28.187617 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9994522f-89b8-4511-9cf6-42067e2776e6 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Action: 'create', calling method: .version_select at 0x7fa7f76d8550>, body: {"snapshot": {"volume_id": "a0532a86-e817-4ed1-8914-227d21512c30", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-998046649"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 01:07:28.345243 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9994522f-89b8-4511-9cf6-42067e2776e6 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.162385 Aug 31 01:07:28.346168 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1750/3449] 10.222.0.67 () {60 vars in 1162 bytes} [Wed Aug 31 01:07:28 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:28.358759 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c04be5c9-3647-4238-a952-825dd079ab9e tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7eff02c10>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:28.397897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c04be5c9-3647-4238-a952-825dd079ab9e tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881" status: 200 len: 286 microversion: 2.1 time: 0.043630 Aug 31 01:07:28.398499 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1700/3450] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 31 01:07:28 2022] GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:28.411375 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3a41d292-44b1-44ac-afc6-f0cf07ed4468 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7f76d8a60>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:28.445919 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3a41d292-44b1-44ac-afc6-f0cf07ed4468 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038475 Aug 31 01:07:28.446487 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1751/3451] 10.222.0.67 () {58 vars in 1140 bytes} [Wed Aug 31 01:07:28 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:28.457911 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e9895433-1657-462e-9697-5da0f172878a tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7f74ade50>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:28.487491 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e9895433-1657-462e-9697-5da0f172878a tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881" status: 200 len: 286 microversion: 2.1 time: 0.033267 Aug 31 01:07:28.488134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1701/3452] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 31 01:07:28 2022] GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:29.500794 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5bf467cf-8fed-4ed1-a781-b2dc94bf4fc8 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7efd378b0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:29.531164 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5bf467cf-8fed-4ed1-a781-b2dc94bf4fc8 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881" status: 200 len: 286 microversion: 2.1 time: 0.034933 Aug 31 01:07:29.531728 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1752/3453] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 31 01:07:29 2022] GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:30.544022 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c65efaf7-9478-4c90-9eb4-569fc584c2ee tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7ef9c4940>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:30.574699 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c65efaf7-9478-4c90-9eb4-569fc584c2ee tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881" status: 200 len: 286 microversion: 2.1 time: 0.034827 Aug 31 01:07:30.575286 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1702/3454] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 31 01:07:30 2022] GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:31.587615 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b700fe82-7bc3-4ebd-85db-fc8a693b3eca tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7efd95550>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:31.617438 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b700fe82-7bc3-4ebd-85db-fc8a693b3eca tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881" status: 200 len: 286 microversion: 2.1 time: 0.034113 Aug 31 01:07:31.618014 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1753/3455] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 31 01:07:31 2022] GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:32.627384 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=20 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:07:32.628134 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:07:32.632107 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-74033e9d-335c-4dda-9792-d1b9c76e4b78 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7f758b0d0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:32.663704 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-74033e9d-335c-4dda-9792-d1b9c76e4b78 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881" status: 200 len: 286 microversion: 2.1 time: 0.037570 Aug 31 01:07:32.664293 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1703/3456] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 31 01:07:32 2022] GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:33.673937 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:07:33.674796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 01:07:33.679290 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aed4636a-573c-4229-beb6-0da8f01da247 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7efebf4c0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:33.713663 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aed4636a-573c-4229-beb6-0da8f01da247 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881" status: 200 len: 287 microversion: 2.1 time: 0.040452 Aug 31 01:07:33.714235 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1754/3457] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 31 01:07:33 2022] GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:33.728961 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6c93cef2-5ea8-4c1f-8383-d1bad847387d tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7f7627d30>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:33.792296 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6c93cef2-5ea8-4c1f-8383-d1bad847387d tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881" status: 202 len: 0 microversion: 2.1 time: 0.068494 Aug 31 01:07:33.792878 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1704/3458] 10.222.0.67 () {58 vars in 1254 bytes} [Wed Aug 31 01:07:33 2022] DELETE /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 01:07:33.802043 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-42bf06d3-e329-451e-ab21-599fd5f7a53e tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7efebf310>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:33.831532 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-42bf06d3-e329-451e-ab21-599fd5f7a53e tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881" status: 200 len: 286 microversion: 2.1 time: 0.033410 Aug 31 01:07:33.832101 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1755/3459] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 31 01:07:33 2022] GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:34.845357 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4327dba8-e434-4cd3-a011-9a9352f2cb3e tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7ef9c3160>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:34.870189 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-4327dba8-e434-4cd3-a011-9a9352f2cb3e tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] HTTP exception thrown: Snapshot 1d781bf1-8d29-468a-a267-1aacc0d67881 could not be found. Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4327dba8-e434-4cd3-a011-9a9352f2cb3e tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Request method failure captured: Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 HTTP/1.1 Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrROkfU77p4BFZXhDfozq8HGzJuK1qYX9sqprY7Jb6XUr7T6vL9yiIUag2qhCWXRmD0b6-vxMjtGreEQ_SH3SQtgwwkkn74yRFnWYbQYvwa6xYbc0HhB4Wtdy7P2n34uxvB4Jsv0QJM16XLFX8sTaZX6sWazJDAR8XJu1n87F7Zx-9M Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: be57e81a767549cda9c3f913eb8c02fc Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:07:34.872457 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_be57e81a767549cda9c3f913eb8c02fc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: be57e81a767549cda9c3f913eb8c02fc Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesSnapshotsTestJSON-1744748378-project Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 678dcce1cb964238888c27efb68689c3 Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1744748378-project Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Snapshot 1d781bf1-8d29-468a-a267-1aacc0d67881 could not be found. Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': '1d781bf1-8d29-468a-a267-1aacc0d67881'} Aug 31 01:07:34.874477 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1d781bf1-8d29-468a-a267-1aacc0d67881 could not be found. (HTTP 404) (Request-ID: req-b6d5d3e9-490b-4fc3-b6fd-8f926983def7) Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:34.875613 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:07:34.876933 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1d781bf1-8d29-468a-a267-1aacc0d67881 could not be found. Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 01:07:34.878451 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1d781bf1-8d29-468a-a267-1aacc0d67881 could not be found. Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1d781bf1-8d29-468a-a267-1aacc0d67881 could not be found. Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4327dba8-e434-4cd3-a011-9a9352f2cb3e tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Returning 404 to user: Snapshot 1d781bf1-8d29-468a-a267-1aacc0d67881 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:34.879875 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4327dba8-e434-4cd3-a011-9a9352f2cb3e tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881" status: 404 len: 111 microversion: 2.1 time: 0.033713 Aug 31 01:07:34.880940 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1705/3460] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 31 01:07:34 2022] GET /compute/v2.1/os-snapshots/1d781bf1-8d29-468a-a267-1aacc0d67881 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:34.882963 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b48b4c53-15fa-471e-81cd-2fcc13d0e492 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7f410a820>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:34.944547 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b48b4c53-15fa-471e-81cd-2fcc13d0e492 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30" status: 202 len: 0 microversion: 2.1 time: 0.065623 Aug 31 01:07:34.945129 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1756/3461] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 31 01:07:34 2022] DELETE /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 01:07:34.954925 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d3675e77-e99a-4040-a89c-3015cf2850ee tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7f7627670>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:35.004895 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d3675e77-e99a-4040-a89c-3015cf2850ee tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30" status: 200 len: 345 microversion: 2.1 time: 0.055425 Aug 31 01:07:35.005481 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1706/3462] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 01:07:34 2022] GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 01:07:36.020426 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0922ac17-60b1-4116-848b-24d0988714b5 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7efebfee0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:36.047765 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-0922ac17-60b1-4116-848b-24d0988714b5 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] HTTP exception thrown: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0922ac17-60b1-4116-848b-24d0988714b5 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Request method failure captured: Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30 HTTP/1.1 Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDrROkfU77p4BFZXhDfozq8HGzJuK1qYX9sqprY7Jb6XUr7T6vL9yiIUag2qhCWXRmD0b6-vxMjtGreEQ_SH3SQtgwwkkn74yRFnWYbQYvwa6xYbc0HhB4Wtdy7P2n34uxvB4Jsv0QJM16XLFX8sTaZX6sWazJDAR8XJu1n87F7Zx-9M Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: be57e81a767549cda9c3f913eb8c02fc Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:07:36.049943 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_be57e81a767549cda9c3f913eb8c02fc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: be57e81a767549cda9c3f913eb8c02fc Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesSnapshotsTestJSON-1744748378-project Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 678dcce1cb964238888c27efb68689c3 Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1744748378-project Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': 'a0532a86-e817-4ed1-8914-227d21512c30'} Aug 31 01:07:36.051556 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. (HTTP 404) (Request-ID: req-a6348c93-7690-48f1-9e4e-f449c84905ec) Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:36.052376 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:07:36.053576 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 01:07:36.054638 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0922ac17-60b1-4116-848b-24d0988714b5 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Returning 404 to user: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0922ac17-60b1-4116-848b-24d0988714b5 tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30" status: 404 len: 109 microversion: 2.1 time: 0.035215 Aug 31 01:07:36.055732 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1757/3463] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 01:07:36 2022] GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 01:07:36.066316 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ffecbe30-ab4a-4434-bc9e-23a3bcfd254b tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7f75fb040>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:36.094234 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-ffecbe30-ab4a-4434-bc9e-23a3bcfd254b tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] HTTP exception thrown: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ffecbe30-ab4a-4434-bc9e-23a3bcfd254b tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Request method failure captured: Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30 HTTP/1.1 Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept: application/json Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Connection: close Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Length: 0 Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Content-Type: application/json Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Host: 10.222.0.67 Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjDrROkfU77p4BFZXhDfozq8HGzJuK1qYX9sqprY7Jb6XUr7T6vL9yiIUag2qhCWXRmD0b6-vxMjtGreEQ_SH3SQtgwwkkn74yRFnWYbQYvwa6xYbc0HhB4Wtdy7P2n34uxvB4Jsv0QJM16XLFX8sTaZX6sWazJDAR8XJu1n87F7Zx-9M Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Id: be57e81a767549cda9c3f913eb8c02fc Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Role: reader,member Aug 31 01:07:36.096514 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Roles: reader,member Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_be57e81a767549cda9c3f913eb8c02fc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Id: be57e81a767549cda9c3f913eb8c02fc Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesSnapshotsTestJSON-1744748378-project Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Id: 678dcce1cb964238888c27efb68689c3 Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1744748378-project Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: method: Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: exception: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: action_args: {'id': 'a0532a86-e817-4ed1-8914-227d21512c30'} Aug 31 01:07:36.097964 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. (HTTP 404) (Request-ID: req-5c2d6f1b-cba4-4810-93e9-5b551402f4df) Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:36.098897 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 01:07:36.100272 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 01:07:36.101580 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ffecbe30-ab4a-4434-bc9e-23a3bcfd254b tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Returning 404 to user: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:36.102845 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ffecbe30-ab4a-4434-bc9e-23a3bcfd254b tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30" status: 404 len: 109 microversion: 2.1 time: 0.035871 Aug 31 01:07:36.103919 dv-cinder-855060-1-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1707/3464] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 31 01:07:36 2022] DELETE /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 01:07:36.106423 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b11f2c7d-eb31-41ce-a449-7bc636fde69a tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Calling method '.version_select at 0x7fa7efd95f70>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 01:07:36.135796 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-b11f2c7d-eb31-41ce-a449-7bc636fde69a tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] HTTP exception thrown: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b11f2c7d-eb31-41ce-a449-7bc636fde69a tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Request method failure captured: Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30 HTTP/1.1 Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept: application/json Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Connection: close Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Length: 0 Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Content-Type: application/json Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Host: 10.222.0.67 Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjDrROkfU77p4BFZXhDfozq8HGzJuK1qYX9sqprY7Jb6XUr7T6vL9yiIUag2qhCWXRmD0b6-vxMjtGreEQ_SH3SQtgwwkkn74yRFnWYbQYvwa6xYbc0HhB4Wtdy7P2n34uxvB4Jsv0QJM16XLFX8sTaZX6sWazJDAR8XJu1n87F7Zx-9M Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Id: be57e81a767549cda9c3f913eb8c02fc Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Role: reader,member Aug 31 01:07:36.137719 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Roles: reader,member Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/be57e81a767549cda9c3f913eb8c02fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_be57e81a767549cda9c3f913eb8c02fc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Id: be57e81a767549cda9c3f913eb8c02fc Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1744748378 Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesSnapshotsTestJSON-1744748378-project Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Id: 678dcce1cb964238888c27efb68689c3 Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1744748378-project Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: method: Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: exception: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: action_args: {'id': 'a0532a86-e817-4ed1-8914-227d21512c30'} Aug 31 01:07:36.139182 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. (HTTP 404) (Request-ID: req-8d333760-a3d8-463d-aaef-84b7ac7b2883) Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:36.140128 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 01:07:36.141598 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 01:07:36.142910 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b11f2c7d-eb31-41ce-a449-7bc636fde69a tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] Returning 404 to user: Volume a0532a86-e817-4ed1-8914-227d21512c30 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b11f2c7d-eb31-41ce-a449-7bc636fde69a tempest-VolumesSnapshotsTestJSON-1744748378 tempest-VolumesSnapshotsTestJSON-1744748378-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30" status: 404 len: 109 microversion: 2.1 time: 0.036549 Aug 31 01:07:36.144172 dv-cinder-855060-1-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1758/3465] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 31 01:07:36 2022] GET /compute/v2.1/os-volumes/a0532a86-e817-4ed1-8914-227d21512c30 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0)